PySpark Jobs in the UK

51 to 75 of 98 PySpark Jobs in the UK

Lead Data Engineer

London, England, United Kingdom
Arrows
preferably GCP | Expertise in event-driven data integrations and click-stream ingestion | Proven ability in stakeholder management and project leadership | Proficiency in SQL, Python, PySpark | Solid background in data pipeline orchestration, data access, and retention tooling | Demonstrable impact on infrastructure scalability and data privacy initiatives | Collaborative spirit | Innovative problem more »
Posted:

Data Scientist

London, United Kingdom
Tria
Mid-or-Senior level Data Scientist Solid knowledge of Data Engineering principles, including productionisation Technical experience with some or all of the following: Python, PySpark, scikit-learn, pandas, Azure Data Services, Databricks. If this sounds of interest, please apply. more »
Employment Type: Contract
Rate: £600 - £640/day
Posted:

Lead Data Engineer - 100K - Hybrid.

London, United Kingdom
Hybrid / WFH Options
developrec
experience in Data Modeling within a cloud-based data platformStrong experience with SQL ServerAzure data engineering stack, including Azure Synapse and Azure Data LakePython, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to work with more »
Salary: £ 100 K
Posted:

Technical Data Business Analyst - Workday HCM

City of London, London, United Kingdom
Concept Resourcing
Requirements: 3+ years as a Business Analyst. Proficiency in ERP/CRM solutions and data, including Workday HCM Strong Azure data skills. Proficiency in PySpark, Java, or Python. Familiarity with Kimball data modeling and SQL. Experience with Power BI and CI/CD practices. Nice to Have: B2B supply more »
Employment Type: Contract
Rate: £550 - £600/day Inside IR35
Posted:

Python App Developer

Glasgow, Scotland, United Kingdom
Hybrid / WFH Options
Synchro
contract position. If you possess a solid background in software application development, with experience in cloud or microservice architecture, and proficiency in Python or PySpark, we encourage you to apply. Python App Developer Requirements: Proficiency with Python or PySpark. Exposure to cloud technologies such as Airflow, Astronomer, Kubernetes, AWS more »
Posted:

Data Pipeline Engineer

London Area, United Kingdom
Hexegic
incorrect or not received on time. outages with the end users of a data pipeline What We Value reading and writing code in Python, Pyspark and Java. understanding of Spark and interested in learning the basics of tuning Spark jobs. pipeline monitoring team members should be able to use more »
Posted:

Data Engineer

London Area, United Kingdom
Hexegic
advice to analytical users on how they can access and utilise the new datasets. Qualities Comfortable with Python - ideally experience with Apache Spark and Pyspark Previous data analytics software experience Able to scope new integrations and translate analytical user needs into technical requirement. UK based – data analytics system can more »
Posted:

Data Engineer - AWS

London, United Kingdom
Boston Hale
performance, scalability, and reliability. Technical Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to a competitive annual salary, we more »
Employment Type: Permanent
Salary: £70,000
Posted:

Senior Data Engineer (AWS)

London Area, United Kingdom
Xcede
of 4 years commercial experience Strong proficiency in AWS and relevant technologies Good communication skills Preferably experience with some or all of the following; Pyspark, Kubernetes, Terraform Expeirence in a start-up/scale up or fast-paced environment is desirable. HOW TO APPLY Please register your interest by more »
Posted:

Python Developer - Data - Azure - Remote - Inside IR35

South East London, London, United Kingdom
Hybrid / WFH Options
The Bridge (IT Recruitment) Limited
a long term contract, inside IR35 on a remote basis. The key skills required for this Python Developer role are: Python ETL Azure Databricks Pyspark If you do have the required skills for this remote Python Developer contract, please do apply. more »
Employment Type: Contract, Work From Home
Rate: £520 - 540 per day
Posted:

Machine Learning Engineer

United Kingdom
Hybrid / WFH Options
Found By Few
on very complex systems Strong experience with Computer vision Longevity in their previous roles Experience with Remote Sensing highly desirable Stack: Python, PyTorch, AirFlow, PySpark (equivalent tools are fine more »
Posted:

Senior Data Scientist

London, Tottenham Court Road, United Kingdom
Be-IT Resourcing Ltd
engineering leaders/stakeholders in decision making and implementing the models into production. You will need to have hands on skills in Python and PySpark, experience working in a cloud environment and knowledge of development tools like Git or Docker. You can also expect to work with the latest more »
Employment Type: Permanent
Posted:

Data Engineer (AWS)

England, United Kingdom
Xcede
experience as a Data Engineer. Strong proficiency in AWS and relevant technologies Good communication skills Preferably experience with some or all of the following; Pyspark, Kubernetes, Terraform Expeirence in a start-up/scale up or fast-paced environment is desirable. HOW TO APPLY Please register your interest by more »
Posted:

Data Engineer

London Area, United Kingdom
Mars
to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data sources Design … Spark/Databricks or similar Experience working in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in more »
Posted:

AWS Data Engineer

SW19, Dundonald, Greater London, United Kingdom
DataBuzz
Engineer you will be pivotal in designing, developing, and maintaining data architecture and infrastructure. The ideal candidate should have a strong foundation in Python, PySpark, SQL, and ETL processes, along with proven experience in implementing solutions in a cloud environment. Roles & Responsibilities: Experienced Data Engineer with a background in … and mastering to management and distribution of large datasets. Mandatory Skills: 6+ Years of experience in Design, build, and maintain data pipelines using Python, PySpark and SQL. Develop and maintain ETL processes to move data from various data sources to our data warehouse on AWS. Collaborate with data scientists more »
Employment Type: Permanent
Salary: £50000 - £55000/annum
Posted:

AWS Data Engineer

South West London, London, United Kingdom
DATABUZZ LTD
Engineer you will be pivotal in designing, developing, and maintaining data architecture and infrastructure. The ideal candidate should have a strong foundation in Python, PySpark, SQL, and ETL processes, along with proven experience in implementing solutions in a cloud environment. Roles & Responsibilities: Experienced Data Engineer with a background in … and mastering to management and distribution of large datasets. Mandatory Skills: 6+ Years of experience in Design, build, and maintain data pipelines using Python, PySpark and SQL. Develop and maintain ETL processes to move data from various data sources to our data warehouse on AWS. Collaborate with data scientists more »
Employment Type: Permanent
Salary: £55,000
Posted:

Data Architect

Greater Bristol Area, United Kingdom
Infinity Quest
up with a high performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting and implementing large scale data processing data storage data … delivery teams Supporting business development and ensuring high levels of client satisfaction during delivery Skills Must have strong hands-on technical Skills in Python Pyspark Azure Databricks Spark ETL Cloud Azure preferred Good to have knowledge on ADF CI CD more »
Posted:

Mid-Level & Senior Data Scientists- Hybrid/Bristol - Up to £90k

Bristol, England, United Kingdom
Hybrid / WFH Options
Adecco
experience in developing data ingestion pipelines with advanced ML elements. Degree in Computer Science, Data Science, Engineering, or related field. Proficient in Python, SQL, PySpark, and Databricks. Experience with modern NLP techniques and tools. Familiarity with Git for version control. Knowledge of the insurance sector is advantageous but not … Expertise in applied machine learning, probability, statistics, and quantitative risk modelling. High proficiency in Python and SQL, with experience in big data technologies (Databricks, PySpark). Experience in the insurance, cyber, or related domain preferred. Strong problem-solving and communication skills.Preferred Skills (Nice to Have): Knowledge of Monte Carlo more »
Posted:

Data Engineer - Azure Databricks - London - £75K

London, United Kingdom
Nigel Frank International
get the most from their data. They are looking for someone with core skills in SQL complimented with Azure experience (Azure Data Factory, Databricks, PySpark etc) This is a very exciting time to join as they shake things up across the industry, so please get in touch asap to … Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £65,000 - £75,000 Bonus To apply for this more »
Employment Type: Permanent
Salary: £65000 - £75000/annum bonus
Posted:

Azure Data Engineer - Remote - Up to GBP70,000

Olney, Buckinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
to d.moore1@nigelfrank.com or alternatively, give me a call on 0191 338 7577 Key Skills:Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLJob SummaryUp to 70,000 GBPDeveloper/Programmer RoleSkills: Microsoft, Azure, Data Factory, Data Lake … Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLLevel: Senior more »
Salary: £ 70 K
Posted:

Data Engineer

Guildford, England, United Kingdom
Hybrid / WFH Options
ADLIB Recruitment | B Corp™
Data Engineer We're partnering with a with a global financial services institution that are embarking on an ambitious project: to build an industry-leading data platform. The long-term vision is to migrate all data within the coming years more »
Posted:

Senior Data Engineer - Remote first.

England, United Kingdom
Hybrid / WFH Options
Revoco
I have placed quite a few candidates with this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure more »
Posted:

Python Team Lead Software Engineer Developer AWS Glue London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives … Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

England, United Kingdom
Hybrid / WFH Options
Revoco
I have placed quite a few candidates with this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure more »
Posted:

Data Engineer - Remote (UK based)

United kingdom, Fleet Street
Hybrid / WFH Options
Revoco
I have placed quite a few candidates with this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure more »
Employment Type: Permanent
Salary: £70000/annum
Posted:
PySpark
10th Percentile
£52,500
25th Percentile
£58,438
Median
£70,000
75th Percentile
£90,000
90th Percentile
£100,000