PySpark Jobs

101 to 125 of 194 PySpark Jobs

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Concept Resourcing
V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of more »
Employment Type: Contract
Rate: £500 - £600/day
Posted:

Data Engineering Lead

London, United Kingdom
RedCat Digital
cross functional teams entrusted with business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong more »
Salary: £ 100 K
Posted:

Data Engineer (Contract)

United Kingdom
Hybrid / WFH Options
OpenSource
Programming: Proficiency in Python, SQL. Microsoft Azure: Experience with Azure Synapse Analytics and Azure Data Factory. ETL: Experience in designing and managing ETL processes. PySpark: Strong experience with PySpark. Remote Work: Effective communication and collaboration skills. We look forward to receiving your application more »
Posted:

Lead Data Scientist

Exeter, Devon, South West, United Kingdom
Hybrid / WFH Options
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Employment Type: Permanent, Work From Home
Posted:

Technical Product Specialist

London Area, United Kingdom
Smartedge Solutions
Banking and Financial Services sector is advantageous. Deep knowledge or experience with using as much of the following: Azure Cloud Data Components | Databricks | Python | PySpark | Terraform | APIs | Lakehouse | Data Mesh | Nosql DBs | GitHub Oversee the evolution of the data platform, encompassing data pipelines, storage, and processing. Establish and nurture more »
Posted:

Senior Full Stack Developer

Saffron Walden, Essex, South East, United Kingdom
Hybrid / WFH Options
EMBL-EBI
expertise and requirements. You have A BSc or MSc in computer science or related fields. Expertise in Python, including popular Python libraries: NumPy, Pandas, PySpark and frameworks: Django, Django Rest Framework, FastAPI Hands-on experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis). Strong more »
Employment Type: Permanent, Work From Home
Salary: £85,000
Posted:

Senior Data Scientist - Probabilistic Modelling

South Harting, England, United Kingdom
Hybrid / WFH Options
Adecco
learning, probability, statistics, and quantitative risk modelling. High proficiency in Python and SQL. Experience with big data technologies and tools such as Databricks and PySpark is highly desirable. Essential experience in Probabilistic Risk Modelling. Highly desirable experience with Monte Carlo, Capula, Gamma, Statistical modelling, financial modelling, and Stochastic modelling. more »
Posted:

Senior Technical Business Analyst

London Area, United Kingdom
InfoCepts
and industry standards for the organization. Strong experience on Azure cloud services like Azure, ADF, ADLS, Synapse Proficiency in querying languages such as SQL, Pyspark, Python and familiarity with data visualization tools (e.g. Power BI). Strong communication skills to gather the business requirements from stakeholder and propose best more »
Posted:

Senior Data Scientist (Insurance)

Surrey, England, United Kingdom
Hybrid / WFH Options
Hawksworth
that are comfortable with terms like; Statistical Models, Computer Vision, Predictive Analytics, Data Visualization, Large Language Models (LLM), NLP, AI, Machine Learning, MLOPs, Python, Pyspark, and Azure. Flexible Working : The role is 60% work from home Sponsorship : Sadly sponsorship isn't available for these roles. About You: Bachelors Degree more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
MBN Solutions
Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns and implementation Benefits : £50-£60k DOE Mainly home based more »
Posted:

Data Engineer

North Yorkshire, England, United Kingdom
KDR Talent Solutions
a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would more »
Posted:

Senior Data Engineer - Databricks - JSON - SQL - Azure - Remote

United Kingdom
Hybrid / WFH Options
Tech Talent ID
tools and technologies, including - Demonstrable professional Data experience Experience of working with semi or unstructured data sets like JSON Excellent understanding of DataBricks and PySpark Excellent understanding of SQL and CosmosDB databases Excellent knowledge of designing, constructing, administering, and maintaining data warehouses and data lakes. Knowledge of Azure Cloud more »
Employment Type: Permanent
Salary: GBP 70,000 Annual
Posted:

Big Data Developer

Glasgow, Scotland, United Kingdom
Morgan McKinley
Proficiency in modern programming languages and database querying languages. Comprehensive understanding of the Software Development Life Cycle and Agile methodologies. Familiarity with Python or PySpark and cloud technologies like AWS, Kubernetes, and Spark is highly desirable. Ideal Candidate: Someone with a knack for innovative solutions and a commitment to more »
Posted:

Senior Data Engineer

Nottingham, Nottinghamshire, East Midlands, United Kingdom
Experian Ltd
Glue and SageMaker Infrastructure-as-Code tools and approaches (we use the AWS CDK with CloudFormation) Data processing frameworks such as pandas, Spark and PySpark Machine learning concepts like model training, model registry, model deployment and monitoring Development and CI/CD tools (we use GitHub, CodePipeline and CodeBuild more »
Employment Type: Permanent
Posted:

Lead Azure Data Engineer

London, United Kingdom
Hybrid / WFH Options
Method Resourcing
tracking. As a Data Engineer, you will be able to demonstrate strong experience in a majority of the following:Extensive experience in Python/PySpark coding and development, as well as SQL Expertise in AWS - ADF, Synpase, Databricks, Function Apps, Logic AppsPrevious commercial experience in cloud migration projectsYou have more »
Salary: £ 80 K
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Pyspark, Databricks Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance. Please apply today more »
Posted:

Manager of Data Science - MIS

Brighton, East Sussex, United Kingdom
American Express
field like engineering, mathematics, statistics or operations research is a must. Masters in a relevant field will be an added advantage.Preferred Qualifications:Knowledge of PySpark, Hive & other big data tools & techniques.Experience with data visualization tools, such as Tableau, Power BI, or similar tools, to efficiently communicate complex analyses and more »
Salary: £ 70 K
Posted:

Data Designer

Norwich, England, United Kingdom
Aviva
and garnering support for data engineering initiatives across different departments and levels of the organisation Strong understanding in technology such as AWS cloud, Glue, Pyspark, Python, SQL, and Database design concepts or experience in implementing data pipelines would be What you’ll get for this role: Our purpose - with more »
Posted:

Contract Senior Data Engineer

Greater Manchester, England, United Kingdom
Hybrid / WFH Options
MRJ Recruitment
experience working directly with C-Suite execs. Technical Expertise Needed At least 3 years Databrick s (must have) Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data Migration more »
Posted:

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Mace group
help cement Mace’s position as a provider of a Premium technical service.The ideal candidate must have extensive experience of working with Python/PySpark, data pipelines, Azure Databricks (or similar) and data warehousing platforms, as well as a good working knowledge of T-SQL.You will play a leading … languages. Experience with data structures/algorithms, building Data Platforms, Data-lake and Business Intelligence solutions.Experience as a data engineer: implementing data pipelines (using PySpark, Spark SQL, Scala, etc), orchestration tools/services (i.e. Airflow, data factory) and testing frameworks.1 year plus of experience in a technical leadership roleExperience more »
Salary: £ 70 K
Posted:

Palantir Data Engineer

Nationwide, United Kingdom
Adecco
data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in Palantir Foundry Design, develop and deploy data solutions in Palantir with excellent skills in PySpark and Spark SQL for data transformations Experience in designing and building interactive data applications working with Ontology, actions, functions, object views, automate, indexing, data more »
Employment Type: Permanent
Salary: £85000 - £95000/annum + perm benefits
Posted:

Senior Data Engineer

United Kingdom
Hybrid / WFH Options
Found By Few
for: -Data Engineering + Data Science Experience -Strong ETL Experience -Experience with Computer Vision -Experience in Remote Sensing highly desirable Stack: Python, PyTorch, AirFlow, PySpark (equivalent tools are fine more »
Posted:

Lead Data Engineer - £100K - Hybrid

City of London, London, United Kingdom
Hybrid / WFH Options
Develop
Modeling within a cloud-based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to work with more »
Employment Type: Permanent
Salary: £80000 - £100000/annum
Posted:

Lead Machine Learning Engineer

London, United Kingdom
Harnham
in retail/marketing but not requiredCandidates should be looking to work in a fast paced startup feel environmentTech across: Python, SQL, AWS, Databricks, PySpark, AB Testing, MLFlow, APIsApply below!CONTACTIf you can’t see what you’re looking for right now, send us your CV anyway – we’re more »
Salary: £ 100 K
Posted:

Senior Data Scientist

London Area, United Kingdom
Higher - AI recruitment
experience-related problems such as workforce management, demand forecasting, or root cause analysis Strong visualisation skills including experience with Tableau Familiarity with Databricks and PySpark for data manipulation and analysis Familiarity with Git-based source control methodologies, including branching and pull requests A self-starter, passionate about converting data more »
Posted:
PySpark
10th Percentile
£52,500
25th Percentile
£58,438
Median
£70,000
75th Percentile
£90,000
90th Percentile
£100,000