18 of 18 Apache Spark Jobs in Yorkshire

Senior DevOps Engineer

Hiring Organisation
BI:PROCSI
Location
Hull, East Yorkshire, UK
Employment Type
Full-time
automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

Senior DevOps Engineer

Hiring Organisation
BI:PROCSI
Location
Doncaster, South Yorkshire, UK
Employment Type
Full-time
automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

Senior DevOps Engineer

Hiring Organisation
BI:PROCSI
Location
York, North Yorkshire, UK
Employment Type
Full-time
automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

Solutions Architect

Hiring Organisation
X4 Technology
Location
Bradford, UK
Employment Type
Full-time
Certified Professional. Working knowledge of MLOps. Extensive experience in a consulting environment i.e. strong stakeholder engagement capability. Strong programming proficiency in Python, SQL, and Apache Spark, with a proven ability to design, optimise, and scale high-performance data pipelines for AI and analytics applications. Deep understanding of cloud ...

Solutions Architect

Hiring Organisation
X4 Technology
Location
Sheffield, UK
Employment Type
Full-time
Certified Professional. Working knowledge of MLOps. Extensive experience in a consulting environment i.e. strong stakeholder engagement capability. Strong programming proficiency in Python, SQL, and Apache Spark, with a proven ability to design, optimise, and scale high-performance data pipelines for AI and analytics applications. Deep understanding of cloud ...

Solutions Architect

Hiring Organisation
X4 Technology
Location
York, North Yorkshire, UK
Employment Type
Full-time
Certified Professional. Working knowledge of MLOps. Extensive experience in a consulting environment i.e. strong stakeholder engagement capability. Strong programming proficiency in Python, SQL, and Apache Spark, with a proven ability to design, optimise, and scale high-performance data pipelines for AI and analytics applications. Deep understanding of cloud ...

Data Engineer

Hiring Organisation
DCS Recruitment
Location
Sheffield, South Yorkshire, England, United Kingdom
Employment Type
Full-Time
Salary
£50,000 - £60,000 per annum
platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and Terraform. What ...

Senior Analytics Engineer

Hiring Organisation
Fruition Group
Location
Leeds, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£90,000
control. Excellent collaboration and communication skills, with strong attention to detail and data quality. Desirable: Exposure to AI/ML data preparation, Python or Spark, Data Vault 2.0, data governance, GDPR, and experience working in mobility, logistics, financial services, or tech-enabled environments. What ...

Senior Data Engineer (f/m/d)

Hiring Organisation
Awin Global
Location
Doncaster, South Yorkshire, UK
Employment Type
Full-time
technology (AWS or Azure). Strong experience with creation of data ingestion pipeline and ET process. Strong knowledge of big data tool such as Spark, Databricks and Python. Strong understanding of common machine learning techniques and frameworks (e.g. mlflow). Strong knowledge of Natural language processing (NPL) concepts. Strong ...

Senior Data Engineer (f/m/d)

Hiring Organisation
Awin Global
Location
Wakefield, West Yorkshire, UK
Employment Type
Full-time
technology (AWS or Azure). Strong experience with creation of data ingestion pipeline and ET process. Strong knowledge of big data tool such as Spark, Databricks and Python. Strong understanding of common machine learning techniques and frameworks (e.g. mlflow). Strong knowledge of Natural language processing (NPL) concepts. Strong ...

Data Science & AI Graduate Scheme

Hiring Organisation
Lloyds Banking Group
Location
Yorkshire, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
£45,000
modern cloud engineering practices. Wherever you land, youll be working with some of the biggest datasets in the UK using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. The work you could be doing Design and deploy machine learning models for fraud detection, credit … risk, customer segmentation, and behavioural analytics using scalable frameworks like TensorFlow, PyTorch, and XGBoost. Engineer robust data pipelines and ML workflows using Apache Spark, Vertex AI, and CI/CD tooling to ensure seamless model delivery and monitoring. Apply advanced techniques in deep learning, natural language processing ...

Data Engineer

Hiring Organisation
Harrogate and District NHS Foundation Trust
Location
Harrogate, United Kingdom
Employment Type
Permanent
Salary
£47810.00 - £54710.00 a year
repositories. 7. Document data architecture, processes, and workflows for reference and knowledge sharing. 8. Utilise programming languages (e.g., C#, Python, SQL) and technologies (e.g., Apache Spark, SSIS, .NET) to manipulate and analyse data. 9. Participate in code reviews, version control (e.g., using Git), and other software development best ...

Senior Data Engineer

Hiring Organisation
Alexander Associates Technical Recruitment
Location
York, North Yorkshire, UK
Employment Type
Full-time
Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling ...

Senior Data Engineer

Hiring Organisation
Fruition Group
Location
Leeds, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£65,000
compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse ...

Data Scientist

Hiring Organisation
Recruit Loop
Location
Leeds, UK
Employment Type
Full-time
Contributions across Kaggle tracks Experience in AI labs, fintech, or ML-focused teams Knowledge of LLMs, multimodal models, embeddings Experience with big data tools (Spark, Ray, Snowflake, BigQuery) Familiarity with Bayesian or probabilistic modeling Why This Role Stands Out: Work on frontier AI research problems Apply competition-level modeling ...

Data Scientist

Hiring Organisation
Recruit Loop
Location
Hull, East Yorkshire, UK
Employment Type
Full-time
Contributions across Kaggle tracks Experience in AI labs, fintech, or ML-focused teams Knowledge of LLMs, multimodal models, embeddings Experience with big data tools (Spark, Ray, Snowflake, BigQuery) Familiarity with Bayesian or probabilistic modeling Why This Role Stands Out: Work on frontier AI research problems Apply competition-level modeling ...

Solutions Architect

Hiring Organisation
AxiaMetrics
Location
Leeds, UK
Employment Type
Full-time
analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging SQL, Python, Java and/or Spark to build, operate and maintain data analytics solutions Extensive knowledge of and experience with large-scale database technology (e.g. Snowflake, Netezza, Exadata, Teradata, Greenplum ...

Solutions Architect

Hiring Organisation
AxiaMetrics
Location
Wakefield, West Yorkshire, UK
Employment Type
Full-time
analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging SQL, Python, Java and/or Spark to build, operate and maintain data analytics solutions Extensive knowledge of and experience with large-scale database technology (e.g. Snowflake, Netezza, Exadata, Teradata, Greenplum ...