11 of 11 Apache Spark Jobs in Yorkshire

Stock Exchange. With 3,000 employees and 32 offices in 12 countries we’re a business with lots of opportunity for people with talent, spark and lots of ambition. If you want to build a great career with a company that prioritises strong values – such as integrity and courage ...

structured data. Experience with batch and near real-time processing across multiple sources and targets. Practical capability with Azure Data Factory and Databricks or Spark, plus Azure Blob Storage or Azure Data Lake. Understanding of data modelling, data marts, metadata-driven development, data dictionaries and lineage. Experience delivering through ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

production Machine Learning models. Experience with end-to-end ML and data pipelines. Strong understanding of model training, inference and feature engineering. Experience with Spark or similar distributed data processing technologies. Experience implementing engineering best practices including CI/CD and automated testing. Ability to analyse an existing technical ...

should have the following skills: Experience implementing data processes for Data Warehouse and production systems. Strong experience with Big Data technologies (e.g., Hadoop/Spark). Programming in modern languages (e.g., Scala and Python). Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA for requirement/ ...

should have the following skills:Experience implementing data processes for Data Warehouse and production systems.Strong experience with Big Data technologies (e.g., Hadoop/Spark).Programming in modern languages (e.g., Scala and Python).Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA for requirement/backlog management.Strong understanding ...

ensure requirements are understood before design and development. The role focuses on data warehouse and large‐scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production. #J ...

liaise with stakeholders, and own end-to-end development from design through to production and support. The role requires strong data warehousing, Hadoop/Spark, and programming skills in Scala and Python, with hands-on leadership and a focus on automated testing and modern engineering practices. #J-18808-Ljbffr ...

quality datasets that underpin analytics, AI initiatives, and business decision-making. The emphasis is on data discovery, data architecture, and data modelling rather than Spark development, dashboard engineering, or visualisation work. Responsibilities Identify, analyse, and document data sources required to meet business and application requirements for the Operational Resilience … documentation, data governance, and high standards of data quality. Work is focused on data architecture, modelling, and integration rather than front-end visualisation or Spark-based development, enabling you to specialise in core data engineering and modelling disciplines. 2 days a week in Sheffield required Inside IR35 Umbrella rate ...

Build and manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python … with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark, and Amazon EMR (or equivalent). Knowledge of monitoring, logging, and security tools. Desirable Skills Kubernetes/EKS or other container platforms. Python scripting ...