9 of 9 Apache Spark Jobs in Yorkshire

with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity with ...

Stock Exchange. With 3,000 employees and 32 offices in 12 countries we’re a business with lots of opportunity for people with talent, spark and lots of ambition. If you want to build a great career with a company that prioritises strong values – such as integrity and courage ...

modern cloud engineering practices. Where you land, you’ll be working with some of the biggest datasets in the UK – using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. Cloud-native AI engineering and large-scale data platforms, leveraging Google Cloud technologies and modern ...

modern cloud engineering practices. Wherever you land, you'll be working with some of the biggest datasets in the UK - using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. The work you could be doing Cloud-native AI engineering and large-scale data platforms ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

production Machine Learning models. Experience with end-to-end ML and data pipelines. Strong understanding of model training, inference and feature engineering. Experience with Spark or similar distributed data processing technologies. Experience implementing engineering best practices including CI/CD and automated testing. Ability to analyse an existing technical ...

ensure requirements are understood before design and development. The role focuses on data warehouse and large‐scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production. #J ...

role you should have the following skills: Experience implementingdata processes for Data Warehouse and production systems. Strong experience withBig Data technologies(e.g.,Hadoop/Spark). Programming in modern languages (e.g.,ScalaandPython). Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management. Strong understanding ...

needed). Skills and knowledge Demonstrable experience designing, deploying, and operating big data platforms at scale. Hands‐on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). Knowledge of cloud platforms and traditional on‐premise hosting; hands‐on experience with Azure ...