9 of 9 Apache Spark Jobs in Yorkshire

Python, Java or Scala, and SQL. Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data ...

warehousing, and data governance frameworks. Define and enforce best practices, security standards, and performance optimization across Databricks workloads. Design scalable big data architectures leveraging Spark, Delta Live Tables, Unity Catalog, and MLflow. Lead cloud architecture design on Azure/AWS/GCP (based on organization need) integrated with Databricks. … Qualifications 10–15 years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks. Expert in Apache Spark, PySpark, Databricks SQL, Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture, BI ecosystems, and modern data platforms. Cloud expertise ...

strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Essential qualifications • Extensive experience with Python and PySpark/Apache Spark. • Proven track record designing and delivering scalable data pipelines and data products. • Strong SQL and data modelling skills. • Experience with modern data architectures ...

Financial Services, multi-market experience Data Integration & System Engineers Build scalable data pipelines supporting decisioning systems. Key Skills: GCP (BigQuery) & Hadoop/Cloudera (mandatory) Spark, Scala, Python, SQL Data pipelines (batch & near real-time) Data modelling, governance & CI/CD Pega CDH integration experience QA/Test Specialists Ensure ...

collection systems using Scala and Java. Apply sound engineering principles such as test-driven development and modular design. Preferred Background Hands-on experience with Spark and Scala in commercial environments. Familiarity with Java and Python. Exposure to distributed data systems and cloud storage platforms. Experience designing data schemas ...

worldwide customer base across Gaming and Sportsbook. What you’ll do Drive platform capability improvements - continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities Enable application data consumption - understand how applications produce and consume data, designing … structures, partitioning strategies, consistency models, and performance optimization, as well as OLTP databases such as PostgreSQL and MySQL Distributed compute frameworks – strong experience with Apache Spark and distributed data processing, including optimisation, performance tuning, and large‐scale batch/streaming workloads Cloud‐native data platforms – demonstrated experience with ...

teams Ensure solutions meet security, compliance, and regulatory standards Key Skills Required: Experience in solution design/architecture Strong background in big data tools (Spark, Airflow, Trino, etc.) Knowledge of cloud platforms (AWS/Azure/GCP) Understanding of cybersecurity principles (IAM, encryption, secure design) Ability to work hands ...

logic into data pipelines and services. Conduct bespoke, high-complexity analysis in support of customer-facing or operational needs. Guide team best practices in Spark SQL usage, data documentation, and exploratory reproducibility. Desired Qualifications: 5+ years of experience in data science, applied analytics, machine learning, or analytical R&D. … Advanced expertise in Python and distributed compute frameworks (e.g., Spark, Databricks), including strong proficiency in Spark SQL . Strong background in statistical inference, anomaly detection, clustering, interaction modeling , or other analytical methods suited to large and heterogeneous datasets. Experience working with multi-source, semi-structured, geospatial, or entity ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure ...