8 of 8 Apache Spark Jobs in Yorkshire

Python and SQL; APIs; test automation; data structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. ...

coaching other engineers GCP is the main cloud platform. Strong AWS engineers are welcome, and full GCP training is provided Nice to have: Apache Spark, financial services or fintech, capital markets knowledge, TypeScript What's on offer A strong base salary that reflects the fixed-term contract, with ...

cost optimisation principles, with the ability to apply this knowledge to multi-cloud and cloud-agnostic solution designs at enterprise scale Knowledge of major Apache spark data platform services and their associated architectures Leadership Essential Evidence of providing clear direction through communicating the strategic vision, adopting a corporate ...

with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev OpsProficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineeringExpertise in building and deploying production level data solutions maintained by application support teamsKnowledge ...

role you should have the following skills: Experience implementingdata processes for Data Warehouse and production systems. Strong experience withBig Data technologies(e.g.,Hadoop/Spark). Programming in modern languages (e.g.,ScalaandPython). Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management. Strong understanding ...

quality datasets that underpin analytics, AI initiatives, and business decision-making. The emphasis is on data discovery, data architecture, and data modelling rather than Spark development, dashboard engineering, or visualisation work. Responsibilities Identify, analyse, and document data sources required to meet business and application requirements for the Operational Resilience … documentation, data governance, and high standards of data quality. Work is focused on data architecture, modelling, and integration rather than front-end visualisation or Spark-based development, enabling you to specialise in core data engineering and modelling disciplines. 2 days a week in Sheffield required Inside IR35 Umbrella rate ...

role combines L2/L3 production support and Data Engineering tasks. Databricks experience covering notebooks, scheduled jobs, cluster configuration, driver/executor logs, Spark UI + performance troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark ...

role combines L2/L3 production support and Data Engineering tasks. Databricks experience covering notebooks, scheduled jobs, cluster configuration, driver/executor logs, Spark UI + performance troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark ...