3 of 3 Apache Airflow Jobs in Yorkshire

seeking a Technical Delivery Lead to drive the engineering and technical strategy for a scalable, multi-tenant data integration platform built on Apache Airflow and Google Cloud. In this role, you will lead the delivery of production-grade data pipelines and cloud solutions, working closely with cross-functional … guiding teams in a collaborative environment. Roles and Responsibilities Lead the engineering and technical strategy for a scalable multi‐tenant data integration platform leveraging Apache Airflow and GCP technologies. Build and maintain production‐grade ETL/ELT pipelines orchestrated with Apache Airflow. Utilize container platforms such ...

including supporting automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

cloud platforms (AWS, Azure, GCP). Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...