13 of 13 Apache Airflow Jobs in Yorkshire

Technical Lead – Multi-tenant Data Integration Platform (GCP/Airflow) Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow , including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor ...

Title Technical Lead – Multi-tenant Data Integration Platform (GCP/Airflow) Role purpose Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow , including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor ...

Description Job Title Technical Lead Multi-tenant Data Integration Platform (GCP/Airflow) Role purpose Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor ...

scale a multi-tenant data integration platform on Google Cloud Platform. You’ll lead the design and delivery of reliable ETL pipelines using Apache Airflow, improve CI/CD and platform automation, and create clear end-to-end data lineage from source systems to downstream vendors. What … Lead platform architecture, technical roadmap, and engineering delivery. Design and develop scalable Airflow pipelines using Python. Improve reliability through retries, idempotency, reconciliation, and resilient failure handling. Evolve multi-tenant architecture, configuration, and metadata-driven processing. Strengthen CI/CD, automated testing, security checks, and deployment processes. Implement observability, monitoring ...

working knowledge Nice-to-have Databricks → AWS (or cross-platform) migration experience — the single strongest signal Parity/statistical testing methodology Data orchestration (Airflow, dbt, Step Functions) Data governance & compliance (PII/GDPR); regulated industry background (iGaming strongly preferred, but FS, banking considered) Soft skills Comfortable working ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

implementing agentic guardrails. Data Engineering (30%): Practical experience implementing components of data pipelines, including real-time streaming tools (AWS Kinesis, Kafka), data orchestration (dbt, Airflow), and managing vector databases for RAG architectures. Observability & Cost Management: SRE/Platform experience with the practical application of real-time monitoring and cloud ...

Engineer delivering data engineering or integration platforms in cloud environments. Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow . Solid experience on Google Cloud Platform , such as: Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/ ...

Commercial Data to build scalable data products supporting AI/ML, analytics, and commercial insights. ✅ Snowflake ✅ SQL & Python ✅ Collibra ✅ IQVIA/Veeva ✅ dbt/Airflow ✅ Pharma Commercial Data 📩 Interested candidates can share their updated resume to manasa@cygnuspro.com ...

stakeholder communication skills Desirable: Experience overseeing or supporting data ingestion pipelines, including APIs and event-driven data sources Familiarity with orchestration tools such as Airflow and modern ELT architectures Experience governing or implementing data CI/CD pipelines (e.g. dbt tests, deployment pipelines, automated checks). We currently … design input, reviews, and mentoring Influence how analytics data is built, trusted, and operated at scale Work with a modern stack: AWS, Snowflake, dbt, Airflow, SQL, and Python Join us as we redefine travel experiences and create memories for millions of passengers. At Jet2.com and Jet2holidays, your potential ...

Description Job Title Technical Lead Multi-tenant Data Integration Platform (GCP/Airflow) Role purpose Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables ...

game production cycle or long-term project. A strong understanding of Photogrammetry workflows and software. Proficiency in Python. Experience with build systems like Jenkins, Airflow, or Celery. An understanding of a 3D asset pipeline and color management. Ability to think creatively and develop innovative solutions to complex problems. PLUSESPlease ...

Consulting Global is seeking a Technical Lead to steer the development of a scalable, multi-tenant data integration platform on Google Cloud Platform using Apache Airflow. You will shape the technical direction, drive reliable ETLs, and raise the bar on automation, governance and performance across environments. You will mentor ...