1 to 25 of 32 Permanent Apache Airflow Jobs in the Midlands

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. > Understanding/hands on experience in Orchestration solutions such as Airflow > Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability ...

Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. > Understanding/hands on experience in Orchestration solutions such as Airflow > Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability ...

Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. > Understanding/hands on experience in Orchestration solutions such as Airflow > Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

What We're Looking For Significant experience with Databricks (including Unity Catalog) Strong skills in Python, Spark, SQL Cloud expertise Knowledge of pipeline tools (Airflow, ADF) Leadership and problem-solving ability Ready to take the next step? Apply now and join us as our Senior Databricks Engineer ...