3 of 3 Apache Airflow Jobs in Yorkshire

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

/B testing. Split principles, test planning, logging. Desirable hard skills Python. Data analysis, pandas, numpy, scipy, statsmodels, seaborn, matplotlib etc. ETL processes. Airflow, Pentaho etc. IT understanding. Client-server processes. API. Back-end and front-end. Parsing. Algorithms and data structures. Management. Sprints, AGILE. Waterfall. Jira etc. Other ...

workflows Nice to Have Knowledge of FinOps principles and cloud cost optimisation Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Airflow Exposure to containerisation tools (Kubernetes, Docker) Experience with data cataloguing tools Familiarity with unit testing in data pipelines Awareness of MLOps practices ...