4 of 4 Permanent Apache Airflow Jobs in the Midlands

complex data initiatives, providing guidance on solution design, engineering standards and implementation approaches Design, build and optimise distributed data processing pipelines using PySpark, Python, Airflow and AWS services Drive engineering excellence through code reviews, technical coaching, design reviews and adoption of software engineering best practices Partner closely with Product … Engineer, Principal Data Engineer or Technical Lead within a large-scale, data-driven organisation Strong hands-on software engineering expertise with Python, PySpark and Apache Airflow Deep experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data ...

Architectural Leaders hipDefine and evolve the enterprise data architecture strategy, with a primary focus on Cloud-scale Distributed Data Processing using Apache Spark and PySpark at the core of the platf ormEstablish and maintain architectural artefacts, reference architectures, Architecture Decision Records (ADRs), technical standards, and architecture roadmaps … Architect in a large, complex, data-led organisation, operating at an influence and strategy level rather than hands-on de liveryExpert-level understanding of Apache Spark and PySpark as the foundation of distributed data processing architectures, including tuning, optimisation, and enterprise-scale deployment pa tternsDeep expertise in designing ...

developing others. Desirable to have skills or experience in: - SAS Viya for data analytics. - Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). - Denodo for data virtualisation. - Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). - ALM Tooling (Jira, Confluence ...

your initiative and get on with resolving it! From a tech perspective, it would be most excellent if youve come from an AWS, Apache AirFlow, Python, Spark type of environment and understand these technologies (or alternatives) and what they do. Youll still be considered if youve not used ...