Senior Manager - Principal Data Engineer
- Hiring Organisation
- Appcast
- Location
- Birmingham, UK
platforms (Azure preferred), leveraging Databricks as the core data engineering platform• Build and optimize sophisticated ETL/ELT data pipelines using PySpark, SQL, and Python, orchestrating complex data workflows through Databricks Workflows, Delta Live Tables, Azure Data Factory• Implement and maintain Delta Lake storage architectures and Unity Catalog governance frameworks … including medallion architectures, data lakes, and enterprise data warehousesExpert-level proficiency in SQL for complex data transformation, optimization, and analytical workload developmentAdvanced proficiency in Python for data engineering, pipeline automation, and integration developmentDeep expertise in PySpark for data processing and transformationProven mastery of cloud platforms with strong preference for Microsoft ...