24 of 24 Delta Lake Jobs in the UK excluding London

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You'll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation - Extensive hands-on with Azure Data Flow Activities More ❯

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You'll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation - Extensive hands-on with Azure Data Flow Activities More ❯

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You’ll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace – for building data pipelines or synapse analytics pipelines. Data Lake – Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture – Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality – Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation – Extensive hands-on with Azure Data Flow Activities More ❯

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You’ll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace – for building data pipelines or synapse analytics pipelines. Data Lake – Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture – Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality – Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation – Extensive hands-on with Azure Data Flow Activities More ❯

London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s taking … supporting team capability development What You Need: ✔ 5+ years in data engineering or backend cloud development ✔ Strong Python, SQL, and Databricks skills (especially PySpark & Delta Lake) ✔ Deep experience with Azure: Data Factory, Synapse, Event Hub, Azure Functions ✔ Understanding of MLOps tooling like MLflow and integration with AI pipelines More ❯

meaningful. 🛠️ What you'll do: Lead and mentor a junior-heavy team of data engineers Build and scale robust pipelines using Spark, Kafka and Delta Lake Define test-driven, documented and repeatable engineering practices Work closely with AI, research and DevOps to deliver products and insights Handle sensitive … the office (1 day in Oxford and 1 day in London) 🧰 Tech you'll use: Python, SQL, Spark, Kafka, Kubernetes, Docker, Airflow, RabbitMQ, AWS, Delta Lake ✅ You’ll thrive here if you: Believe in clean code, strong documentation and a test-first mindset Enjoy mentoring and levelling up More ❯

Spark for data engineering and analytics. Proficient in SQL and Python/PySpark for data transformation and analysis. Experience in data lakehouse development and Delta Lake optimisation. Experience with ETL/ELT processes for integrating diverse data sources. Experience in gathering, documenting, and refining requirements from key business More ❯

new technologies and languages. Expertise in designing and building Big Data databases, analytics, and BI platforms. Strong understanding and experience in working with Databricks Delta Lake. Keen interest in the latest trends and tools in data engineering and analytics. Familiarity with graph databases (e.g., Neo4J/Cypher). Experience … assets and reports for business insights. Assist in engineering and managing data models and pipelines within a cloud environment, utilizing technologies like Databricks, Spark, Delta Lake, and SQL. Contribute to the maintenance and enhancement of our progressive tech stack, which includes Python, PySpark, Logic Apps, Azure Functions, ADLS More ❯

orchestration from diverse data sources. Build scalable data integration processes to bring in data from on-premises , cloud , and external APIs into Azure Data Lake Storage (ADLS). Data Transformation & Modeling: Utilize Azure Data Factory/Databricks (PySpark/Scala) to build scalable data processing and transformation workflows for … improve query performance in Azure Synapse Analytics . Data Warehouse & Analytics Solutions: Collaborate with data architects and business stakeholders to design and implement data lake and data warehouse architectures on Azure. Create and optimize data models (star and snowflake schemas) for business intelligence (BI) and analytics workloads, ensuring high … own area of technical expertise at practice level. About you Strong experience in building and orchestrating complex data pipelines in ADF . Experience with Delta Lake for implementing data lakes and managing big data workloads efficiently. Strong knowledge of Synapse Analytics (formerly SQL Data Warehouse) for data warehousing More ❯

Senior ETL/Data Lake Engineer, Data Engineering | FinOps, Data Transformation | Contract £500-600 per day - Outside IR35 | Hybrid – London | 9-months Contract Company: Our client is one with international reach and a highly regarded reputation that specialises in FinTech software for some of the largest banks in the … of a major digital transformation — reimagining its core data infrastructure to power smarter decisions, faster operations, and better customer outcomes. Building a modern data lake to power its digital transformation — and we’re hiring an ETL/Data Lake Engineers to build out the pipelines and ingestion flows … that feed the whole engine. Job opportunity details for Senior ETL/Data Lake Engineer, Data Engineering | FinOps, Data Transformation | Contract £500-600 per day - Outside IR35 | Hybrid – London | 9-months Contract You’ll work with: Tools like Airflow, Airbyte, Fivetran AWS S3, Athena, Delta Lake/ More ❯

business use cases. Strong knowledge of data governance, data warehousing, and data security principles. Hands-on experience with modern data stacks and technologies (e.g., Delta Lake, SQL, Python, Azure/AWS/GCP). Experience aligning data capabilities with commercial strategy and business performance. Exceptional communication skills. More ❯

architecture, ensuring alignment with best practices and strategic goals. Drive the adoption of Azure data technologies such as Fabric, Data Factory, Databricks, Synapse, and Delta Lake. Develop and maintain scalable data pipelines, ensuring efficient data ingestion, transformation, and storage. Introduce and enhance self-service reporting capabilities for stakeholders across More ❯

/Frameworks - JSON - YAML - Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.) - SQL - PySpark - Delta Lake - Bash (both CLI usage and scripting) - Git - Markdown - Scala (bonus, not compulsory) - Azure SQL Server as a HIVE Metastore (bonus) Technologies - Azure … Databricks - Apache Spark - Delta Tables - Data processing with Python - PowerBI (Integration/Data Ingestion) - JIRA Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required More ❯

Data Architect or Lead Data Engineer , ideally within consulting or large enterprise environments. Proven expertise with Azure , Databricks , and associated data tooling (e.g., Synapse, Delta Lake, Azure Data Factory). Strong understanding of data architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency More ❯

SQL and Python Prior experience designing solutions on the Databricks Data Intelligence platform, either on Azure or AWS Good knowledge of Databricks components including DeltaLake, Unity Catalogue, ML Flow etc. Experience building data pipelines and ETL processes Experience with any of the following is highly desirable: Snowflake, Kafka, Azure Data More ❯

SQL and Python Prior experience designing solutions on the Databricks Data Intelligence platform, either on Azure or AWS Good knowledge of Databricks components including DeltaLake, Unity Catalogue, ML Flow etc. Experience building data pipelines and ETL processes Experience with any of the following is highly desirable: Snowflake, Kafka, Azure Data More ❯

in SAP Datasphere or SAP BW4/Hana Advanced skills in SQL, data modelling, and data transformation Familiarity with Databricks, Apache Spark, PySpark, and Delta Lake Agile mindset with experience in DevOps and iterative delivery Excellent communication and stakeholder engagement abilities At Cadent, we’re thrilled to be More ❯

in SAP Datasphere or SAP BW4/Hana Advanced skills in SQL, data modelling, and data transformation Familiarity with Databricks, Apache Spark, PySpark, and Delta Lake Agile mindset with experience in DevOps and iterative delivery Excellent communication and stakeholder engagement abilities At Cadent, we're thrilled to be More ❯

implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment More ❯

implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment More ❯

and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience in modern software development practices (agile, CI/CD, DevOps, infrastructure as code … the following: Strong knowledge of SQL and Python programming. Extensive experience working within a cloud environment. Experience with big data technologies (e.g. Spark, Databricks, Delta Lake, BigQuery). Experience with alternative data technologies (e.g. duckdb, polars, daft). Familiarity with eventing technologies (Event Hubs, Kafka etc…). Deep … understanding of file formats and their behaviour such as parquet, delta and iceberg. What we offer We want to give you a great work environment; contribute back to both your personal and professional development; and give you great benefits to make your time at RVU even more enjoyable. Some More ❯

is a plus Ability to quickly learn new tools and independently deliver scalable, high-quality solutions Experience with data pipelines (Kafka, Debezium, S3, Lambda, Delta Lake) is a bonus Please Note: This is a permanent role for UK only. This role does not offer Sponsorship. You must have More ❯

Location: London, Hybrid 💰 Rate: Up to £700 p/d 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure, Databricks, Delta Lake, MLflow, OpenAI, LangChain, RAG, APIs, Power Platform We’re working with a stealth-mode AI-first consultancy that's rethinking what professional services More ❯