1 to 25 of 155 Data Lake Jobs in the UK excluding London

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace – for building data pipelines or synapse analytics pipelines. Data Lake – Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture – Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality – Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models, and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration, and pyspark. Data Factory/Synapse Workspace – for building data pipelines or synapse analytics pipelines. Data Lake – Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture – Knowledge or experience in implementing Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality – Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

Senior ETL/Data Lake Engineer, Data Engineering | FinOps, Data Transformation | Contract £500-600 per day - Outside IR35 | Hybrid – London | 9-months Contract Company: Our client is one with international reach and a highly regarded reputation that specialises in FinTech software for some … transformation — reimagining its core data infrastructure to power smarter decisions, faster operations, and better customer outcomes. Building a modern data lake to power its digital transformation — and we’re hiring an ETL/Data Lake Engineers to build out the pipelines and … ingestion flows that feed the whole engine. Job opportunity details for Senior ETL/Data Lake Engineer, Data Engineering | FinOps, Data Transformation | Contract £500-600 per day - Outside IR35 | Hybrid – London | 9-months Contract You’ll work with: Tools like Airflow, Airbyte, Fivetran More ❯

impacts on the strategic direction of technology in the company. As part of the established Enterprise Architecture team, lead the technology strategy for data, supporting and aligning with the overall corporate business, data & digital strategy. Lead the overall development, maintenance, communication and implementation of the data … Azure hosted data and digital capabilities. Quilter’s data platform leverages a Lakehouse architecture built upon Azure data lake and uses a series of Microsoft based data services. The data platform, along with operational data stores, provide … from the below: Data (Key areas of experience) Data Warehousing and Data Lakes, specifically Azure Data Lake Self-service and corporate reporting, specifically Power BI Analytics, Data Mining & Data Science Data integration, data More ❯

scalable data integration processes to bring in data from on-premises , cloud , and external APIs into Azure Data Lake Storage (ADLS). Data Transformation & Modeling: Utilize Azure Data Factory/Databricks (PySpark/Scala) to build scalable data … Analytics . Data Warehouse & Analytics Solutions: Collaborate with data architects and business stakeholders to design and implement data lake and data warehouse architectures on Azure. Create and optimize data models (star and snowflake schemas) for business intelligence (BI) and … technical expertise at practice level. About you Strong experience in building and orchestrating complex data pipelines in ADF . Experience with Delta Lake for implementing data lakes and managing big data workloads efficiently. Strong knowledge of Synapse Analytics (formerly SQL Data More ❯

enterprise orchestration. Their AI-powered platform enables enterprise customers to navigate complex workflows in real-time, driving efficiency and streamlining operations by connecting data, processes, applications, and experiences. As Director Product Manager, you will define and execute the strategy to build a unified platform that seamlessly orchestrates data pipelines for ETL, ELT, and Reverse ETL (data activation)—eliminating the need for fragmented tools and enabling enterprises to move data efficiently across their ecosystem. REQUIREMENTS Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related field. A Master's … degree is a plus but not required. 10+ years of product management in B2B SaaS environments, specializing in data management, data orchestration, or infrastructure products. Proven success in shipping and scaling complex data products with measurable business impact. Strong track record in leading cross More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

AstraZeneca's commercial drug substances and products to ensure we successfully supply medicines to patients. We are seeking a highly skilled and experienced Data Governance Specialist to join our Data Governance team, within the Digital Science area in PT&D. Our overarching goal is to drive … within Pharmaceutical Technology and Development (PT&D) focused on Data. Introduction to role The successful candidate will be responsible for all aspects of Data Standards, Data Quality & Data Policy. Working closely with PT&D business representatives, the Enterprise, R&D, and Operations Data Offices, as well as other members of the PT&D Data teams, this role is a key enabler in improving our data quality. We expect that you to work at a detailed level with technical teams, alongside non-technical business teams. Accountabilities The role More ❯

Enterprise Data Architect - Hybrid Working out of Southampton or London - £150,000+ package - FS brand This position provides strategic technology leadership, focusing on the development, maintenance, communication, and governance of the organisation's technology strategy, architecture, and roadmaps. The role emphasises balancing business objectives, industry trends, innovation, and … Azure-hosted data and digital capabilities. Its data platform is built on a Lakehouse architecture using Azure Data Lake and Microsoft-based data services. This platform supports reporting, analytics, and insights and is evolving to deliver advanced business intelligence. Experience and … Skills Data Warehousing and Data Lakes (e.g., Azure Data Lake) Reporting and analytics tools (e.g., Power BI) Analytics, Data Mining, and Data Science Data integration, migration, and ETL processes Master and reference data management Data More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

Senior Data Engineer - Finance Industry About the Company Join a leading financial services company dedicated to innovation and data-driven decision-making. As we transition from on-premises SQL Server to a modern cloud-based Azure environment, we are investing in cutting-edge technology to enhance … high-performance data warehouse models (star/snowflake schema). Optimize data storage and structures using Azure Data Lake and Databricks Delta Tables. Work closely with stakeholders to gather and analyze data requirements for reporting and analytics. ETL Development & Data … to detail. Ability to collaborate effectively with technical and non-technical stakeholders. Desirable Experience Hands-on experience with Azure services (Azure Data Lake, Azure Data Factory). Development experience using Databricks Notebooks & Databricks Workflows. Familiarity with Git repositories and source control best practices. Experience managing More ❯

Senior Data Engineer - Finance Industry About the Company Join a leading financial services company dedicated to innovation and data-driven decision-making. As we transition from on-premises SQL Server to a modern cloud-based Azure environment, we are investing in cutting-edge technology to enhance … high-performance data warehouse models (star/snowflake schema). Optimize data storage and structures using Azure Data Lake and Databricks Delta Tables. Work closely with stakeholders to gather and analyze data requirements for reporting and analytics. ETL Development & Data … to detail. Ability to collaborate effectively with technical and non-technical stakeholders. Desirable Experience Hands-on experience with Azure services (Azure Data Lake, Azure Data Factory). Development experience using Databricks Notebooks & Databricks Workflows. Familiarity with Git repositories and source control best practices. Experience managing More ❯

Senior Data Engineer - Finance Industry Location: Blackpool Working Structure: Hybrid working Job Type: Permanent, Full-Time Industry: Finance About the Company Join a leading financial services company dedicated to innovation and data-driven decision-making. As we transition from on-premises SQL Server to a modern … high-performance data warehouse models (star/snowflake schema). Optimize data storage and structures using Azure Data Lake and Databricks Delta Tables. Work closely with stakeholders to gather and analyze data requirements for reporting and analytics. ETL Development & Data … to detail. Ability to collaborate effectively with technical and non-technical stakeholders. Desirable Experience Hands-on experience with Azure services (Azure Data Lake, Azure Data Factory). Development experience using Databricks Notebooks & Databricks Workflows. Familiarity with Git repositories and source control best practices. Experience managing More ❯

We are currently seeking an experienced BI Data Engineer to join our Digital Data Hub team within Thames Water. In this role, you will play a critical part in designing, building, and maintaining scalable data architectures that drive our ambition to become a truly … data-driven organisation. You will work closely with data architects, data scientists, and cross-functional teams to build the foundational data structures and processes that power analytics, insight, and innovation. Key Responsibilities as a BI Data Engineer: Design, construct, test … scientists to acquire, model, and prepare corporate data in a production-ready manner to support the development of our data lake and lake-house architecture. Implement robust data flows that integrate operational systems with analytics and BI platforms, ensuring seamless, efficient access More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

AWS Data Engineer Support | S2 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity for an AWS Data Engineer Support to join our … team of analysts to create the data and insights which support the functional areas of the bank. You'll play a key role understanding the types of models and data frameworks that support the business strategies around our data assets. This will require excellent … using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda Understanding of the principles behind designing and implementing data lake, lake house and/or data mesh architecture Problem solving skill with basic knowledge of the change management process Demonstrates understanding More ❯