1 to 25 of 97 Data Lake Jobs in the UK excluding London

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

About the team The Data Architect role sits in the Data Authority team within Architecture and Software Solutions. The Architecture and Software Solutions Function is part of the Software Engineering and Complex Services Department, which sits within the Technology Business Unit. The role reports to the … Data Authority Manager dealing directly with the business to provide data centric solutions and data expertise support for business problems ranging from customer base acquisition, support to analytics, management and compliance reporting, and best practice guidance, the team is an agile working environment, key … Master Data Management In depth understanding of data management and storage systems (database, data container, data lake, data warehouse), with a focus on Microsoft Azure/Snowflake Ability to design and enforce data infrastructure policies, procedures and more »

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data … and storage technologies, ideally within Azure. Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system … and storage technologies, ideally within Azure. Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system more »

data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory, Synapse/Fabric, Databricks, Spark and other data tools Advantageous to have: Insurance domain knowledge a plus … the business requirements. Design data models and lakehouse’s using medallion architecture that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools. Develop, maintain, and optimize semantic data … models in production environments. Optimizing data models from various sources such as Azure SQL databases and Azure Data Lake Storage Gen2 for usage in Power BI Ensure efficient querying of large datasets and troubleshoot any performance issues related to data retrieval more »

Job Title: Solution Architect - Data Integration (Telco) Job Description We are seeking a highly skilled and experienced Solution Architect to lead the design and implementation of data integration solutions within our telco environment. This role is … pivotal in ensuring seamless data flow between our systems of record, specifically Sonalake SwitchedOn Fibre and Salesforce, and our data lake, Azure Synaps. Key Responsibilities: Data Architecture Design: Develop and maintain a comprehensive data architecture for our telco systems of record … focusing on data flows, data quality, and data governance. Identify and analyze data sources, target systems, and data transformation requirements. Design data integration patterns and strategies, including ETL/ELT processes, data synchronization, and data more »

Head of Data/Azure Data Architect Chandlers Ford - £100,000+ plus bonus + excellent package An excellent opportunity for an established Head of Data/Azure Data Architect to join a Global group of companies who are a market-leading provider … a proven ability to deliver strategic data solutions that drive business value. Specific experience with Azure Synapse Analytics, Azure Data Lake, and Azure Databricks for large-scale data processing and analytics. Technical Proficiency: Extensive experience with cloud-based data platforms, particularly … in Microsoft Azure. Proficiency in using Azure SQL Database, Azure Data Factory for ETL processes, Azure Data Lake Storage for scalable data storage, and Azure Stream Analytics for real-time analytics. Familiarity with Azure Purview for data governance and compliance, as more »

Data Architect – Dynamics 365 CRM, D365 CRM, Microsoft Dynamics CRM, Data Migration, Data Architect, Data Modelling, Data Warehousing, ETL, Data Integration, Cloud Architecture, Azure, SQL,Database Design, Data Governance, Data Security, Data Migration, Business Intelligence, Analytics, Data Strategy, Data Management, Master Data Management, Data Lakes, Data Pipelines, Customizations, Configuration – Contract – West Midlands - £625pd We are looking for experienced Data Architect, preferably with expertise in Dynamics 365/D365 … CRM/CE for an exciting contract opportunity. This is a 6-12-month role where as well as defining the data taxonomy and ontology, you will steer the direction of the business in relation to data retention and ageing from all their data more »

Job Title : Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location : Fully Remote Employment Type : Permanent, Full-Time Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless … part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse. Ensure Data Quality & Governance : Implement data quality checks, ensure regulatory compliance, and support data governance … Azure Data Engineer: Azure Data Expertise : Proficiency in Azure Databricks , Azure Data Factory , Azure Synapse Analytics , and Delta Lake . Databricks & Spark : Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics. ETL/ELT Skills : Strong more »

Job Title : Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location : Fully Remote Employment Type : Permanent, Full-Time Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless … part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse. Ensure Data Quality & Governance : Implement data quality checks, ensure regulatory compliance, and support data governance … Azure Data Engineer: Azure Data Expertise : Proficiency in Azure Databricks , Azure Data Factory , Azure Synapse Analytics , and Delta Lake . Databricks & Spark : Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics. ETL/ELT Skills : Strong more »

Title: Azure Data Engineer Location: Manchester City Centre (3 days a week onsite) Salary: £50,000 - £65,000 DOE The Role As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure. Leading a small team, you … tools. Collaborate with business stakeholders to understand data requirements and integrate diverse data sources into a unified data lake or warehouse. Perform data cleansing, transformation, and enrichment to ensure data quality and consistency. Monitor and optimise data … data visualization tools (e.g., Power BI, Tableau) Experience with Azure cloud services, including Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure SQL Database Our Values They pride ourselves on being a values-led law firm. This means: We do what more »

We are looking for an experienced Data Architect to join our client on a transformational journey. As a key member of their Data Architect team, you will play a pivotal role in translating business needs into robust data architecture solutions. Your expertise will drive … the design, development, and optimisation of data models, ensuring data quality, governance, and security across the systems. Key Responsibilities: Design and Development: Create conceptual and logical data models to support business, data, and technical requirements. Develop data flows, automate processes … analyst/modeler, including complex enterprise and dimensional data modelling. Proven experience in a data warehouse, data lake, or operational data store environment. Expertise with major data modelling tools (e.g., SQL Database Modeller, MySQL Workbench, PowerBI). In more »

Data Lead | Newcastle/Hybrid | £70,000 - £80,000 Microsoft | Azure | ETL | Azure Data Lake | BigQuery | Python | team leadership | technical leadership | Architecture | and more An opportunity has arisen for you, a highly skilled and experienced Data Engineer to join this newly formed Data … for improvement and optimization. Develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Lake, Google BigQuery, Python, and other relevant technologies. Mentor and coach team members, fostering a culture of continuous learning and growth. Qualifications and Skills: Extensive … now to be considered. george.aldridge@opusrs.com Data Lead | Newcastle/Hybrid | £70,000 - £80,000 Microsoft | Azure | ETL | Azure Data Lake | BigQuery | Python | team leadership | technical leadership | Architecture | and more more »

daily towards creating the world we want tomorrow. Job Description: Senior Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data more »

prevention services. As part of their ongoing growth, they are looking to strengthen their technology capabilities with the addition of a Head of Data to lead their data strategy and digital transformation. The Head of Data will play a pivotal role in shaping and … executing the data strategy to support the organisation's digital transformation and long-term goals. This role will oversee data governance, architecture, and analytics, ensuring the business fully leverages its data assets to enhance operational efficiency and customer engagement. Leading the data … that drive business value. Extensive experience with cloud-based data platforms, particularly Microsoft Azure, including Azure Synapse Analytics, Azure Data Lake, and Azure Databricks. Proficiency in Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure Stream Analytics more »

the best of the best isn’t just a goal—it’s in our DNA. We’re on the lookout for an incredible Data Architect who thrives on innovation and excellence, with experience in the AWS environment, including S3, Redshift, and other AWS products. Based in our London … office and reporting into the Senior CRM & Customer Service Ops Manager, you will: Design & Strategy: Architect cutting-edge, scalable data solutions using AWS services, ensuring peak performance and reliability. Data Management: Masterfully manage data storage, retrieval, and processing across AWS S3, Redshift, and other … warehousing and analytics AWS Lambda: Serverless computing for ETL processes AWS Glue: Data integration AWS RDS: Managed relational databases AWS Lake Formation: Data lake management and governance Python/SQL: Programming for data processing and querying Amazon Kinesis: Real-time more »

Data Architect/Azure/1 day per week in office/£75,000 - £85,000 + 20% Bonus Role title: Data Architect Office Requirement … day per week Office Location: High Wycombe Area Technical Requirements: Azure/SQL/Data Governance/DWH/Data Lake Our client, one of the leaders in their area are in the market for a Data Architect to support them as part … to you, we need to see the following: Established background holding Data Architect positions Azure experience as a must Data Lake/DWH background SQL Great comms and ability to work effectively across an organization Data Governance understanding And for the most part more »

The Opportunity Our client, an innovative and fast-growing SaaS company, is seeking a dynamic Head of Data and AI to spearhead their data strategy, analytics, and AI initiatives. This pivotal role involves driving data-driven decision-making, leading the technical delivery of AI … Manage the design and maintenance of secure, scalable data architectures leveraging Azure Data Factory, Azure Synapse, Azure Data Lake, and other tools. Work collaboratively with engineering teams to guide the integration of data and AI solutions throughout the Software Development Life … standards and regulations. Tech Environment Cloud : Azure-focused data ecosystem (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, Azure Machine Learning). AI/ML : Strong focus on LLMs, NLP applications, and machine learning frameworks such as PyTorch and more »

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: £65,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This … full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive … pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product more »

Our client, a prominent player in the technology sector, is currently seeking a skilled Data Architect to support a Finance Programme within their organisation. This contract role will focus on designing and implementing robust data solutions while ensuring alignment with business and technical requirements. If you … are detail-oriented and possess expertise in data architecture and modelling, we want to hear from you! Key Responsibilities: Develop low-level designs (LLDs) that address key business logic, functional, and non-functional requirements. Present designs to the Design Governance Council and provide guidance to build teams for … reviewing technical code and ensuring design alignment during build phases. Expertise in tools and technologies such as Data Bricks, Data Lake, Data Management, Data Analysis, and Data Science. This is an excellent opportunity to contribute to a critical Finance more »

A growing Financial Services firm are looking for an experienced Data Engineer to join their team in Sunderland - they're fully up-and-running on Azure, making this an excellent role for someone to develop their skills with cutting-edge technologies. This role requires you to be in … effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well-suited to a Data Engineer or BI Developer with core competencies in Data … integration techniques Ideally experience and/or certifications with some of: Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics Excellent communication and requirements gathering skills Benefits Salary up to £65,000 depending on experience Annual salary increase based on performance more »

A growing Financial Services firm are looking for an experienced Data Engineer to join their team in Sunderland - they're fully up-and-running on Azure, making this an excellent role for someone to develop their skills with cutting-edge technologies. This role requires you to be in … effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well-suited to a Data Engineer or BI Developer with core competencies in Data … integration techniques Ideally experience and/or certifications with some of: Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics Excellent communication and requirements gathering skills Benefits Salary up to £65,000 depending on experience Annual salary increase based on performance more »

A growing Financial Services firm are looking for an experienced Data Engineer to join their team in Sunderland - they're fully up-and-running on Azure, making this an excellent role for someone to develop their skills with cutting-edge technologies. This role requires you to be in … effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well-suited to a Data Engineer or BI Developer with core competencies in Data … integration techniques Ideally experience and/or certifications with some of: Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics Excellent communication and requirements gathering skills Benefits Salary up to £65,000 depending on experience Annual salary increase based on performance more »

Services (CPS) to work with our partners to widen, operate and maintain the M25 under a 30-year contract and are looking for Data Architect to develop, manage and lead our … corporate data strategy. As a data architect you’ll be crucial in delivering solutions for the digital data lake in project and you’ll be pivotal in supporting and enhancing our newly established data governance framework. As a Data Architect, you’ll be crucial in delivering solutions for the Digital Data Lake in the JV. You’ll develop solutions for specific business needs, understand business requirements, and review solution impacts. You will be accountable for the data architecture of the M25 IT more »

Data Quality Manager/Senior Analyst - Consumer analytics & SQL - Location - Virtually remote working with 2 days a month self-funded travel to Southampton offices - Salary negotiable DoE £60,000 - £70,000 J12812 Candidates must have an existing right to live and work in the UK. If this sounds … like the role for you then please apply today! Role Purpose: Working within the Customer Data Quality Team, the Data Quality Manager will ensure the single version of truth for customer data exists and that data quality is of the highest standard. … help to deliver their data quality framework and roadmap as well as ensuring the data in the data lake is in the right location for stakeholders to use. • Be an active member of the wider data community across the group, engaging more »