1 to 25 of 80 Data Lake Jobs in the UK excluding London

of experience in Azure Data. Design, develop, and maintain scalable ETL pipelines using Azure Services to process, transform, and load large datasets into AWS Datalake or other data stores. Collaborate with cross-functional teams, including data architects, analysts, and business stakeholders, to gather data … and create effective data workflows. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations. Implementing data … on development in cloud-based analytics solutions. Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required. Designing and building of data pipelines using API ingestion and Streaming ingestion methods. Knowledge of Dev more »

Data Engineer Fully remote working Salary up to £55,000 per annum + Benefits An exciting new opportunity has arisen to join a large retailer, known for their sustainability ethos within a Data Engineer role. The company are based in the Midlands and the position is … FULLY REMOTE. Key responsibilities: Ensure quality data is ingested into the data warehouse to capture reliable and accurate insights. Manage a range of data sources and make sure the data platform for analytics is ingesting and structuring data correctly. Understand … systems. Communicate with key stakeholders to understand requirements. Skills required: A strong understanding of Microsoft Azure (Data Factory, Azure Data Lake, Synapse, Databricks) A solid understanding of data concepts and data modelling principles, applied across traditional warehousing and modern data more »

Data Lead - CMMS Project Overall Purpose: UKAEA are undertaking a significant business transformation to upgrade their Computerised Maintenance Management (CMMS)/Enterprise Asset Management (EAMS) systems capability. As the Data Lead, you will oversee the programme's data workstream which will deliver a new … target data architecture, delivering significant benefits to UKAEA through the implementation of organisation wide platforms, improvement in data management and the rationalisation of the asset data across the UKAEA estate. You will collaborate with system integrations and cross-functional departments to ensure the successful … project-based data model definition and design Strong understanding and experience of data warehousing, ETL processes and Data Lake concepts and technologies. Experience working with multiple data sets and owners. Excellent problem-solving skills and attention to detail. Strong communication and more »

Data Lead - CMMS Project Overall Purpose: UKAEA are undertaking a significant business transformation to upgrade their Computerised Maintenance Management (CMMS)/Enterprise Asset Management (EAMS) systems capability. As the Data Lead, you will oversee the programme's data workstream which will deliver a new … target data architecture, delivering significant benefits to UKAEA through the implementation of organisation wide platforms, improvement in data management and the rationalisation of the asset data across the UKAEA estate. You will collaborate with system integrations and cross-functional departments to ensure the successful … project-based data model definition and design Strong understanding and experience of data warehousing, ETL processes and Data Lake concepts and technologies. Experience working with multiple data sets and owners. Excellent problem-solving skills and attention to detail. Strong communication and more »

of the top 100 best small-to-medium size businesses to work for, join us on our journey! The Head of IT and Data is a senior leadership role in which you will beresponsible for overseeing VoCoVo'stechnology infrastructure, data management, data infrastructure, AI … capabilities andbusiness transformation efforts. The Head of IT and Data will ensurethat all IT initiatives align with VoCoVo's business goals, meetregulatory requirements, and maintain a high level of operational efficiency. The role iscrucial in ensuring the IT teams practices are scalable, secure, and compliant while supportingbusiness growth … and innovation.The Head of IT and Data will be a key member of the extended leadership team with full responsibility for IT, Data and systems and managing a small group of IT professionals. Please note, to apply for this position you must be based in the more »

of the top 100 best small-to-medium size businesses to work for, join us on our journey! The Head of IT and Data is a senior leadership role in which you will be responsible for overseeing VoCoVo's technology infrastructure, data management, data infrastructure, AI capabilities and business transformation efforts. The Head of IT and Data will ensure that all IT initiatives align with VoCoVo's business goals, meet regulatory requirements, and maintain a high level of operational efficiency. The role is crucial in ensuring the IT teams' practices … are scalable, secure, and compliant while supporting business growth and innovation. The Head of IT and Data will be a key member of the extended leadership team with full responsibility for IT, Data and systems and managing a small group of IT professionals. Please note, to more »

Starting in September 2025, our Data Engineer Apprentice program will give you the opportunity to develop a range of skills while working within our Global Pricing Data team. This is an ideal opportunity for anyone looking to embark on a career as a Data … we craft innovative pricing models that ensure our clients remain competitive in a rapidly evolving commercial market. You will work closely with our Data Engineering managers to interrogate data and implement data flows across our various lines of business and regions to support advanced … the Pricing Function and across other Allianz Commercial functions. Some of your specific responsibilities could include: Maintaining and enhancing our Pricing data lake and data warehouse Developing knowledge of company’s IT landscape, data and data systems Helping to develop new more »

Your new role We are seeking a Data Modeller with experience in data architecture and modelling. You will also have a strong understanding of relational and non-relational database systems and be proficient in data modelling tools (Erwin, SAP Power Designer). You will … have experience with data governance and data quality practices. What you'll need to succeed You will have an understanding of cloud platforms, particularly Azure along with knowledge of data integration and ETL processes. You will be familiar with data warehousing, data marts, and data lakes. Exposure to healthcare industry standards, such as FHIR, is a plus. You will come with excellent analytical and problem-solving skills and strong communication and collaboration abilities with the ability to work independently and as part of a team. Your experience will more »

Senior Data Engineer - Sheffield - Hybrid - £70k - £75k My client is currently recruiting for a Senior Data Engineer to join their team on a permanent basis. This role will require expertise in Azure, Databricks and SQL, with experience in senior positions with mentorship responsibilities. Salary and Benefits … Be highly skilled in implementing and managing data integration solutions using Azure Data Factory, Azure Databricks, Azure Data Lake, and Azure Synapse Analytics Strong SQL experience Develop scripts and automation using PowerShell, Python, or other relevant languages Strong communication skills to provide technical … teams What do I need to apply for the role Strong Azure experience - Azure Data Factory, Azure Databricks, Azure Data Lake, and Azure Synapse Analytics Strong SQL experience Python/Powershell - Scripting and automation skills MS Fabric (desirable) Experience in senior or lead data more »

Job Description: As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven … initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such … processes and best practices to streamline data workflows and reduce manual interventions. Experience working with bigdata ACID file formats to build delta lake, particularly with Iceberg file formats and loading methods of Iceberg. Good knowledge on Iceberg functionalities to use the delta features to identify the changed more »

Job summary An exciting opportunity has arisen in the Data and Analytics Team, at Northern Care Alliance, for a Senior Data Engineer to help migrate the current on-premises solution to a cloud-based solution in Azure. The Data and Analytics Team has recently … undergone a period natural growth and progression which has resulted in the opportunity for two Senior Data Engineers to join the existing Data Platform Team. This is a fantastic opportunity to join a team that is looking to be one of the first hospitals in the … methodologies and appropriate application of different techniques (Kimball). Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Desirable Knowledge & experience in working within an Agile (Scrum) environment/framework. Professional Registration Desirable Membership more »

Senior Data Engineer Location: Manchester – Hybrid Working Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks an influential Senior Data Engineer to help lead across design, build and deployment of cloud-based data solutions - transforming raw data into actionable … core industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Lead Data Engineering teams in designing, building, and maintaining large-scale data solutions using AWS data and analytics services. • Recognized as a … engineering, data science, and product development projects. • Expertise in AWS cloud technologies for ETL pipeline, data warehouse, data lake design/building, and data movement. • Design and deploy production data pipelines in big data architecture using Java more »

About Affinity Reply Glue Affinity is the new, high-growth specialist consulting company in Reply, dedicated to driving Next Gen Architecture, Data Driven Enablement, and Future Transformations. We distinguish ourselves by fostering robust and trusted relationships with our clients, ensuring the successful delivery of their desired outcomes through … our proactive and insightful approach Role Overview Glue Affinity Reply are Data Specialists and actively seek to grow and develop our consultants in the delivery of data solutions. Are you passionate about bridging the gap between the Business and IT through the lens of Data? We are seeking a seasoned Data Architect to join our team and partner with leading financial services clients. You will leverage your deep understanding of the financial services industry and data architecture expertise to design and implement innovative solutions that empower clients to leverage more »

AWS Data Engineer (Junior/Mid-Level) Package: £50,000 - £58,000 per annum + 6% contributory pension, UNLIMITED external certification training budget, health insurance, life assurance, and more! Location: UK-Wide offices | Hybrid (Onsite/Remote flexibility) We're seeking talented AWS Data Engineers to … for analytics and reporting. Implement ETL/ELT Workflows : Seamlessly migrate data to Data Warehouses, Data Lakes, and Lake Houses using cutting-edge AWS and open-source tools. Adopt DevOps Excellence : Leverage CI/CD, Infrastructure as Code (IaC), and automation to streamline … Strong skills in Python , Java , or Scala . Data Storage Know-How : Experience with AWS Redshift, RDS, Hadoop, and Data Lake architectures. DevOps Mindset : Familiarity with CI/CD, IaC, and other DevOps tools and methodologies. Please send your CV more »

AWS Data Engineer (Junior/Mid-Level) Package: £50,000 - £58,000 per annum + 6% contributory pension, UNLIMITED external certification training budget, health insurance, life assurance, and more! Location: UK-Wide offices | Hybrid (Onsite/Remote flexibility) We're seeking talented AWS Data Engineers to … for analytics and reporting. Implement ETL/ELT Workflows : Seamlessly migrate data to Data Warehouses, Data Lakes, and Lake Houses using cutting-edge AWS and open-source tools. Adopt DevOps Excellence : Leverage CI/CD, Infrastructure as Code (IaC), and automation to streamline … Strong skills in Python , Java , or Scala . Data Storage Know-How : Experience with AWS Redshift, RDS, Hadoop, and Data Lake architectures. DevOps Mindset : Familiarity with CI/CD, IaC, and other DevOps tools and methodologies. Please send your most up-to-date CV to more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

Senior Azure DevOps Engineer (Data Lake/Data Factory) x 2 - Remote - Up to £65k (REFBJ4) Up to £65k + Bonus + Benefits + Remote Working A growing organisation - that builds and delivers market leading applications in the healthcare space - requires two Senior Azure DevOps … solutions. Suitable candidates will have circa 5 years experience with Azure coupled with a deep understanding of Azure PaaS components including: Azure SQL Data Factory Databricks Power BI Data Lakes Fabric Or: AKS (deployment + management) API Management 3App Services Azure SQL and MI Functions Networking … App Insights Data Factory Databricks Both roles will require an understanding of the following: Terraform HELM Flux Powershell/Azure CLI Personal Attributes: Able to work well as an individual and as part of a team Take part in architectural discussions with technical/non-technical team members more »

AWS Data Engineer (Junior/Mid-Level) Package: £50,000 - £58,000 per annum + 6% contributory pension, UNLIMITED external certification training budget, health insurance, life assurance, and more! Location: UK-Wide offices | Hybrid (Onsite/Remote flexibility) We're seeking talented AWS Data Engineers to … for analytics and reporting. Implement ETL/ELT Workflows : Seamlessly migrate data to Data Warehouses, Data Lakes, and Lake Houses using cutting-edge AWS and open-source tools. Adopt DevOps Excellence : Leverage CI/CD, Infrastructure as Code (IaC), and automation to streamline … Strong skills in Python , Java , or Scala . Data Storage Know-How : Experience with AWS Redshift, RDS, Hadoop, and Data Lake architectures. DevOps Mindset : Familiarity with CI/CD, IaC, and other DevOps tools and methodologies. Please send your CV more »

to us — we want to see a broad mix of people from all backgrounds Who We Are Hypercube Consulting is a rapidly growing data and AI consulting firm dedicated to the energy sector . We combine deep domain expertise with cutting-edge technology to help our clients unlock … a Principal Machine Learning Engineer to lead and shape the design, development, and deployment of ML solutions at Hypercube. You will collaborate with data engineering, analytics, and cloud experts to guide our clients’ data strategy and ML roadmap, ensuring they gain tangible value from their data … large-scale data processing. SQL : Strong background in querying, wrangling, and optimising data. Data Architecture : Familiarity with data lake, data warehouse, or lakehouse architectures (e.g. Delta Lake). Additional (Nice-to-Have) Skills Infrastructure as Code : Terraform or similar. Containers more »

Job Opportunity: Data Engineer (Databricks Specialist) Location : Manchester | Employment Type : Full-time. Are you a passionate Data & AI expert with a strong Databricks background? A leading consulting firm is seeking a person skilled in Data Engineering to join their growing team. In this senior … time insights and decision-making. Data Integration: Develop scalable data ingestion processes from multiple sources and integrate them into Delta Lake or data lakes for unified storage and analysis. Collaboration: Partner closely with data architects, data scientists, and business … in Databricks . Proven ability to deliver large-scale data pipelines in consulting or enterprise environments. Technical Expertise: Proficiency in Databricks, Delta Lake , and Apache Spark . Strong programming skills in Python and SQL , with optional experience in Scala . Experience with cloud platforms such as Azure more »