1 to 25 of 178 Data Lake Jobs in the UK

Factory, Azure Synapse Analytics, and Databricks. Cloud Platform Expertise: Architect, deploy, and manage data solutions on Azure, including Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Log Analytics. Data Modelling & Architecture: Implement scalable data models and architectures, with a strong … for deploying models into production for real-world applications Understanding of a variety of approaches to data platforms (e.g. Data Lake, Data Mesh, Data Warehouse, streaming, batch processing) Knowledge of security, GDPR and PII data handling principles Experience with … analysis. Strong experience with Azure Data services including: Azure Databricks, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Azure Log Analytics Deep understanding of data warehousing, data lakes, data mesh, lakehouse architecture (with medallion architecture more »

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

About the team The Data Architect role sits in the Data Authority team within Architecture and Software Solutions. The Architecture and Software Solutions Function is part of the Software Engineering and Complex Services Department, which sits within the Technology Business Unit. The role reports to the … Data Authority Manager dealing directly with the business to provide data centric solutions and data expertise support for business problems ranging from customer base acquisition, support to analytics, management and compliance reporting, and best practice guidance, the team is an agile working environment, key … Master Data Management In depth understanding of data management and storage systems (database, data container, data lake, data warehouse), with a focus on Microsoft Azure/Snowflake Ability to design and enforce data infrastructure policies, procedures and more »

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data … and storage technologies, ideally within Azure. Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system … and storage technologies, ideally within Azure. Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system more »

data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory, Synapse/Fabric, Databricks, Spark and other data tools Advantageous to have: Insurance domain knowledge a plus … the business requirements. Design data models and lakehouse’s using medallion architecture that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools. Develop, maintain, and optimize semantic data … models in production environments. Optimizing data models from various sources such as Azure SQL databases and Azure Data Lake Storage Gen2 for usage in Power BI Ensure efficient querying of large datasets and troubleshoot any performance issues related to data retrieval more »

Job Title: Solution Architect - Data Integration (Telco) Job Description We are seeking a highly skilled and experienced Solution Architect to lead the design and implementation of data integration solutions within our telco environment. This role is … pivotal in ensuring seamless data flow between our systems of record, specifically Sonalake SwitchedOn Fibre and Salesforce, and our data lake, Azure Synaps. Key Responsibilities: Data Architecture Design: Develop and maintain a comprehensive data architecture for our telco systems of record … focusing on data flows, data quality, and data governance. Identify and analyze data sources, target systems, and data transformation requirements. Design data integration patterns and strategies, including ETL/ELT processes, data synchronization, and data more »

Head of Data/Azure Data Architect Chandlers Ford - £100,000+ plus bonus + excellent package An excellent opportunity for an established Head of Data/Azure Data Architect to join a Global group of companies who are a market-leading provider … a proven ability to deliver strategic data solutions that drive business value. Specific experience with Azure Synapse Analytics, Azure Data Lake, and Azure Databricks for large-scale data processing and analytics. Technical Proficiency: Extensive experience with cloud-based data platforms, particularly … in Microsoft Azure. Proficiency in using Azure SQL Database, Azure Data Factory for ETL processes, Azure Data Lake Storage for scalable data storage, and Azure Stream Analytics for real-time analytics. Familiarity with Azure Purview for data governance and compliance, as more »

About the Role: As a Data Architect at [Electric Automotive Company], you will play a pivotal role in shaping the future of electric mobility. You will design and implement robust data solutions that power our critical business operations, from vehicle performance analytics to supply chain optimization. … Responsibilities: Data Architecture: Develop and maintain a comprehensive data architecture, including data models, data flows, and data governance policies. Sharing best practice in cloud native data integration - security, scalability, latency ; point to point data feeds, GDPR … Governance, customer consent management etc Data Integration: Design and implement data integration strategies to consolidate data from various sources, such as vehicle telematics, manufacturing systems, and customer interactions. Data Warehousing and Data Lakes: Architect and manage data warehouses more »

Data Engineer Permanent Location: Remote working with some onsite working Salary: Up to £75K Skills: SQL, Power BI, ETL, SSIS, Data Factory, Azure We are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer … will design, develop and maintain robust data infrastructure and ETL pipelines that support the data needs of projects, services and customers. To create insightful data visualisations and dashboards in PowerBI to enable data-driven decision-making. Collaborate with Data Consultants … delivery Including (SSIS, Azure Data Factory) Azure Data Services (including Data Factory, Databricks, Synapse Analytics, Data Lake) Relational and multi-dimensional data modelling Designing and delivering Testing including Regression, Unit, integration, and system for data solutions Understanding more »

role will support the ongoing implementation of Microsoft Fabric and a strategic migration of a SQL database to the Microsoft Fabric Data Lake . The role is a 3-6 month contract and for the most part remote - there will be occasional office visits. Key Responsibilities Data Migration to Microsoft Fabric: Oversee the migration of SQL databases to Microsoft Fabric Data Lake, ensuring data integrity, accessibility, and performance. Design & Strategy for Data Lake: Define and implement a robust strategy for data structuring within the Fabric … Data Lake, focusing on best practices in data sharing, table organisation, access, and controls. Integration with BI Tools: Ensure that data is effectively integrated with our existing applications, including Qlik (which will remain a primary BI tool) and Power BI. Collaboration with Stakeholders more »

Data Architect – Dynamics 365 CRM, D365 CRM, Microsoft Dynamics CRM, Data Migration, Data Architect, Data Modelling, Data Warehousing, ETL, Data Integration, Cloud Architecture, Azure, SQL,Database Design, Data Governance, Data Security, Data Migration, Business Intelligence, Analytics, Data Strategy, Data Management, Master Data Management, Data Lakes, Data Pipelines, Customizations, Configuration – Contract – West Midlands - £625pd We are looking for experienced Data Architect, preferably with expertise in Dynamics 365/D365 … CRM/CE for an exciting contract opportunity. This is a 6-12-month role where as well as defining the data taxonomy and ontology, you will steer the direction of the business in relation to data retention and ageing from all their data more »

Job Title : Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location : Fully Remote Employment Type : Permanent, Full-Time Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless … part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse. Ensure Data Quality & Governance : Implement data quality checks, ensure regulatory compliance, and support data governance … Azure Data Engineer: Azure Data Expertise : Proficiency in Azure Databricks , Azure Data Factory , Azure Synapse Analytics , and Delta Lake . Databricks & Spark : Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics. ETL/ELT Skills : Strong more »

Job Title : Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location : Fully Remote Employment Type : Permanent, Full-Time Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless … part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse. Ensure Data Quality & Governance : Implement data quality checks, ensure regulatory compliance, and support data governance … Azure Data Engineer: Azure Data Expertise : Proficiency in Azure Databricks , Azure Data Factory , Azure Synapse Analytics , and Delta Lake . Databricks & Spark : Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics. ETL/ELT Skills : Strong more »

Title: Azure Data Engineer Location: Manchester City Centre (3 days a week onsite) Salary: £50,000 - £65,000 DOE The Role As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure. Leading a small team, you … tools. Collaborate with business stakeholders to understand data requirements and integrate diverse data sources into a unified data lake or warehouse. Perform data cleansing, transformation, and enrichment to ensure data quality and consistency. Monitor and optimise data … data visualization tools (e.g., Power BI, Tableau) Experience with Azure cloud services, including Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure SQL Database Our Values They pride ourselves on being a values-led law firm. This means: We do what more »

Cloud Data Platform Engineer, Azure, Bicep, Data Engineering, SQL, Data Lake, Part Remote Cloud Data Platform Engineer required to work for a Professional Services business based in Central London. However, this is mainly remote and you will only be expected to … wants to be at the forefront (or who is already) of as many of the following technologies: Data Engineering Data Lake Data Migration Bicep IaaS IaC (Infrastructure as Code) Azure Data Analytics Data Factory Data Fabric SRE …/DevOps SQL Someone who has maybe been a SQL DBA and moved into a Data Engineering role would be a good fit. The team and the environment is a really positive one to be part of and you will be encouraged (and supported) to move on to more »

We are looking for an experienced Data Architect to join our client on a transformational journey. As a key member of their Data Architect team, you will play a pivotal role in translating business needs into robust data architecture solutions. Your expertise will drive … the design, development, and optimisation of data models, ensuring data quality, governance, and security across the systems. Key Responsibilities: Design and Development: Create conceptual and logical data models to support business, data, and technical requirements. Develop data flows, automate processes … analyst/modeler, including complex enterprise and dimensional data modelling. Proven experience in a data warehouse, data lake, or operational data store environment. Expertise with major data modelling tools (e.g., SQL Database Modeller, MySQL Workbench, PowerBI). In more »

Data Lead | Newcastle/Hybrid | £70,000 - £80,000 Microsoft | Azure | ETL | Azure Data Lake | BigQuery | Python | team leadership | technical leadership | Architecture | and more An opportunity has arisen for you, a highly skilled and experienced Data Engineer to join this newly formed Data … for improvement and optimization. Develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Lake, Google BigQuery, Python, and other relevant technologies. Mentor and coach team members, fostering a culture of continuous learning and growth. Qualifications and Skills: Extensive … now to be considered. george.aldridge@opusrs.com Data Lead | Newcastle/Hybrid | £70,000 - £80,000 Microsoft | Azure | ETL | Azure Data Lake | BigQuery | Python | team leadership | technical leadership | Architecture | and more more »

daily towards creating the world we want tomorrow. Job Description: Senior Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data more »

Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.). With … the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business. As more »

prevention services. As part of their ongoing growth, they are looking to strengthen their technology capabilities with the addition of a Head of Data to lead their data strategy and digital transformation. The Head of Data will play a pivotal role in shaping and … executing the data strategy to support the organisation's digital transformation and long-term goals. This role will oversee data governance, architecture, and analytics, ensuring the business fully leverages its data assets to enhance operational efficiency and customer engagement. Leading the data … that drive business value. Extensive experience with cloud-based data platforms, particularly Microsoft Azure, including Azure Synapse Analytics, Azure Data Lake, and Azure Databricks. Proficiency in Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure Stream Analytics more »

the best of the best isn’t just a goal—it’s in our DNA. We’re on the lookout for an incredible Data Architect who thrives on innovation and excellence, with experience in the AWS environment, including S3, Redshift, and other AWS products. Based in our London … office and reporting into the Senior CRM & Customer Service Ops Manager, you will: Design & Strategy: Architect cutting-edge, scalable data solutions using AWS services, ensuring peak performance and reliability. Data Management: Masterfully manage data storage, retrieval, and processing across AWS S3, Redshift, and other … warehousing and analytics AWS Lambda: Serverless computing for ETL processes AWS Glue: Data integration AWS RDS: Managed relational databases AWS Lake Formation: Data lake management and governance Python/SQL: Programming for data processing and querying Amazon Kinesis: Real-time more »

Are you a Data Engineer looking to work with the latest data and analytics technologies within an environment that actively encourages continuous learning? Do you want to help enable clients to unlock their data potential and value? About us: Apexon is a digital-first … helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … a Data Engineer with a focus on Azure cloud data services (e.g. Azure Data Factory, Data Lake, etc). Experience working with databases (MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Strong programming skills, ideally in Python. more »

Data Architect (Senior/Principal Level) – Permanent, Hybrid, London £80k-£100k plus 15% bonus, car allowance Company description Our client teams operate globally from offices in the UK, Ireland, US, Nordics, and Netherlands. With diverse teams of experts combine innovative thinking and breakthrough technologies to progress further, and … in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Architect will join the business at a period of huge growth. Key Responsibilities: Design and Develop Data Architecture: Create, optimise, and maintain … conceptual, logical, and physical data models to support the enterprise data strategy. Data Strategy and Governance: Define and implement data management strategies, including data governance, metadata management, and data quality controls. Database and Cloud Technologies: Select appropriate database more »

Data focused tech business within the automotive industry. Role - Data Engineer Type - Fixed term contract (6 months) Salary - £65,000 - £75,000 Location - Hybrid, 2 days per week in the office (Victoria, London) Spec - PURPOSE OF POST: To implement scalable and efficient data models … databases, and processing systems To build robust, fault-tolerant data pipelines for ingesting, processing and transforming large volumes of data To collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data requirements and provide solutions To … warehousing, and big data technologies. Experience with Azure services, such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage. Experience implementing data quality checks and validation processes to ensure data consistency and integrity Familiarity with more »