1 to 25 of 60 Data Lake Jobs in London

Factory, Azure Synapse Analytics, and Databricks. Cloud Platform Expertise: Architect, deploy, and manage data solutions on Azure, including Azure Data Lake, Azure Databricks, Azure Synapse, and Azure Log Analytics. Data Modelling & Architecture: Implement scalable data models and architectures, with a strong … for deploying models into production for real-world applications Understanding of a variety of approaches to data platforms (e.g. Data Lake, Data Mesh, Data Warehouse, streaming, batch processing) Knowledge of security, GDPR and PII data handling principles Experience with … analysis. Strong experience with Azure Data services including: Azure Databricks, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Azure Log Analytics Deep understanding of data warehousing, data lakes, data mesh, lakehouse architecture (with medallion architecture more »

About the Role: As a Data Architect at [Electric Automotive Company], you will play a pivotal role in shaping the future of electric mobility. You will design and implement robust data solutions that power our critical business operations, from vehicle performance analytics to supply chain optimization. … Responsibilities: Data Architecture: Develop and maintain a comprehensive data architecture, including data models, data flows, and data governance policies. Sharing best practice in cloud native data integration - security, scalability, latency ; point to point data feeds, GDPR … Governance, customer consent management etc Data Integration: Design and implement data integration strategies to consolidate data from various sources, such as vehicle telematics, manufacturing systems, and customer interactions. Data Warehousing and Data Lakes: Architect and manage data warehouses more »

Data Engineer Permanent Location: Remote working with some onsite working Salary: Up to £75K Skills: SQL, Power BI, ETL, SSIS, Data Factory, Azure We are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer … will design, develop and maintain robust data infrastructure and ETL pipelines that support the data needs of projects, services and customers. To create insightful data visualisations and dashboards in PowerBI to enable data-driven decision-making. Collaborate with Data Consultants … delivery Including (SSIS, Azure Data Factory) Azure Data Services (including Data Factory, Databricks, Synapse Analytics, Data Lake) Relational and multi-dimensional data modelling Designing and delivering Testing including Regression, Unit, integration, and system for data solutions Understanding more »

Cloud Data Platform Engineer, Azure, Bicep, Data Engineering, SQL, Data Lake, Part Remote Cloud Data Platform Engineer required to work for a Professional Services business based in Central London. However, this is mainly remote and you will only be expected to … wants to be at the forefront (or who is already) of as many of the following technologies: Data Engineering Data Lake Data Migration Bicep IaaS IaC (Infrastructure as Code) Azure Data Analytics Data Factory Data Fabric SRE …/DevOps SQL Someone who has maybe been a SQL DBA and moved into a Data Engineering role would be a good fit. The team and the environment is a really positive one to be part of and you will be encouraged (and supported) to move on to more »

Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.). With … the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business. As more »

Data Architect (Senior/Principal Level) – Permanent, Hybrid, London £80k-£100k plus 15% bonus, car allowance Company description Our client teams operate globally from offices in the UK, Ireland, US, Nordics, and Netherlands. With diverse teams of experts combine innovative thinking and breakthrough technologies to progress further, and … in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Architect will join the business at a period of huge growth. Key Responsibilities: Design and Develop Data Architecture: Create, optimise, and maintain … conceptual, logical, and physical data models to support the enterprise data strategy. Data Strategy and Governance: Define and implement data management strategies, including data governance, metadata management, and data quality controls. Database and Cloud Technologies: Select appropriate database more »

Data focused tech business within the automotive industry. Role - Data Engineer Type - Fixed term contract (6 months) Salary - £65,000 - £75,000 Location - Hybrid, 2 days per week in the office (Victoria, London) Spec - PURPOSE OF POST: To implement scalable and efficient data models … databases, and processing systems To build robust, fault-tolerant data pipelines for ingesting, processing and transforming large volumes of data To collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data requirements and provide solutions To … warehousing, and big data technologies. Experience with Azure services, such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage. Experience implementing data quality checks and validation processes to ensure data consistency and integrity Familiarity with more »

We are seeking a skilled Data Engineer to join the Data team at our client in the Insurance industry. This role is crucial to driving the success of the Data Strategy, ensuring that their data infrastructure is robust, reliable, and scalable to … support company's rapid growth and commitment to excellence. As a Data Engineer, you will maintain and update the data pipelines and data warehouse, supporting Insight and Analytics with table creation, business logic, and stakeholder management. Working closely with the Head of Data … Proven ability to optimise data pipelines, ETL jobs, and queries for efficiency and cost effectiveness. Preferred knowledge of Azure Data Lake, Azure SQL Database, Synapse SQL pools, and Delta Lake. Industry experience in insurance, particularly broking (preferred). Bachelor's or master's degree in more »

Senior Data Technology Consultant Position Description Challenge yourself, change lives and help shape the UK's digital revolution. We look to our Business Consultants, to drive change, inspire trust with clients, and take responsibility for some of the world's most ambitious transformation projects. As a Senior Data … of consulting colleagues, will take a central role in providing support to our clients with a focus on driving their business outcomes using data and technology. You will also support the growth of the wider evolving business consulting function. A key focus of the role will be to … presenting technical concepts in simple, accessible language. • Leverage your deep understanding of legacy and cloud-based data technologies, including Data Lake, Data Warehouse, and Lakehouse concepts. • Bring broad technical knowledge of Azure data products, with subject matter expertise in areas like more »

The CAD-Data Architect/Data Advisor will be responsible for formulating the organizational data strategy, including standards of data quality, the flow of data within the organization, help customer with strategy and choice of products and security of data. … Tableau/Power BI/Advanced Excel, R/SAS/Python/Scala/Java, Azure (SQL Database, Cosmos Database, Data Lake Storage, PostgreSQL Database, Blob, Data Factory, Databricks, Analytic Tools, Stream Analytics, Synapse Analytics, Data Lake Analytics), and AWS (Analytics Services, Amazon Athena, Amazon EMR, Amazon Redshift, Amazon Kinesis, Amazon Openserach Services, Amazon QuickSight, AWS Glue DataBrew, Datalake, Amazon S3, Aws Lake Formation) is required. more »

Reporting to the Chief Technology Officer, the role is responsible for enterprise application & Data capabilities (inception, through design, implementation, maintained and retiral). This is a new function, therefore the incumbent will be responsible for building this function from the ground up, defining a strategy and leading a … function. Qualities, skills and experience required: Proven track record of having successfully led a team to deliver a strategic roadmap that matured applications & data capabilities (including framework, policies, processes and standards) to best practice levels. Significant experience of implementing and achieving enterprise-wide adoption of data … technology platforms including master data management, active metadata management, digital data catalogue, enterprise BI, AI/ML, data lake and data warehousing environments. Must have excellent skills and knowledge in Salesforce, Microsoft Dynamics, Tableau and Power BI. Workday would be beneficial. more »

Azure Data Engineer Location: Reading and 2 days on site per week Contract Type: 6=18 months We are seeking an experienced Azure Data Engineer to join our dynamic team. As part of our data engineering division, you will work with cutting-edge tools … and technologies to support data ingestion, integration, and transformation within the Azure ecosystem. The ideal candidate will have a strong background in data engineering, specifically with Azure Databricks, PySpark, and SparkSQL, as well as experience in testing and Azure DevOps. Key Responsibilities: Data Ingestion … to ingest, process, and transform large datasets efficiently. Testing & Validation: Implement automated testing using Pytest to ensure the quality and integrity of the data pipelines. Data Integration: Work with Azure SQL Database to develop and optimize T-SQL queries and stored procedures for data more »

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »

Do you want to work on a data transformation at a business putting innovation at the forefront of their data strategy? Do you love working to define, introduce, and deliver business wide data change? Are you looking for a role with purpose, where you … thousands of people? If you’re passionate about making a genuine difference and can boast an excellent track record of implementing and delivering data products to all areas of a business, then this Head of Data opportunity at a large housing association in London could be … technology in place, but it is not linked to the overall platform. Your role will be to help link the data lake, to business stakeholders, by building data products that allow the data to be accessed and used to inform business decisions. more »

be helping to shape the Reference Data Mastering and Distribution architecture and technology stack within our new cloud-based data lake-house. What You Will Be Doing Shape the portfolio of business problems to solve by building detailed knowledge of internal data sources. … define secure data exchange approaches. Acquire, ingest, and process data from multiple sources and systems into Cloud Data Lake Operate in the fast-paced, iterative environment while remaining compliant with bank’s Information Sec policies/standards Collaborate with others to map data … disparate data sets. Expert in creating data structures optimized for storage and various query patterns for e.g., Parquet and Delta Lake Meaningful experience in at least one database technology such as: Traditional RDBMS (MS SQL Server, Oracle) NoSQL (MongoDB, Cassandra, Neo4J, Cosmos DB, Gremlin) Understanding more »

Senior Data Engineer - Fully Remote - £60k My client are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and maintenance of their data infrastructure. In this role, you will assist in overseeing data integration, streaming systems, and … data engineering best practices while collaborating with various teams to ensure that data flows are efficient, scalable, and in alignment with the company's strategic goals. You will work on enterprise-level solutions and influencing business strategy with advanced data engineering capabilities. Salary & Benefits … Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) Data Vault Microsoft Fabric PySpark/Databricks Azure Synapse Azure Data Lake Data migration experience My client have very limited interview slots and they are looking to fill this vacancy within the next more »

people make better decisions with data. Combining passionate people, sector-specific insight and technical excellence to provide our customers an end-to-end data service. We use a collaborative, creative and user centric approach data to do good and solve difficult problems. We ensure that our … optimum solutions. Ethics, privacy and quality are at the heart of our work and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated and relentless. Data is a vast topic … measure. Methods Analytics was acquired by the Alten Group in early 2022. Purpose of the Role: Methods Analytics (MA) is recruiting for a Data Engineer to join our team within the Public Sector Business unit on a permanent basis. Location: This role will be mainly remote but require more »

DATA ENGINEER LONDON BASED £55,000-65,000 PER ANNUM This UK-based Music company are searching for a … new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible for building new data pipelines in python. THE COMPANY The company is one of the … the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using AWS. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as more »

Senior Data Analytics Engineer London (3 days a week in-office) Up to £70,000 per annum + 10% discretionary bonus Overview: La Fosse are excited to be partnering with a professional services firm who are looking to hire a Senior Data Analytics Engineer. This is … an exciting opportunity to work with a highly respected organisation, renowned for its commitment to data-driven decision-making and innovation. The successful candidate will bring a strong combination of data engineering expertise and data visualisation skills, playing a key role in developing and … Azure SQL Server – Proficient in managing and optimizing databases in Azure. Data Lakes & Delta Lakes – Skilled in utilizing Azure Data Lake and Delta Lake for scalable data storage. Azure Data Integration – Familiarity with Logic Apps, Azure Functions, and messaging technologies more »

approach allows our clients to enjoy benefits such as rapid innovation and development cycles. Our focus areas are both application workload migration and data migrations into platforms engineered on GCP. Go Reply is a Google Cloud Premier Partner with over 100 GCP engineers across our European practice. Go … Google Cloud Platform Managed Service Partner, an award from Google to endorse our credentials in managed services. www.go.reply.com About the Role As a Data & AI Lead , you will play a pivotal role in shaping our data-driven initiatives and delivering innovative solutions to clients leveraging Google … Cloud Platform (GCP). You will lead a team of data professionals, oversee the development and implementation of data strategies, and drive the adoption of AI and ML technologies. Responsibilities Strategy and Vision: Develop and execute comprehensive data strategies aligned with the company's more »

Head of Cloud Data Architecture - Contract - up to 12 months - Inside IR35 In this critical role, you will be responsible for designing and implementing advanced data solutions across multiple cloud platforms, including Azure and AWS. You will play a key part in shaping the data strategy, optimising data structures, and ensuring secure, scalable, and efficient data management. Key Responsibilities: Develop and maintain a strategic data architecture approach in multi-cloud … environments aligned with data governance standards. Design and implement robust, scalable data solutions using Azure services like Data Lake, Synapse Analytics, and AWS equivalents. Collaborate with leadership to build a data strategy Lead efforts in optimising data structures, integrating more »

Job Title: Senior Data Engineer Location: National Day Rate: £600 - £650 Contract Length: 6 Months Working Style: Hybrid Are you a highly skilled and experienced Senior Data Engineer? Do you have expertise in Power Platform: Power Apps, Power BI and Power Automate, SQL, Azure SQL DB … and cloud data warehousing? Our client, a Central Government organisation, is looking for a talented Senior Data Engineer to join their warm and collaborative Data & Business Intelligence team. As a Senior Data Engineer, you will play a crucial role in delivering a … in Azure SQL DB, ADF, and Azure Storage. Hands-on experience with Power BI, Power Apps, and Power Automate. Knowledge of data lake and cloud data warehousing, particularly Microsoft Fabric. The ability to consult with stakeholders, manage expectations, and resolve issues. The willingness to provide more »

DATA ENGINEER LONDON BASED £35,000-40,000 PER ANNUM This UK-based software firm is searching for a … new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in GCP. You will also be responsible for building new data pipelines in Python. THE COMPANY The company works within the Adtech … the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using GCP. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as more »

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … technology solutions drive performance and reduce costs while helping our clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either more »

Senior Data Platform Engineer Salary: £80,000 - 90,000 + Bonus and benefits Location: London - Hybrid We are currently seeking a Senior Data Platform Engineer to join a prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you … training programs to develop your skills. Parental Support : Industry-leading parental, adoption, and neonatal policies. Skills and Experience Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks. Strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions. Solid knowledge of security … CV to us by clicking on the Apply button below. Senior Data Platform Engineer Desired Skills and Experience Azure Data Lake Storage|Azure Compute|Azure Databricks|Azure DevOps|Jenkins|GitHub Actions|CI/CD|Infrastructure Automation more »