101 to 125 of 241 Data Engineer Jobs in London

Data Engineers are responsible for aiding UK Health in developing a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications. They will need to work closely with UK Health subject matter experts to scope new data integrations, design a data model, and … perform data cleansing and transformation within the data analytics platform. Core activities Establish new integrations into the data foundation. The engineer will get to work with ontology experts and UK Health subject matter experts to map out a data model. Data cleansing and transformation … as defined with subject matter experts. Configure links to other datasets in the data foundation. Work with UK Health QA analysts and subject matter experts to test and validate the output datasets. Set up schedules to regularly update the data in analytics platform. Configure monitoring and data more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to … realise consistent trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and maintenance. more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

About the job My client is seeking a dynamic Lead Data Engineer with robust data architecture and warehousing skills to lead their Data Engineering team. Being a leading financial institution, data fuels their operations and growth. being pivotal in ensuring data is expertly modelled … ingested, transformed, and accessible organisation-wide. Responsibilities: Team Leadership: Mentor and develop our Data Engineering team. Strategy Development: Shape and implement our data engineering strategy. Data Architecture: Define and implement solutions within our Data Vault framework. Cross-Functional Collaboration: Partner with data science, credit risk … and analytic teams to meet their data needs. Customer Data Platform: Manage our Rudderstack-based platform for comprehensive Customer 360 views. Quality Assurance: Ensure CI/CD and test automation with robust observability. Cost Management: Optimise data platform costs within budget. Supplier Management: Maintain strong relationships with more »

Lead Data Engineer85,000 – 103,000Location: United Kingdom (London – London) Type: PermanentPrincipal Data EngineerLocation: London (2 days a week in the office)Salary: 90k - 105k (DOE)About the Company:Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to … cutting-edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions.Key Responsibilities:Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across … various systems.Utilize Python for data manipulation, transformation, and automation tasks.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.Implement data pipelines and workflows to support real-time and batch data processing.Optimize database performance, including tuning queries and managing more »

Data Engineer - AWS Join a prominent blue-chip company at the forefront of the Media industry. As an AWS Data Engineer, you'll spearhead the design, implementation, and upkeep of our AWS Redshift data warehouse, ensuring it operates at peak performance, scalability, and reliability. Technical … Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to a competitive annual salary, we offer an enticing … Attainable 10% bonus scheme Potential for up to 5% annual pay increase Don't miss this chance to play a pivotal role in revolutionizing data management within the Media sector while enjoying ample opportunities for personal and professional growth. Apply now by sending in your CV more »

We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data. Your tasks will include implementing data processes, managing … data architecture, designing ETL processes, and analyzing data for business insights. You will also make data accessible through various platforms and consult internal teams on data usage. This role is ideal for someone with extensive experience in data management, a strong background in computer science … and excellent communication skills. Responsibilities Implement data processes for the Data Warehouse and internal systems Manage and update Data Engineering architecture Implement processes for data accuracy and reconciliation Design and implement ETL processes Make data available through reporting platforms Analyze data and communicate insights more »

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications … Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting the business in adoption of Machine Learning and GenAI capabilities more »

DATA ENGINEER Location: Remote Hybrid (1 day per month in London) Job Type: Contract - 6 Months Daily Rate: £(Apply online only) per day INSIDE IR35 Concept Resourcing are currently working with one of the UK's leading IT consultancies. We are seeking an experienced Data Engineer to join their team and contribute to the success of various IT salesforce projects. Key Responsibilities: Architecture, modelling and leadership skills Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure … understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc. Strong SQL skills. Strong data analysis skills. Excellent written and verbal communication skills If you're more »

Principal Data Engineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment … office Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal Data Engineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … a fantastic Head of Software Engineering. What you'll be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the … services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with … a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

means that we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK.The role responsibilities The Principal Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines … to ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data operations managers, ensuring that all … work delivers maximum value to the BBC.Role and responsibilities will comprise of:· Leads and architects on developing robust and scalable complex data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be optimised for performance, reliability, and more »

Data EngineerPermanentHybrid - 2 days a week in HammersmithMy Client, a Large Global organisation based in London, are seeking an experienced Data Engineer to join their Data & Analytics team. They are embarking on a journey to create a single source of data for the organisation globally. … This is a highly strategic programme and will need an experienced Data Engineer who has experience of working with large data sets. You will be a valuable member of the team helping them to implement Snowflake as their main Cloud source as well as enhancing their overall … customer experience.The ideal candidate must have:Strong data engineering experienceExperience with SnowflakeExperience with Amazon Web Services (AWS)Strong Python experienceMatillion (ETL & ELT) experienceData Visualisation experience - ideally Power BIStrong SQL experience Retail or consumer/customer insight experienceExcellent communication skillsUnfortunately, the role will not be providing sponsorship at this time.If more »

Purview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details: Role: Senior SAS Data Engineer Location: London & Edinburgh Duration: Permanent and Contract Work Mode: Fully remote with openness to travel occasionally when required We … are looking for strong Senior SAS Data Engineer Job Description: Senior Data Engineer (SAS) – They want to rewrite existing pipelines (SAS, Info, pear, shell scripts) to target state which will be Python and DBT transformation based to be then loaded to SF on Azure. SAS (primary … pearl, shell scripts (secondary) engineers who has experience to convert to Python , DBT based pipelines and load data to Snowflake. Converting SAS based module to python based Candidates who have data management experience in Snowflake with expertise in Python, DBT, Airflow or similar technologies Must have hands on more »

has recently expanded its front office team of Quants and Traders. As a consequence, the need has arisen to increase the headcount on their data engineering and analytics team as the need has arisen to build a new real-time streaming data platform and enhance the capability of … their data lake. Our client is looking for the very best and you will be working with an exceptionally talented team with a flat management structure. This will be a business facing role where you are given the freedom to build solutions in the way you see fit to … the tools, they need to enhance profitability. In return they are offering above-market basic salary in addition to exceptional bonuses... THE ROLE: Senior Data Engineer Quantitative Trading The Data Engineering and Analytics team own all of the Data that is required for offline regression analysis more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will have … experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track record … of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with Data Modelling more »

Job Description:We seek an experienced Data Platform Engineer to join our leads team. As a Data Platform Engineer, you will play a crucial role in managing data platform engineering and core toolsets, with a focus on Azure infrastructure as code. You will ensure our … data infrastructure's reliability, scalability, and performance while contributing significantly to our data ecosystem and driving innovation within our organisation.The opportunity is exciting for a seasoned data engineer or advanced analytics engineer interested in platform and infrastructure to shape our data infrastructure and drive … innovation in a dynamic and collaborative environment. If you are a passionate engineer with expertise in Azure and infrastructure pipelines, we encourage you to apply and be a part of our dedicated global team of talented professionals, make a real impact on our Petcare data and analytics platform more »

Azure Data Engineer - Contract - Inside IR35 This is an Azure Data Engineer position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and … Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline … experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven decisions that improve the services the client … provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data development lifecycle that meet the quality and security standards more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and … efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune … data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and CloudRun. Experience with building and optimizing data pipelines for more »

Data Engineer Location: London, 3 days per week in the office Salary range: £60,000-£65,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

Our client, a leading innovation and transformation consulting firm based in London, is seeking a talented Senior Consultant - Data Engineer. This role is perfect for an experienced professional who thrives in dynamic environments and is eager to drive impactful data engineering projects. The firm specializes in leveraging advanced … technology to transform businesses, providing cutting-edge solutions to a diverse range of clients. As a Senior Consultant - Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and architectures. Your expertise will help clients harness the power of their data … that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support data integration and transformation. Implement and maintain data architectures on AWS more »