1 to 25 of 64 Senior Data Engineer Jobs in London

Senior Data Engineer £50-£60k DOE Mainly Remote working, in office twice a month in Exter offices. The company : Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along … of industry. Providing award-winning solutions to estate agencies, conveyancing, surveying, lender valuations, land asset management, environmental consultancy, and Government markets. The Opportunity : This senior role in the Data department is ideal for an experienced Data Engineer to work on their modern Data platform. Currently … undergoing an ambitious data transformation to shape the future of Data and revolutionize the property industry. This role is diverse and involves creating data-as-product solutions, including: Assembling large, complex data sets that meet functional and non-functional business needs Building infrastructure for optimal data more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute … to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other … platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in more »

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be … responsible for designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want to minimize manual … processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating new product features using data. - Develop more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will … have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track … record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with Data more »

sites across the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions, constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. … Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. more »

A high growth global events business are searching for a Senior Data Engineer to join their Data and Analytics division. The successful candidate will have the opportunity to work in a close knit and high performing team that operates at group level. Key Responsibilities Data Platform Design: Lead the creation and optimization of data platforms for CRM, finance, and marketing, driving informed decision-making. Team Leadership: Head a skilled data team, collaborating with DevOps and System Integration to support Hyve portfolios and ensure alignment with business goals. Architecture Enhancement: Contribute to refining … data architecture across portfolios, ensuring consistency and relevance through continuous improvement. Requirements Extensive Experience: Minimum 5 years in data roles, with expertise in designing and implementing complex data platforms. Technical Proficiency: Skilled in handling diverse workloads and integrating real-time and batched data streams, MUST HAVE more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the … design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable … and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that … supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance … efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge fund industry. Technical Skills: Proficiency in Python more »

SENIOR) DATA ENGINEER ROLE PROFILE Hush is an ambitious and distinctive fashion brand, with plans to double the business over the next few years. Founded 20 years ago, we are now established as one of the UK’s leading online fashion retailers. We employ around 125 staff … Technology team with a key focus on aiding Hush to develop, maintain and draw insights from business intelligence solutions consisting of Google Big Query (Data warehouse), Domo (Visualisations), Snaplogic (ELT), and DBT (Modelling). Reporting into our Head of Technology, playing a critical role in our small Data … ll have the opportunity to challenge the status quo, preparing ad-hoc analysis, supporting business users in self-serve operations mode and actively championing data-science use and robust data analysis across the organisation. THE RESPONSIBILITIES Collaborate with the business to prioritise and define data requirements into more »

Senior Software (Data) Engineer - Up to £150k + bonus - 12m FTC Durlston Partners are working with a large financial institution whose Data Office team is revolutionising financial services, collaborating with engineering and business partners to redefine the investment experience. They're committed to innovation and excellence … your career. Innovation-Driven: Be part of a team that fosters creativity and forward-thinking solutions. The Role: As an individual contributor in the Data Enablement team, you'll play a pivotal role in addressing complex data challenges. You'll work closely with business and engineering teams to … deliver scalable and innovative solutions, enhancing their strategic data platform. This role requires a proactive approach to problem-solving and a strong enthusiasm for leveraging technology to create meaningful impacts. Key Responsibilities: Analyse and understand real-world problems, translating them into software-led solutions. Collaborate with business and engineering more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and … data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role … Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure … the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. more »

My client, a highly prestigious hedge fund, is seeking an elite data engineer to join their team in London. The successful individual will have hands-on experience as a data engineer, alongside building ETL pipelines, financial data processing solutions, and owning the data lifecycle … management. You should have prior experience with both Python and SQL. You will be designing and implementing large scale data processing systems, alongside leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis. In addition, you should have experience … in data wrangling, data cleaning and data architecture. My client is committed to paying a substantial increase on any base salary and pay market leading bonuses. It is also worth mentioning that my client offers exceptional benefits, ranging from on-site breakfast + lunch (free for all more »

range of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting … projects with a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Senior Data Engineer | DataBricks | AWS/Azure | Full Remote Outside IR35 up to £500 per day 6 months initial Start - Immediate FRG Data are looking for a Senior Data Engineer with strong DataBricks experience. Skills & Experience: We are looking for someone that has … a strong mix of the following skills and experience: * Strong experience utilising the Microsoft Azure stack for data engineering ie Azure Functions * Core skills in coding with SQL, Python and Spark * Proven experience using DataBricks ie lakehouse, delta live tables, Pyspark etc more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to derive valuable … insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to the Azure Cloud … a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate with diverse departments more »

an independent charity committed to bringing about better health and health care for people in the UK. This is an exciting role in the Data Analytics directorate, a team of around 25 staff. Data Analytics plays a core role in delivering the Foundations overall mission and strategy. We … the UK population, as well as health and care system performance. The Improvement Analytics Unit (IAU) is a sub-team of 14 staff within Data Analytics. It is a unique partnership between NHS England and the Health Foundation. We evaluate innovative and complex initiatives in health care in order … to support learning, improvement and policy development. Our Senior Data Engineer will work within the Improvement Analytics Unit (IAU).They will support our Assistant Director and Senior Analytical Managers to deliver an ambitious work programme, leading on data engineering, data management and information governance. more »

has partnered with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of … database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers, preferably GCP or AWS. Experience creating DataOps pipelines. Adept at working in an Agile environment, actively participating in approaches such as more »

Are you ready to join a global investment manager who are at the forefront of shaping the future of data technology? You’ll play an integral role in the new team where you will be instrumental in driving the development of their new data analytics platform. Your contributions … about technology; then this could be the perfect role for you. Key Responsibilities: Spearhead the architectural design and implementation of a greenfield cutting-edge data platform, contributing to the transformation of our client's data landscape. Collaborate with a cross-functional team of software engineers, data engineers … and data analysts to support and enhance both existing and new data platforms. Varied role including improving the data quality and software development Be the driving force in identifying anomalies within the data, leveraging your expertise to enhance decision-making processes and optimise the value derived more »

Senior Data Engineer Location: London Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge … technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various … systems. Utilize Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data processing. Optimize database performance, including tuning more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search … for a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data pipelines, ensure … data quality, and automate reporting processes. Your work will support decision-making and contribute to strategic goals, making a significant impact across the company. What you'll be doing... You will gather data from various departments and tools, integrating it into a central data lake or warehouse. more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an … urgent hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking … for interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a Data more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities. The role holder must ensure that the data is well-managed and ready for consumption by the … business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business e.g. the digital teams or central data services and projects more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in data assessment and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data Engineering or Data Warehousing (Data Engineer/DW Developer) with robust … DW development and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL/ELT processes Extensive experience with Python Excellent numerical, analytical, and statistical skills Ability to visualize and present more »