1 to 25 of 67 Senior Data Engineer Jobs in London

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be … responsible for designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want to minimize manual … processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating new product features using data. - Develop more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that … supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance … efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge fund industry. Technical Skills: Proficiency in Python more »

Senior Data Engineer £50-£60k DOE Mainly Remote working, in office twice a month in Exter offices. The company : Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along … of industry. Providing award-winning solutions to estate agencies, conveyancing, surveying, lender valuations, land asset management, environmental consultancy, and Government markets. The Opportunity : This senior role in the Data department is ideal for an experienced Data Engineer to work on their modern Data platform. Currently … undergoing an ambitious data transformation to shape the future of Data and revolutionize the property industry. This role is diverse and involves creating data-as-product solutions, including: Assembling large, complex data sets that meet functional and non-functional business needs Building infrastructure for optimal data more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. … Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute … to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other … platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the … design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable … and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will … have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track … record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with Data more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data ecosystem … Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. As this is a lead role 50% of your time will be leading and assisting the other data engineers and more »

range of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting … projects with a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

SENIOR) DATA ENGINEER ROLE PROFILE Hush is an ambitious and distinctive fashion brand, with plans to double the business over the next few years. Founded 20 years ago, we are now established as one of the UK’s leading online fashion retailers. We employ around 125 staff … Technology team with a key focus on aiding Hush to develop, maintain and draw insights from business intelligence solutions consisting of Google Big Query (Data warehouse), Domo (Visualisations), Snaplogic (ELT), and DBT (Modelling). Reporting into our Head of Technology, playing a critical role in our small Data … ll have the opportunity to challenge the status quo, preparing ad-hoc analysis, supporting business users in self-serve operations mode and actively championing data-science use and robust data analysis across the organisation. THE RESPONSIBILITIES Collaborate with the business to prioritise and define data requirements into more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role … Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure … the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. more »

My client, a highly prestigious hedge fund, is seeking an elite data engineer to join their team in London. The successful individual will have hands-on experience as a data engineer, alongside building ETL pipelines, financial data processing solutions, and owning the data lifecycle … management. You should have prior experience with both Python and SQL. You will be designing and implementing large scale data processing systems, alongside leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis. In addition, you should have experience … in data wrangling, data cleaning and data architecture. My client is committed to paying a substantial increase on any base salary and pay market leading bonuses. It is also worth mentioning that my client offers exceptional benefits, ranging from on-site breakfast + lunch (free for all more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and … data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »

sites across the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions, constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record more »

Senior Software (Data) Engineer - Up to £150k + bonus - 12m FTC Durlston Partners are working with a large financial institution whose Data Office team is revolutionising financial services, collaborating with engineering and business partners to redefine the investment experience. They're committed to innovation and excellence … your career. Innovation-Driven: Be part of a team that fosters creativity and forward-thinking solutions. The Role: As an individual contributor in the Data Enablement team, you'll play a pivotal role in addressing complex data challenges. You'll work closely with business and engineering teams to … deliver scalable and innovative solutions, enhancing their strategic data platform. This role requires a proactive approach to problem-solving and a strong enthusiasm for leveraging technology to create meaningful impacts. Key Responsibilities: Analyse and understand real-world problems, translating them into software-led solutions. Collaborate with business and engineering more »

A high growth global events business are searching for a Senior Data Engineer to join their Data and Analytics division. The successful candidate will have the opportunity to work in a close knit and high performing team that operates at group level. Key Responsibilities Data Platform Design: Lead the creation and optimization of data platforms for CRM, finance, and marketing, driving informed decision-making. Team Leadership: Head a skilled data team, collaborating with DevOps and System Integration to support Hyve portfolios and ensure alignment with business goals. Architecture Enhancement: Contribute to refining … data architecture across portfolios, ensuring consistency and relevance through continuous improvement. Requirements Extensive Experience: Minimum 5 years in data roles, with expertise in designing and implementing complex data platforms. Technical Proficiency: Skilled in handling diverse workloads and integrating real-time and batched data streams, MUST HAVE more »

Senior Data Engineer. Java/Python/AWS. Investment Management. £135,000 - £145,000 + Discretionary Bonus and Benefits. Cannot sponsor Visa. The Data Office team at my client is playing a key role in helping build the future of financial services, working together with business partners … of view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the platform’s … architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata management and data quality tooling more »

Senior Data Engineer. Java or Python and AWS. Investment Management. 12 month rolling Fixed Term Contract. £135,000 - £145,000 + 15% Guaranteed Bonus paid monthly + Benefits including health, holidays and 13% pension. Cannot Sponsor. CANNOT SPONSOR The Data Office team at my client is playing … of view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the platform’s … architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata management and data quality tooling more »

WHAT YOU'LL DOWelcome to BCG Worldwide IT! We are seeking an IT Data Security Architect to join our growing Information Protection team.You will be working in a Security Engineering, Architecture and Operations capacity to drive and support the continued evolution of our Secure Infrastructure Portfolio, notably in Data … threats. You will play a key role in developing and implementing our next generation of detection capabilities. You will:Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutionsSupport vendor assessments, including proof of concepts and … teams as well as the IT industry at largeCreate and maintain technical service roadmaps pertaining to monitoring and analysis solutionsData Management: Define and manage data models, schemas, metadata, and security rules. Design, create, deploy, and manage databases and data structures on premise and in the cloud to fulfill more »

has recently expanded its front office team of Quants and Traders. As a consequence, the need has arisen to increase the headcount on their data engineering and analytics team as the need has arisen to build a new real-time streaming data platform and enhance the capability of … their data lake. Our client is looking for the very best and you will be working with an exceptionally talented team with a flat management structure. This will be a business facing role where you are given the freedom to build solutions in the way you see fit to … have the tools, they need to enhance profitability. In return they are offering above-market basic salary in addition to exceptional bonuses... THE ROLE: Senior Data Engineer Quantitative Trading The Data Engineering and Analytics team own all of the Data that is required for offline more »

Senior Data Engineer (Snowflake) London - x2 days in office a month as a rough expectation. Xcede is delighted to be recruiting a Senior Data Engineer on behalf of a market leader in the retail and e-commerce space. Our continues to invest in innovation … to millions of customers in several formats. As they continue to expand their operations and enhance their digital capabilities, they're seeking an experienced Senior Data Engineer who shares their ambition for well-structured, stable, scalable Data management systems. The Senior Data Engineer should come with a proven track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing, building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone more »

Senior Data Engineer - FinTech (Tech for Good!)London Office/Fully remote across UK and EuropeDo you want to utilise cutting-edge FinTech innovations to drastically reduce inequity within society?As a Senior Data Engineer, you will join a close-knit team based across … UK and Europe that is continuously innovating and applying state-of-the-art technologies within greenfield projects.You will be building the team's modern data platform from the ground up as the foundation of the team's decision-making abilities. You will be leveraging your Python, AWS, and SQL … exciting growth.If you are a passionate techy looking for a position that will allow you to positively impact society, bridge the gaps with big data, and flexibility to work from London or remotely, this could be the role for you!Apply now if this is of interest!Job typePermanent more »

has partnered with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of … database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers, preferably GCP or AWS. Experience creating DataOps pipelines. Adept at working in an Agile environment, actively participating in approaches such as more »

Are you ready to join a global investment manager who are at the forefront of shaping the future of data technology? You’ll play an integral role in the new team where you will be instrumental in driving the development of their new data analytics platform. Your contributions … about technology; then this could be the perfect role for you. Key Responsibilities: Spearhead the architectural design and implementation of a greenfield cutting-edge data platform, contributing to the transformation of our client's data landscape. Collaborate with a cross-functional team of software engineers, data engineers … and data analysts to support and enhance both existing and new data platforms. Varied role including improving the data quality and software development Be the driving force in identifying anomalies within the data, leveraging your expertise to enhance decision-making processes and optimise the value derived more »

INFO75,000 - 85,000 HYBRIDSENIOR DATA ENGINEERThis is a great opportunity with one of Europe's fastest-growing Data and Analytics Consultancies. They have recently expanded into the Data Engineering market having established themselves in other verticals, so you have a unique opportunity to be one of … the more senior members of the team.THE ROLE You'll be working on several projects at one time, though this will change as the company continues to grow. You will be the lead on several Data Engineering projects which will often overlap with the BI domain. This is … you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited more »