1 to 25 of 206 Data Engineer Jobs in London

is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for a Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various … platforms. The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python and AWS is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

Data Engineer - London - £65,000 I am working with a London based company who specialise in the organisation of large-scale events who are looking to add a Data Engineer to their growing data team. You will join the organisation at a significant point in … their data journey as they have redesigned their data platform so they can better deliver data to stakeholders across the business. In this role you will work alongside the Data Architect, Data Engineers and Data Analyst as part of a close-knit and collaborative … you will join a business who are passionate about the development of its people. You will also be encouraged to be involved in the data community with the opportunity to attend conferences and events to broaden your knowledge! In this role you will be responsible for the development and more »

Data Engineer - Security Cleared - AWS SR2 is recruiting a Data Engineer to join an inflight programme for a government client. The project in question involves a complex data transformation initiative and someone with strong experience in AWS, S3, Athena and Python. Due to the nature more »

are working with a high-profile Government Department on an exciting project. They are undertaking a massive project where they are looking for multiple data engineers who must hold Active SC Clearance. 3 Month Rolling Contract Outside IR35 contract Occasional Travel Required £(Apply online only) ASAP - 2 Interview Stages … Must have Active SC Tech Requirements: Must have commercial Data Engineering experience 5+ Years: S3 Athena Glue AWS Lambda Python DevOps & Terraform (advantageous more »

Senior Data Engineer | DataBricks | AWS/Azure | Full Remote Outside IR35 up to £500 per day 6 months initial Start - Immediate FRG Data are looking for a Senior Data Engineer with strong DataBricks experience. Skills & Experience: We are looking for someone that has a strong … mix of the following skills and experience: * Strong experience utilising the Microsoft Azure stack for data engineering ie Azure Functions * Core skills in coding with SQL, Python and Spark * Proven experience using DataBricks ie lakehouse, delta live tables, Pyspark etc more »

Your new company A high-Profile Emergency Organisation based in London Your new role Data Engineer - NPPV3 Cleared What you'll need to succeed Our client is looking for an experienced Data Engineer to join the Data Analytics Platform Project team. The successful candidate will … be detail-oriented, with excellentOrganisational skills and experience as a Data Engineer for Analytics Platforms. Successful candidates will need to hold a valid and active Warwickshire NPPV3 clearance. Requirements: Previous experience as a data engineer, ideally in the policing sector or similar Technical expertise with data models, data mining, and segmentation techniques Experience of Architecting and implementing Azure Services e.g. Azure cloud services, Azure storage, IIS, Azure Active Directory (AD), Azure Resource Manager (ARM), Azure Storage, Azure, Blob Storage, Azure VMs, SQL Database, Azure Functions, Azure Service Fabric, Azure Monitor, and Azure Service Bus more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client … is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate, document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team of Data Engineers. Requirements: Solid and more »

Data Engineer A brand new and exciting opportunity has recently arisen for a Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and SQL to join one of the UK's Largest Charity based in London. As the Data Engineer you will be shaping the data eco-system and being influential in the migration to Salesforce. This is an excellent opportunity for a Data Engineer who is looking to work for the Largest UK Charity who are working on greenfield projects and improving their data function. If you are currently a Data Engineer with experience in ETL, Azure Data Factory, Azure DataBricks, SQL and keen to be influential in greenfield projects then this is the perfect opportunity for you! Skills that are required for a Data Engineer are: Experience more »

Position: Data Engineer Reporting to: Lead Data Engineer Contract type: Full Time, Permanent, Remote (with Occasional Travel) This is an exciting opportunity to join one of Europe's fastest growing healthtech startups About Cera At Cera Care, our mission is to empower people to live longer … be the global leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. . About Data at Cera Data has a critical role to play and … our operational workforce, from caregiver recruitment to care delivery to our client base, and provides insights for performance improvement and cost-efficiency. Health-related data offers a comprehensive financial overview that could lead to cost savings and crucially lead to health deterioration prevention. The primary mission of our Data more »

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be responsible for … designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want to minimize manual processes and … strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating new product features using data. - Develop and automate more »

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Senior Data Engineer to the team based in London. Requirements of a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis … Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Principal Data Engineer to the team based in London. Requirements of a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis … Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering team … within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments in data more »

Data Engineer (Azure) Up to £80,000 North London office x1 day per week OVERVIEW A successful & established B2C Insurance giant are hiring for a Data Engineer to join a strong, cross-functional Data team in the UK. You will be spearheading some of their … key Data Engineering projects, working on an Azure tech stack. Proven experience using Azure Cloud Technology is essential for this role. Your responsibilities as a Data Engineer will include, but not be limited to: Spearhead Data Engineering work within the team, including ETL pipelines, CI/… CD, platform engineering. Help guide and mentor junior team members on key Data Engineering projects for the business. Engage with senior business stakeholders and communicate technical concepts and projects to non-technical audiences. YOUR SKILLS & EXPERIENCE A successful Data Engineer (Azure) will have the following. Strong proficiency more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients and … deploy Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … legacy to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that supports … their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. … Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge fund industry. Technical Skills: Proficiency in Python and more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the … design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable … and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing more »

Job Title: Junior Data Engineer Location : London (Anywhere in UK) Pay Rate : £150/Day We are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely with … senior data engineers, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. … Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue, AWS Lambda, and AWS Data Pipeline. Data Storage Management : Manage and optimize data storage solutions, including Amazon S3, Amazon Redshift, and AWS RDS. Data Quality and Validation : Ensure data more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. … Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … re a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software tools into … existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. Essential Skills Proven experience as a Data Engineer, with expertise developing scalable data pipelines. Strong more »

Senior Data Engineer £50-£60k DOE Mainly Remote working, in office twice a month in Exter offices. The company : Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with … winning solutions to estate agencies, conveyancing, surveying, lender valuations, land asset management, environmental consultancy, and Government markets. The Opportunity : This senior role in the Data department is ideal for an experienced Data Engineer to work on their modern Data platform. Currently undergoing an ambitious data transformation to shape the future of Data and revolutionize the property industry. This role is diverse and involves creating data-as-product solutions, including: Assembling large, complex data sets that meet functional and non-functional business needs Building infrastructure for optimal data extraction, transformation, and more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support further … growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain, support and … expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise and work closely with our team more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative … data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for … large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in data more »

Data Engineer – London – Up to £120,000 I am working with a leading Blockchain start-up, whose core offering is based around the research, development and deployment of infrastructure. This VC-backed client has seen massive success in the last 12 months and are now capitalizing on their … who are ready to take on project ownership and create products that will truly disrupt their industry. Role The business is looking for a Data Engineer with a passion for new technologies/Strong analytical skills and whilst experience in a quant or trading role is not essential … beneficial. The team is highly entrepreneurial giving every new starter a great opportunity to take on project ownership straight from the off. As a Data Engineer you will be working on the company’s core analytics/Monitoring and Alerting platform alongside contributing to the research framework. Requirements more »

My client, a highly prestigious hedge fund, is seeking an elite data engineer to join their team in London. The successful individual will have hands-on experience as a data engineer, alongside building ETL pipelines, financial data processing solutions, and owning the data lifecycle … management. You should have prior experience with both Python and SQL. You will be designing and implementing large scale data processing systems, alongside leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis. In addition, you should have experience … in data wrangling, data cleaning and data architecture. My client is committed to paying a substantial increase on any base salary and pay market leading bonuses. It is also worth mentioning that my client offers exceptional benefits, ranging from on-site breakfast + lunch (free for all more »