Lead DataEngineer A brand-new and exciting opportunity has arisen for a Lead DataEngineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead DataEngineer will be intrumental … in their migration over to Azure alongside installing best practises in the data engineering team. This is an excellent opportunity for a Lead DataEngineer who is looking to work for a rapidly not for profit organisation who are currently in the process of a huge cloud … migration and improving the data engineering function. If you are currently a Lead DataEngineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect more »
Manchester, England, United Kingdom Hybrid / WFH Options
Anson McCade
Data Science & ML Consultant Location : Manchester – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching datamore »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Primis
Job Title: Technical Lead DataEngineer Location: Edinburgh, Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £70,000 - £85,000 The Role: Lead the Data team to deliver ETL processes, build and maintain data pipelines, enhance scalability, performance, maintainability, configurability and usability … Be involved in the entire life-cycle of the Data Strategy, including idea creation, deployment, and longer term updates and enhancements Support the product and Software Development Managers in prioritisation, scoping and leading delivery of Data Strategy features in the exciting world of Future State Architecture Manage company … data, monitor accuracy and completeness, and advise ways that data quality can be improved Able to zero-in on bugs without looking at the code Technical Lead DataEngineer Requirements: Good SQL and NoSQL experience Expert-level ability in TSQL development Integrations utilising a range of more »
Basingstoke, England, United Kingdom Hybrid / WFH Options
Intec Select
DataEngineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained Working … with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services Experience more »
shop and this role will face off with a range of business leads in order to build the pipelines that will ultimately ingest the data for their new strats! Responsibilities: Design and implement scalable ETL solutions (structured and unstructured; batch and streaming) Building data pipelines, standardizing, and cleansing … data for the investment team Define and set best practice standards surrounding data (i.e., data modelling, database design, ETL design, job scheduling and monitoring, etc) Manage the entire data flow, from acquisition to transformation into actionable insights using SQL and Python/Java Design and maintain … APIs Requirements: Degree in Computer Science. 4+ years of professional software development experience. A passion for data and experience in applying that passion to high quality data products. Strong knowledge of software engineering best practices, object-oriented concepts, and the ins and outs of data-focused development. more »
DataEngineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a DataEngineer and working closely … with technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to more »
Sheffield, England, United Kingdom Hybrid / WFH Options
Pearson Carter
DataEngineer Pearson Carter are currently working with a Education consultancy based in Sheffield who are looking for a DataEngineer who has strong AWS cloud, SQL and Python experience. They offer a base salary of £50,000 and £60,000 Get in touch if you … are looking for your next opportunity! Responsibilities: Data pipeline development in Python Development of the data warehouse stack Integrate additional data sources Experience: SQL Python AWS, Glue and Lambda Salary They offer an excellent salary: £60,000 Location This client has an office in Sheffield however they more »
Sheffield, England, United Kingdom Hybrid / WFH Options
BJSS
with people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do … challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering … with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS dataengineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll more »
City Of Bristol, England, United Kingdom Hybrid / WFH Options
Noir
DataEngineer - Leading Pharmaceutical Company - Bristol (Tech Stack: DataEngineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented DataEngineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled DataEngineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »
Northamptonshire, England, United Kingdom Hybrid / WFH Options
Capgemini
Job Title: Cloud DataEngineer Location: Northampton,UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud DataEngineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Northampton, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build … Tool) for managing transformations in the data pipeline. Strong programming skills in technologies like Python, Scala, Spark, PySpark or Ab Initio, Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow more »
London, England, United Kingdom Hybrid / WFH Options
iO Associates - UK/EU
Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »
Greater London, England, United Kingdom Hybrid / WFH Options
Morgan McKinley
an unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not just accessible but … optimised for safe, secure utilisation across multiple fronts — be it reporting, analytics, or powering applications — ultimately driving substantial productivity gains for all data consumers. As a collaborative force, you will seamlessly integrate across central, regional, and local teams, refining our client's data visualisation strategy and elevating our more »
Oxfordshire, England, United Kingdom Hybrid / WFH Options
Mirus Talent
Senior DataEngineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior DataEngineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its … next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless datamore »
Lincoln, England, United Kingdom Hybrid / WFH Options
BJSS
with people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do … challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering … with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS dataengineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll more »
Greater Manchester, England, United Kingdom Hybrid / WFH Options
MRJ Recruitment
Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior DataEngineer to design, build, and maintain a variety of solutions including … drive real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior DataEngineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. You … ll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations for efficient data analysis. more »
understanding of how people think, feel and act; globally and locally in over 90 markets. By combining the deep expertise of our people, our data resources and benchmarks and our innovative analytics and technology, we help our clients understand people and encourage growth. Backed by industry-leading anti-fraud … more than 100 markets worldwide. Our clients include many of leading brands, who trust us to collect reliable insights. Join Kantar Profiles as a DataEngineer, where your technical expertise and collaborative spirit will contribute to the success of our data-driven initiatives. Apply now and be … part of a team that is shaping the future of data analytics at Kantar Profiles. Job Summary As a DataEngineer at Kantar Profiles, you play a crucial role in the development and maintenance of robust data pipelines, facilitating seamless access to data for our more »
Principal DataEngineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced DataEngineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment … office Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal DataEngineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down more »
Exeter, England, United Kingdom Hybrid / WFH Options
Noir
DataEngineer - Leading Pharmaceutical Company - Exeter (Tech Stack: DataEngineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented DataEngineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled DataEngineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »
London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching datamore »
Knutsford, England, United Kingdom Hybrid / WFH Options
Capgemini
Job Title: Cloud DataEngineer Location: Knutsford, UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud DataEngineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Knutsford, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build … Tool) for managing transformations in the data pipeline. Strong programming skills in technologies like Python, Scala, Spark, PySpark or Ab Initio, Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow more »
is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for a DataEngineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various … platforms. The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python and AWS is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Viqu Limited
Senior DataEngineer (Databricks) – Remote – Leeds - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and more »
DataEngineer - London - £65,000 I am working with a London based company who specialise in the organisation of large-scale events who are looking to add a DataEngineer to their growing data team. You will join the organisation at a significant point in … their data journey as they have redesigned their data platform so they can better deliver data to stakeholders across the business. In this role you will work alongside the Data Architect, Data Engineers and Data Analyst as part of a close-knit and collaborative … you will join a business who are passionate about the development of its people. You will also be encouraged to be involved in the data community with the opportunity to attend conferences and events to broaden your knowledge! In this role you will be responsible for the development and more »
This is a Contract Role Contract Duration : 6 months Location: London, Hybrid, Need to work 2 days from Office Inside IR 35 Required Skills: Proven experience (5 years) as a Load Balancing and Proxy Network Engineer. Proven experience (5 years more »
Lead DataEngineer/Data Lead/Senior DataEngineer/Lead DataEngineer Lead Dataengineer We are searching for a Lead DataEngineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client … is a world renowned leading Non-profit organization. Lead DataEngineer/Data Lead/Senior DataEngineer/Lead DataEngineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate, document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team of Data Engineers. Requirements: Solid and more »