1 to 25 of 607 Data Pipeline Jobs in the UK

Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering & Governance, you will be responsible for leading the data engineering team in designing, implementing, and maintaining scalable data pipelines and infrastructure. You will collaborate closely with … cross-functional teams to ensure the integrity, availability, and security of the organisation's data, while also driving innovation in data engineering practices. You will work closely with the Data Science and Analytics team (which sits outside of the remit of this position) but more »

Mid-Level and Senior Data Scientist Roles - Hybrid/Bristol Location: Hybrid/Bristol - 2 days in office per week min. About Our Client: Our client is a leading organisation in the risk industry, specialising in cyber risk assessment and management. They are at the forefront of innovation … With unique perks like dog-friendly offices, team meals and enrichment days, their team thrives on a cooperative and inventive spirit. Mid-Level Data Scientist: Location: Hybrid/Bristol Salary: £50,000 - £60,000 per annum Contract Type: Permanent Key Responsibilities: Seeking an Engineer with a curious mindset … and an understanding of bespoke data transformation, without the need for the crutch of Cloud Platforms at all times… Develop, enhance, and manage intricate data ingestion pipelines. Integrate advanced machine learning elements into data pipelines. Implement data quality metrics and dashboards for more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good … space. This is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we … are ideally looking for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data more »

Data Engineer | Bristol (Hybrid) | £50,000 - £60,000 Peaple Talent have partnered exclusively with a family-owned farming and dairy company located in the heart of the picturesque Somerset countryside. With a legacy spanning over four generations, they are dedicated to producing delicious, organic dairy products while maintaining … our commitment to sustainability and environmental stewardship. Position Overview: We are seeking a talented and experienced Data Engineer with expertise in Azure to join our dynamic team. As a Data Engineer, you will play a crucial role in transforming raw data into actionable insights … that drive business decisions and enhance operational efficiency. You will work closely with cross-functional teams to design, develop, and implement robust data pipelines and solutions that support our growing data needs. Responsibilities: Build data pipelines that clean, transform, and aggregate data more »

ll play a key role building a Gen AI system that facilitates seamless communication between users and databases, enhancing efficiency and accuracy in data retrieval and analysis. Responsibilities include: Lead the development of systems with a specific emphasis on AI/ML applications, CI/CD pipelines, APIs … and communication layers across hybrid architectures spanning multiple public clouds and private data centers. Engineer global-scale backends using microservices or distributed systems, primarily in Python (experience in other languages is advantageous). Collaborate on PDF parsing and/or optical character recognition (OCR) projects. Construct data more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Job Summary: We are looking for a skilled and experienced Data Architect Technical to work as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing, and maintaining the data architecture for our organization. You will have … a strong understanding of data integration best practices and will play a key role in driving successful data integration and transformation initiatives. Responsibilities: Overall Solution: Over 15 years of IT experience and over 7 years of experience in architecting, designing, developing and maintaining an End to … visualization skills for data models and logical workflows. Continuous Improvement: Analyze performance metrics and propose improvements. Provide resolution to data pipeline challenges. Cloud Data Technologies: Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving strategies. Advocate more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Data Engineering Technical Lead Salary - £60,000 - £65,000 This is a great job for someone who has worked as a senior data engineer in data lake/lake house architecture platform and has hands on experience of developing data pipelines using … Pyspark and SQL. The successful individual will have working experience of AWS data eco system and toolsets, with passion to learn and explore new technology stack. A bit about the job: The Data Engineering Technical Lead will provide technical expertise and delivery capability across the development … hands on delivery. Working experience of Cloud Technologies and data eco system, AWS is preferable. Expert in development of data pipeline based on Pyspark and SQL with orchestration tools such as Airflow, Tivoli etc Knowledge of OLAP implementation on any Database technologies (Snowflake preferred) Excellent more »

Vertex Search is representing a fast-growing financial services firm that is now looking to make a Senior Data Engineering hire, the first role of its kind into the business with huge scope for impact and influence. The nascent data engineering team will collaborate with internal … teams around the business with a focus on data engineering, pipelines, tooling and services. Key Responsibilities: Data Engineering: Design and develop data services across various business functions Data Pipelines: Design and develop data pipelines for extracting, transforming, and loading data into appropriate storage systems. Data Tools and Services: Develop data tools and services to discover, understand, and utilize data effectively. Best Practice: Advise on and contribute to the development of data governance and management practices. Collaborate across teams to understand more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Chapman Tate is collaborating with a leading property management company that is revolutionizing the industry through innovative data-driven solutions. As they continue to … expand their operations, they are seeking a talented Azure Data Engineer with strong SQL expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and … so, this is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k Hybrid model – 3 days in the office per week. There is NO sponsorship on offer for this role, so you must be eligible to work in the UK My clients newly formed Data & Analytics team is … playing a pivotal role in driving our data-driven transformation. They are a diverse group of passionate individuals with expertise across various data and analytics domains. Currently transitioning from a program-based structure to a steady-state operation, and we're excited to embrace Agile methodologies … to optimize our efficiency and effectiveness. We are seeking a highly motivated and skilled Lead Data Engineer to join our growing Data & Analytics team. In this role, you will play a pivotal role in supporting the ambition to fully realise the benefits of a Lakehouse platform more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 9 reporting to the Head of Data Science - working closely with a wider Data Engineering function Focusing on end-to-end data pipelines, for training, evaluating and … deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience in data pipelines and deploying ML models Preference for experience in retail/… marketing but not required Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Experience in feature engineering and third-party data Apply below more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Templeton and Partners are currently on the look for an Data Engineer to join one of our clients within the Emerging Tech space on a 12month contract (PAYE), fully remote. You will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers … in data engineering, experience in data processing and management, and proficiency in working with developers to optimise data pipeline tooling. Responsibilities: Data processing: Using online workflows and command line tools/scripts to clean and transform our multimedia datasets to make … sharing other relevant information. This requires collaboration with multiple internal teams and working with spreadsheets, documents, internal wikis, and similar tools. Data pipeline: Support improvements to our data pipeline tooling by working closely with developers to provide feedback and make modifications to optimise data more »

Data Engineer - £95,000 - DV Clearance Required We are currently looking for a passionate and experienced Data Engineer to come and join one of our biggest clients - A consultancy that specialises in FS, Public Sector, Media, Software and Data Warehousing. They are looking for … available across the UK so no matter where you are from, we welcome your applications!!! The Role: We are looking for a savvy Data Engineer to … join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our software more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software … databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. Qualifications Degree in more »

Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is … the lifeblood of the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new … ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data more »