1 to 25 of 42 Data Engineering Jobs in the North West

strategy and supporting the mission to deliver exceptional Management (MI) products and services? Do you want to collect and manage a vast array of data which is used by the Secretary of State? DWP Digital is seeking a Senior Data Engineer to join our MI team who provide … me more about the position: Working with modern cloud environments and a mix of legacy on-premises technologies, you'll help develop the DWP Data Engineering Strategy for MI products and services that enables the department to gain insight and make more informed choices. The work is fast … paced with a large and growing portfolio of MI products built upon hundreds of data sets. You'll focus on back-end data processes to support MI reporting, rather than visu... more »

LEAD DATA ENGINEER REMOTE FIRST (UK BASED) UP TO £100,000 PERMANENT Do you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working with public sector organisation? This role is an amazing chance to work with some experienced and … talented individuals. THE COMPANY The company is a leading consultancy company. They are looking to build out their data engineering function with an expert in cloud technologies and prior experience working with public sector organisations. THE ROLE You will be: Designing, developing, and delivering solutions and presenting ideas. … Some light line management and mentoring of junior data engineers. Working on a variety of projects including building out infrastructure, ETL work, architecture design, advancing and maintaining warehouses, etc. YOUR SKILLS AND EXPERIENCE High levels of proficiency in a cloud technology. Strong capabilities with Python, Spark, and Databricks. Experience more »

Role – Lead Data Engineer Skills – Leadership/Python/Any Cloud Location – Manchester Work Pattern – Once every 2 weeks in the office Salary – up to £80,000 plus benefits package including a significant Bonus. The Company We are looking for Data Engineer to join a very well-established … company and data team. They have a huge amount of data, it’s one of the strategic pillars of the company and they are heavily investing in a new system, which will be a vast improvement. This role will focus on exploring solutions to maintain, improve, and scale … their use of data. They do an awful lot with data, it’s a huge asset to the business and they have a large number of people who have access to their data systems for analytical and insight purposes. The Role This is an amazing opportunity for an more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This … role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: Identify opportunities for … automation and process improvement. Mentor and guide data engineers. Establish coding standards and best practices. Implement and document data integrity and quality checks. Optimize queries. Facilitate collaboration within the data engineering team. This role involves close collaboration with the Principal Cloud Engineer and the Data more »

Senior Data Engineer (Remote) - Stealth SaaS Startup Location: Manchester (Remote Friendly) Salary: £65,000 - £75,000 per annum About Us: We are an innovative stealth start-up set to launch a cutting-edge SaaS product next year. We’re looking for a talented Senior Data Engineer to join … our team and build robust data pipelines. Responsibilities: Build, and maintain scalable data pipelines. Maintain the pipeline through Databricks and Apache Beam Seamless data integration and quality. Data storage solutions using GCP (will still be considered with other cloud experience) Best practices in data management … and SDLC. Work with Data Scientists to bring the AI/ML models into production Databricks for daily data processing Qualifications: Experience in data engineering and pipeline construction. GCP and familiarity with other cloud environments. Understanding of SDLC. Experience with Databricks. Programming skills (Python and SQL more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we pay over … combination of microservices that make up a single customer journey. Our production environment is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work … where you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes An more »

strategy and supporting the mission to deliver exceptional Management (MI) products and services? Do you want to collect and manage a vast array of data which is used by the Secretary of State? DWP Digital is seeking a Senior Data Engineer to join our MI team who provide … me more about the position: Working with modern cloud environments and a mix of legacy on-premises technologies, you'll help develop the DWP Data Engineering Strategy for MI products and services that enables the department to gain insight and make more informed choices. The work is fast … paced with a large and growing portfolio of MI products built upon hundreds of data sets. You'll focus on back-end data processes to support MI reporting, rather than visualisation work. This role has an emphasis on data engineering technical leadership - you'll lead other more »

DWP. Digital with purpose. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and supporting data capabilities that are essential to DWP services? Do you want to be involved … in agile, multidisciplinary teams to deliver these changes, making over services easier to find, access and use. We're looking for a talented Lead Data Engineer with the experience and passion to lead a high-performing team of data engineers working to build and support data capabilities … maintain an effective professional community. Defining, updating and implementing Career Pathways to enhance capability development, talent management and reduce attrition. Defining and implementing the Data Engineering standards and Best Practices for DWP. Understanding the demands and development of the profession in the wider industry and feed this into more »

Data Architect - UK Wide - Need to be DV Security Cleared Data Architect with experience in data modelling, data integration, and data architecture is required by a leading global consultancy. You must already hold DV (Developed Vetting) Security clearance to apply for this role Working with … some high-profile clients such as the MoD & government, you will be working on some of the most interesting data architecture projects going on at the moment. They offer remote working when needed with offices all over the UK for when you need to be in the office. There … will be the odd visit to the client side, but that will be project-dependent. Experience needed: Data Modelling; Data Integration & Processing; Data Storage; Information Consumption - ideally gained across E2E data deliveries. Experience in data toolsets and platforms supporting the architectural knowledge above. Experience in more »

strategy and supporting the mission to deliver exceptional Management (MI) products and services? Do you want to collect and manage a vast array of data which is used by the Secretary of State? DWP Digital is seeking a Senior Data Engineer to join our MI team who provide … me more about the position: Working with modern cloud environments and a mix of legacy on-premises technologies, you'll help develop the DWP Data Engineering Strategy for MI products and services that enables the department to gain insight and make more informed choices. The work is fast … paced with a large and growing portfolio of MI products built upon hundreds of data sets. You'll focus on back-end data processes to support MI reporting, rather than visualisation work. This role has an emphasis on data engineering technical leadership - you'll lead other more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting, visualisation, analysis … and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data infrastructure, including Microsoft more »

Senior Data Engineer London/Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query, Python … and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You'll have the more »

Digital with Purpose. DWP Digital is seeking a Senior Data Engineer to apply data engineering on a massive scale, influencing issues which affect millions of citizens and making a real difference to how the UK works. DWP is the UK's largest department, every year we pay … with huge datasets (quite possibly the largest on offer in the UK), you'll be delivering benefits that positively impact thousands of UK citizens. Data modelling is key in this role - you'll be running platforms and transforming raw data into model raw datasets. Our production environment is … cloud engineering. You'll be executing code in different places across the following tech stack: Azure, Databricks, PySpark and Pandas. You will steer the data engineering function within a wider product team. There'll be lots of connecting and interaction with stakeholders - you'll work closely with product more »

A Master Data Analyst is sought after by a prominent client. If you are aiming to advance your career in data, this opportunity is ideal for you. My client stands as one of Manchester's most well-established companies. They seek an individual with a few years of … experience as a Data Analyst or Junior Data Engineer to create and maintain master data records within the client's systems, encompassing stock, customers, suppliers, and pricing information. Conduct data quality checks and audits to detect and correct any discrepancies or errors in the master data. … Work collaboratively with cross-functional teams to guarantee data consistency and precision across various integrated systems. Formulate and enforce data governance policies and procedures to uphold data integrity and security. Offer training and support to end-users regarding master data management processes and best practices. Oversee more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their team and … be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. … The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as more »

Senior Data Engineer Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … year at the Real I.T Awards 2024- one of the many awards we are proud of ! Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale for our clients, data analysts,data scientists, and stakeholders. As such we are more »

Senior Data Scientist Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … years and as a result we’re looking for great people to join our exciting team. Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Science is pivotal to this mission. As a Senior Data Scientist you will take a leading role in researching, building, deploying and monitoring machine learning (ML) models, in close collaboration with cross-functional teams. more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some of … the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer Educated to degree … level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data Migration Programmes With the brand heavily data more »

maintaining business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements … and priorities As part of the BI team you will be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the more »

Lead Data Engineer Hybrid - Manchester based (2x a month) £80,000 salary plus 20% annual bonus I am currently partnering with a leading digital retailer that service some of the worlds largest brands and they are seeking a Lead Data Engineer to join their Data Engineering team and play a pivotal role in designing, constructing, integrating and maintaining a robust data platform on multiple clouds. The successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow … Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better work/life balance. Joining the fastest-growing company in their sector. Working with the latest tech and Cloud services. Ability to manage and develop a team more »

About The Role We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Principal Data Engineers are experts in … their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships, and be passionate about developing and upskilling others. Your role in a nutshell: Act as … a technical SME within our engineering community to produce and ensure user-centered software is developed based on business requirements and following best practices. Work collaboratively with colleagues to explore, design, and deliver solutions to client problems. Maintain client relationships and troubleshoot issues through collaboration. Design and manage software more »

strategy and supporting the mission to deliver exceptional Management (MI) products and services? Do you want to collect and manage a vast array of data which is used by the Secretary of State? DWP Digital is seeking a Senior Data Engineer to join our MI team who provide … me more about the position: Working with modern cloud environments and a mix of legacy on-premises technologies, you'll help develop the DWP Data Engineering Strategy for MI products and services that enables the department to gain insight and make more informed choices. The work is fast … paced with a large and growing portfolio of MI products built upon hundreds of data sets. You'll focus on back-end data processes to support MI reporting, rather than visu... more »

a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be … exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as a Databricks Engineer/Data more »

Senior Data Engineer (Databricks) – Remote - 6 Months Contract (Initial) – Outside IR35 VIQU are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and … consolidating/centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in … Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data more »