26 to 50 of 57 Data Pipeline Jobs in the North West

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

Are you a Data Engineer with solid Kafka experience and a passion for building robust, scalable data pipelines? We're working with a fast-growing, tech-first organisation looking to grow their data function with a dedicated and ambitious Data Engineer. Youll … play a key role in helping this business shape and own its data estate, supporting everything from customer insight to operational efficiency. Working closely with a forward-thinking Head of Data, this is a genuine opportunity to make your mark on a greenfield data function with the autonomy to shape the future of how data is used across the company. What Youll Be Doing: Design, build and manage scalable and secure data pipelines. Own and optimise the ETL process, ensuring high-quality and reliable data flows. More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a start up tech consultancy and help to lead their data engineering practice. If you are an experienced and capable data engineer … and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the … engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, Synapse, SQL) Expert use of Databricks More ❯

Head of Data Engineering As the Head of Data Engineering, you will design, develop, and scale the company's data infrastructure, ensuring it supports business growth and delivers measurable value. Reporting directly to the senior data leader, you will lead a hands … on team, utilising the Azure Data Stack, including Synapse, to develop robust pipelines and solutions. Collaborating with teams across Data Governance and BI, you will ensure that data engineering efforts align seamlessly with the company’s broader data strategy. A key part … make the role their own and isn’t afraid to step forward with new ideas and strategies. Key Responsibilities Develop and execute a data engineering strategy aligned with business goals. Utilise the Azure Data Stack (including Synapse) to build scalable, secure, and efficient data More ❯

Senior Data Engineer - MS Fabric - Remote - £70k - £75k My client are a leading Data Partner and consultancy looking for an experienced senior data engineer with skills in Microsoft Fabric being the absolute essential here, the Azure Data Platform and Python to join … programme - guaranteed learning and development investment Life insurance Private medical health insurance Contributory pension scheme Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Azure Develop good working relationships with clients on a project including interpersonal skills with … both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support More ❯

Senior Analyst & Data Specialist Location: Liverpool Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯

AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data Engineer to … join our client’s growing team? You'll play a key role in developing, maintaining, and improving our end-to-end data pipeline, working with cutting-edge technologies and large-scale datasets in real-time. Skills and Experience: Strong problem-solving skills Knowledge of AWS or similar … Experience debugging business-critical systems Role and Responsibilities: Write high-quality application code and tests Develop infrastructure automation and scheduling scripts for reliable data processing Continuously improve platform performance with cutting-edge technologies Provide support for production systems Review code and give helpful feedback Developing scalable backend and More ❯

Senior Data Scientist (Permanent) Location: Blackpool - 3 days per week onsite Salary: Up to £55,000 plus benefits such as Civil Service Pension (28% contribution) + Bonus 5-10% Applicants must be eligible to gain SC clearance - Last 5 continuous years UK residency, clear criminal and financial record … checks essential. Visa sponsorship is not available for this opening. Our client, a prestigious civil service organisation, is seeking a talented Senior Data Scientist to join their dynamic team. This is an exciting opportunity for someone looking to work independently on a variety of ongoing and new data … and maintenance of automated reporting pipelines Develop and maintain predictive models and pricing analytics solutions Create and enhance product segmentation models Manage complex data projects and automated data pipelines Conduct data discovery projects and onboard new data sources Ensure high-quality data More ❯

the UK's leading providers of specialist services to the Construction and Facilities Management sector who are currently on the lookout for a Data Engineering Manager with GCP expertise . This is a permanent position offering up to £70K , with a hybrid working set-up (1-3 days … UK. The business is very much in its growth stage, and they are currently consolidating their IT infrastructure across the group. As the Data Engineering Manager, you will be joining a new collaborative team. Reporting into the Head of Data & Analytics, you will be a key … Data Engineer Strong proficiency in SQL and experience with database management systems (e.g., MySQL, PostgreSQL, MongoDB). Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Luigi). Experience working with Google Cloud Platform tools Proficiency in programming languages such as Python, Java More ❯

Job Description Data Architect | 6-Month Contract | London - Vauxhall (2 Days/Week Onsite) | £550–600/day Outside IR35 We’re looking for an experienced Data Architect to lead the data modelling strategy for a large-scale system integration project. This is a … month contract working on-site in Vauxhall two days per week, helping shape the future of a major data platform used by millions globally. The company provides a market-leading credit and financial insights platform, enabling users to make better decisions and build stronger financial futures. You’ll … join a highly collaborative, fast-moving environment where technology and data drive the user experience. This Data Architect role is critical to the success of a project to merge two distinct data systems. Your Responsibilities: Design the end-to-end architecture to unify two More ❯

Job Title : Data Science Actuarial Analyst Experience Level : 2+ Years Salary : Competitive, based on experience Reports to : Senior Data Science Actuarial Manager We are seeking a talented Data Science Actuarial Analyst to join a leading insurer in Manchester. The team is dedicated to delivering … cutting-edge analytical insights, ensuring data-driven decision-making that supports the company’s strategic goals. Job Overview The Data Science Actuarial Analyst will be responsible for utilizing advanced data science and actuarial techniques to analyse complex datasets, support risk management, and contribute to … the development of pricing models and financial forecasts. This role offers the opportunity to work alongside senior actuaries and data scientists in a collaborative environment focused on innovation and continuous learning. Key Responsibilities Develop, maintain, and optimize predictive models for pricing, reserving, and risk management. Perform complex data More ❯

Data Engineer Tech Stack- Azure Location- Wigan Area Salary: Up to £50K We're partnering with a leader in the parking management sector, driving innovation with products that support multi-sites, cashless payments and ethical enforcement. After growing success, the company is continuing its growth and looking to … expand its Data Engineering team. Key Responsibilities: Working in a 20+ strong IT, Software & Data team. Building the future of their data systems (data pipelines, reporting, Datawarehouse etc). Working with the latest MS tech stack including ADF, Synapse, MS Fabric and … Power BI. MUST have 3+ years of Data Engineering experience. What’s in it for you as their Data Engineer? Hybrid working. The chance to work with the latest tech such as MS Fabric. Working as part of a growing team that wants to push boundaries. More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

I am recruiting for a Data Scientist for an exciting multi national business. As a Data Scientist, you’ll be at the heart of data-driven decision-making. You’ll help build and maintain scalable data pipelines, design predictive models, and turn … the business. This role offers a balance of technical depth, creative problem-solving, and cross-functional collaboration. Do you love solving problems with data? You can enjoy the challenge of digging into complex datasets and uncovering insights that drive business outcomes. Key Responsibilities Develop and maintain robust data pipelines to support analytics and machine learning initiatives. Build and deploy predictive models using statistical methods and ML algorithms. Ensure high data quality through validation, monitoring, and automated checks. Translate business needs into clear analytical approaches and solutions. Communicate results and insights via dashboards, reports, and More ❯

I am recruiting for a Data Scientist for an exciting multi national business. As a Data Scientist, you'll be at the heart of data-driven decision-making. You'll help build and maintain scalable data pipelines, design predictive models, and turn … the business. This role offers a balance of technical depth, creative problem-solving, and cross-functional collaboration. Do you love solving problems with data? You can enjoy the challenge of digging into complex datasets and uncovering insights that drive business outcomes. Key Responsibilities Develop and maintain robust data pipelines to support analytics and machine learning initiatives. Build and deploy predictive models using statistical methods and ML algorithms. Ensure high data quality through validation, monitoring, and automated checks. Translate business needs into clear analytical approaches and solutions. Communicate results and insights via dashboards, reports, and More ❯

Chroma is currently working with a prominent high street retailer who is looking for a Lead Data Engineer to join their growing team in Manchester . Offering up to £90K with excellent benefits and hybrid working (3 days per week on site) , this is an excellent opportunity for … someone keen to get involved in the early stages of strategic data projects and deliver robust data solutions. The company is a well-known retailer with hundreds of shops across the UK, France and the USA. They have built a strong reputation over the years, and … driven business. Now is the perfect time to join them on this exciting journey as they look to drive forward innovation through meaningful data insights. As a Lead Data Engineer you will join a newly established team tasked with enabling the company to unlock the value More ❯

delighted to be supporting a well-known business in Manchester on an exclusive basis. We’re searching for a Solutions Architect with a Data background, that wants to be part of an exciting transformation journey. Responsibilities: Gaining in-depth knowledge of existing business legacy systems and mapping migration … systems with built-in security to comply with regulatory requirements and company standards. Assessing and prioritising business needs and new requirements within the data architecture strategy to support evolving reporting and analytics. Driving innovation by leading solution development and facilitating technical workshops to align on architecture and design. … Defining and managing relationships between data sources while overseeing the impact of future or proposed changes. As a Solutions Architect you will have: 7+ years of experience migrating systems and data platforms from on-premises data centres to public cloud environments (Azure preferred but More ❯

ML development, automation, and general software engineering. The successful candidate will play a key role in building and deploying machine learning features and data-driven applications. You will work on end-to-end solutions – from writing robust code and unit tests to developing APIs and integrating machine learning … in the travel or retail industry would be an advantage. Responsibilities Design, implement, and maintain software components that incorporate machine learning algorithms and data processing. Develop clean, efficient Python code for both backend logic and integration of ML models. Understand the business drivers behind each feature. Create and … CI/CD and automation tools. Experience using Git for version control and platforms like Bitbucket for code collaboration. Knowledge of build tools and pipeline configuration (Jenkins) to automate testing and deployment. Strong problem-solving and analytical skills. Presentation and teamwork skills. Understanding of both Waterfall and Agile methodologies. More ❯

delighted to be supporting a well-known business in Manchester on an exclusive basis. We're searching for a Solutions Architect with a Data background, that wants to be part of an exciting transformation journey. Solution Architect duties: Gaining in-depth knowledge of existing business legacy systems and … systems with built-in security to comply with regulatory requirements and company standards. Assessing and prioritising business needs and new requirements within the data architecture strategy to support evolving reporting and analytics. Driving innovation by leading solution development and facilitating technical workshops to align on architecture and design. … Defining and managing relationships between data sources while overseeing the impact of future or proposed changes. As a Solutions Architect you will have: 7+ years of experience migrating systems and data platforms from on-premises data centres to public cloud environments (Azure preferred but More ❯

Matillion is The Data Productivity Cloud. We are on a mission to power the data productivity of our customers and the world, by helping teams get data business ready, faster. Our technology allows customers to load, transform, sync and orchestrate their data. We are … a dent in the universe bigger than ourselves. About the role At Matillion, we’re redefining what’s possible in the world of data engineering by embedding cutting-edge AI into every layer of our platform. Our Data Science team—part of the Product organisation—is … AI systems that power the Data Productivity Cloud . From boosting the accuracy of our natural language interface to enabling AI-driven pipeline creation, your work will directly empower data engineers to process the most complex and unstructured data with ease. If you More ❯

Matillion is The Data Productivity Cloud. We are on a mission to power the data productivity of our customers and the world, by helping teams get data business ready, faster. Our technology allows customers to load, transform, sync and orchestrate their data. We are … a dent in the universe bigger than ourselves. About the role At Matillion, we're redefining what's possible in the world of data engineering by embedding cutting-edge AI into every layer of our platform. Our Data Science team-part of the Product organisation-is … AI systems that power the Data Productivity Cloud . From boosting the accuracy of our natural language interface to enabling AI-driven pipeline creation, your work will directly empower data engineers to process the most complex and unstructured data with ease. If you More ❯

Principal Data Engineer/Architect (Python) Remote UK to £120k Are you a data centric technologist? You could be progressing your career in a senior, hands-on role at a scaling, global technical services company as they look to expand their product offerings with a new … SaaS data analytics platform. As a Principal Data Engineer/Architect you will head up the engineering for the new platform, building the PoC product from the ground up and in time creating a team around you. You'll be responsible for the architecture and design … building a highly scalable SaaS offering that is customer facing and compliant with SOC and ISO27001 standards. The application will ingest customer data from multiple sources and aggregate, manipulate, model and build calculations and transformations based on the customers' analytical requirements and make the information available on a More ❯

Contract Role: Data Specialist - Qlik to Microsoft Fabric Migration Duration: 3-Month Rolling Contract Rate: £Market Rate Location: Liverpool/Hybrid Join a Leading Global Energy Company We're looking for a Data Specialist to drive a key analytics transformation at one of the world's … leading energy giants. If you've migrated from Qlik to Microsoft Fabric and have a solid data engineering background - we want to hear from you. What You'll Be Doing: Leading the migration of critical reporting assets from Qlik to Microsoft Fabric (Power BI, Data Factory … etc.) Building scalable, secure, and high-performance data pipelines Collaborating with business and technical teams to modernize reporting and analytics Ensuring best practices in data governance and architecture What You Bring: Proven hands-on experience migrating Qlik to Microsoft Fabric Strong background in data More ❯

a year-round opportunity to engage with content and communities they are most passionate about. The Position: FanDuel Sports Network is seeking a Data Analyst to join our team to help drive company performance through data-driven insights. Reporting to the VP, Business and Subscription Analytics … responsibilities for this role include coding in SQL, leveraging data engineering best practices and building self-serve PowerBI dashboards for both internal and external users to better understand subscriber, viewer and fan experiences across various sports. This role will enable the company and its partners to make more … to extract and analyze large datasets in Microsoft Fabric and other database applications Create PowerBI dashboards given a set of requirements Work with data engineering teams to optimize data pipelines Clean and maintain precise data Document and catalog various queries and metrics to centralize More ❯

ML Engineering Leader , where you’ll be at the forefront of AI-driven product development, building a skilled team, and driving the ML | Data Science | AI vision for the business. What You'll Do: Develop and lead the ML Engineering | AI strategy as the company looks to drive … with software engineers, product managers, and business teams to define ML-driven solutions. Stay up-to-date with advancements in ML, AI, and data engineering best practices. Drive best practices in model explainability, bias mitigation, and ethical AI principles. What We’re Looking For: 5+ years of experience … containerisation (Docker, Kubernetes). Experience gained in Tech for Good, eCommerce and/or Marketplaces is preferred. Expertise in ML lifecycle management, including data pipelines, feature engineering, and model serving. Knowledge of MLOps practices, including versioning, monitoring, and automation. Familiarity with big data technologies (Spark, Hadoop More ❯