1 to 25 of 1,202 Data Pipeline Jobs in the UK

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data … our cutting-edge Azure Databricks platform focused on economic data. This platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

Responsibilities: Implement data quality, security and governance policies and procedures to ensure data integrity and compliance. Manage data pipeline projects, including version control, code review, testing, and deployment. Design and maintain our Data LakeHouse and other repositories. Implement data … structures and associated business rules/procedures. Data warehousing and data quality concepts and best practices. Optimise data pipeline performance, scalability, and security. Document data pipeline design, architecture, metadata, and map data flows. Identifying and fixing data … modelling, data warehousing and data quality concept and best practices. Experience in using Azure DevOps or data pipeline project management. Strong analytical and problem-solving skills, with the ability to make sound decisions under pressure. Desirable Skills ITIL Experience in UK Insurance More ❯

Description Data System Reliability Engineer (dSRE) Role Overview: A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP … data footprint expands rapidly. Accountabilities: Automate data tasks on GCP Work with data domain owners, data scientists and other stakeholders to ensure that data is consumed effectively on GCP Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP Measure and monitor the quality of data on GCP data platforms Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to More ❯

as core platform features, ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements, making Workato the … classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into Workato’s data services, driving continuous optimization … data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. Educational Background Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related field. An MBA or advanced degree is More ❯

Role: Azure Data Architect. Experience: 10+ years. Location: London. Position: Permanent. Job Responsibilities: Collaborate with various teams/regions in driving data design, identifying architectural risks, and developing and refining data models and architecture frameworks. Technical experience and knowledge in Cloud Data Warehousing, data migration, and data transformation. Develop and test ETL components to high standards of data quality and performance as a hands-on development lead. Familiarity with Data Lakes, Data Warehouses, MDM, BI, Dashboards, AI, and ML. Design … data architecture patterns and ecosystems including data stores (operational systems, data lakes, data warehouses, data marts, Cosmos DB), ingress patterns (API, streaming, ETL/ELT), and egress patterns (analytics/decision tools, BI tools). Lead, consult, or oversee multiple More ❯

more exclusive features. Direct message the job poster from Tata Consultancy Services Recruiter - Leadership & Strategic Hiring UK&I at Tata Consultancy Services Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently and securely stored, organized, and accessible across the enterprise. Build the foundation … for databases, data warehouses, data lakes, and other data storage solutions, ensuring they meet both business and technical requirements. Key responsibilities: Develop and design the data architecture framework for the organization. Create models for databases, data warehouses, data More ❯

As a Business Systems Data Architect, you will collaborate closely with the Regulatory team to drive the architectural vision for regulatory data and its consumption and usage. This role requires a deep understanding of modern data architectures, cloud technologies, and knowledge of AI/… ML frameworks. You will play a critical role in shaping and overseeing the Regulatory data architecture utilizing existing cloud data technologies, data pipelines, the management of structured, semi-structured, and unstructured data and data quality which is critical to the … you to find the optimal balance between remote and in-office work. In this role you will Provide oversight and advice to Architects, Data Subject Matter Experts (SMEs), and Data Engineers who are designing and implementing data capabilities, integration solutions, and data More ❯

as core platform features, ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements, making Workato the … classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into Workato’s data services, driving continuous optimization … data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. Educational Background Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related field. An MBA or advanced degree is More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

as core platform features , ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements , making Workato the … classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into Workato’s data services, driving continuous optimization … data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. Educational Background Bachelor’s Degree in Computer Science, Engineering, Data Science , or a related field. An MBA or advanced degree is More ❯

as core platform features, ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements, making Workato the … classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into Workato’s data services, driving continuous optimization … data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. Educational Background Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related field. An MBA or advanced degree is More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we’re investing in our central data teams. We’re now recruiting a Principal Data Engineer to join our More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we’re investing in our central data teams. We’re now recruiting a Principal Data Engineer to join our More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

data analytics, and competitive insights to inform product decisions. Experience analyzing large-scale data platforms to optimize usage trends and pipeline performance. RESPONSIBILITIES Develop and execute the product strategy for a unified data orchestration platform supporting ETL, ELT, and Reverse ETL (data … as core platform features, ensuring enterprises have built-in compliance and data integrity controls. Develop native observability and automation tools to monitor pipeline performance, detect anomalies, and proactively enforce data governance policies. Ensure the platform meets enterprise security, compliance, and scalability requirements, making it the … classification, transformation recommendations, and self-healing pipelines that minimize operational overhead. Integrate predictive analytics and semantic enrichment to automate data mapping, improve pipeline efficiency, and surface actionable insights. Work with AI research teams to infuse machine learning into data services, driving continuous optimization and smarter More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team … and PNE, ensuring alignment with global data models, governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering … data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise More ❯