1 to 25 of 37 Change Data Capture Jobs in London

memory (Redis), time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage … programme scale Comfortable working hands‐on – writing dbt models, reviewing SQL, profiling queries – while operating at senior stakeholder and architecture level Experience with CDC‐based real‐time data pipelines and event‐driven data integration patterns Strong communicator able to convey complex data architecture decisions to both engineering ...

team Compensation: OTE £90,000 Location: Hybrid/client-site as required Technology environment: AWS, Databricks, Lakehouse architecture, complex relational databases, ETL/CDC pipelines About Transform Together Transform Together is a digital transformation consultancy helping organisations deliver business and technology change. We work with clients to bridge … data quality dashboards, exception reporting and data health metrics. Ensure validation outputs can support audit, regulatory assurance and operational sign-off. ETL, CDC and Engineering Collaboration Work with Data Engineers to define ingestion requirements from complex relational databases, operational platforms and structured client files. Produce clear source ...

middleware technologies . Design ETL, data migration, orchestration and synchronisation solutions, ensuring data quality, integrity and Change Data Capture (CDC). Implement secure integration patterns using OAuth 2.0, JWT, SAML, Connected Apps and Named Credentials , aligned with enterprise security, GDPR and data governance requirements. … capabilities. Strong understanding of enterprise data integration, relational databases, data modelling, ETL, data migration and Change Data Capture (CDC) . Experience working with Agentforce and Agentic AI solutions , combined with strong communication, collaboration and stakeholder management skills. If you are interested or would like ...

more than 38,000 trials and 12 million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million registered users across approximately 2,300 customers trust Medidata's seamless, end-to-end platform … refactoring, and performance tuning. Technical Strategy & Database Optimization: Promote technical direction and engineering best practices across teams for Change Data Capture (CDC), clustering, data migration, and aggregation. Use AI query-optimization tools to analyse execution plans, auto-tune complex Snowflake/Iceberg SQL workloads, and eliminate ...

more than 38,000 trials and 12 million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million registered users across approximately 2,300 customers trust Medidata's seamless, end-to-end platform … generation, refactoring, and performance tuning.Technical Strategy & Database Optimization: Promote technical direction and engineering best practices across teams for Change Data Capture (CDC), clustering, data migration, and aggregation. Use AI query-optimization tools to analyse execution plans, auto-tune complex Snowflake/Iceberg SQL workloads, and eliminate ...

Director of Data and AI Department: Platform Employment Type: Permanent Location: London Description We’re seeking a strategic Director of Data and AI to lead, develop, and empower our Data and AI teams. This role balances leadership with technical excellence; you’ll define how data, analytics … machine learning, and generative AI enable the wider business. You’ll work closely with senior stakeholders, translating business objectives into a clear Data and AI strategy, and ensuring the team delivers scalable, trusted, secure, and commercially impactful solutions. The ultimate goal will be to establish Data ...

Group:Trading JobsWorker Type:RegularPosting Start Date:September 1, 2026Business Unit:Trading and SupplyExperience Level: Experienced ProfessionalsJob Description: What’s the roleAs a Lead Data Product Manager, within the Shell Energy Chief Data Office (CDO) organisation, you will own the business-led data product strategy, acquisition design … adoption outcomes that engineering teams can execute.Strong product and technical judgement across modern data platforms, ingestion patterns, APIs, streaming/batch, schema management, CDC, metadata, lineage and data quality, with the ability to assess what good looks like.Experience leading cross-functional product delivery through Product Owners, architects, engineers ...

opportunity We are investing in the next generation of our data and technology capabilities to create more connected, intelligent experiences for customers. Data is central to this ambition. This is an opportunity to define the architecture, standards and delivery patterns for a modern data platform that will … customer data. Strong data-modelling expertise across conceptual, logical, physical, dimensional and canonical models. Experience with batch and real-time integration, including APIs, CDC, streaming or event-driven pipelines. A strong data-engineering or software-development foundation using Python, SQL, Scala, Java and/or Spark. Deep experience ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start and end times … and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

# Senior Data Architect - London, UK - FulltimeLondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 522521-en\_GB**About the Job you are considering:**Join Capgemini’s **Integration & Data (I&D)** practice, where we **Consult with Purpose, Continuously Evolve, and Architect Tomorrow**. As a **Data Architect … will play a strategic role in shaping and delivering enterprise data architectures for our Financial Services clients. You will lead the design of scalable, secure, and cloud-enabled data platforms that empower organisations to harness data as a critical business asset.**Hybrid working:**The places that ...

will be an embedded technical expert within the Cloud Engineering & FinOps team, working alongside fellow FinOps engineers to build, maintain, and continuously improve the data and AI/ML capabilities that power CBRE's cloud cost management practice. You bring deep, hands‐on expertise in data engineering … principal-level individual contributor. You are a highly skilled practitioner who goes deep on the most technically complex problems: designing high-quality data pipelines, developing and tuning AI/ML models, optimizing database performance, and translating raw multi‐cloud billing data into reliable, actionable intelligence. You collaborate closely ...

DescriptionState Street Global Alpha Data Platform , lets you load, enrich and aggregate investment data. Clients’ will be able to manage multi-asset class data from any service provider or data vendor for a more holistic and integrated view of their holdings. This platform reflects State Street … years of experience servicing complex instruments for our global client base and our investments in building advanced data management technologies. Responsibilities include:Provide analysis and input into designs of Alpha Data Services platform to support a rapidly-growing business on a massive scale. Provide data solutions ...

About Squid AI and data centres are booming, electrification is accelerating, and trillions in generation, storage, and connection projects are queued - but the real bottleneck is the grid. Grid planning and operations are becoming a national-scale systems problem: complex network models, messy legacy data, strict governance, overloaded … decisions that affect real infrastructure. Squid is building the agentic modelling platform for power grids: a versioned, auditable source of truth where network models, data, changes, assumptions, and decisions can be tracked – and where humans and AI agents can safely work together. We unify legacy planning models, operational data ...

Vilkinsons, formerly CEO of Soho Strategy. About the role A large part of HASH's utility is its ability to integrate structured data from a wide-range of external applications into a single, unified knowledge and process graph. Each SaaS applications, communication tools, internal service or specialized enterprise system … both widely used services and customer-specific systems straightforward to connect to HASH. This includes understanding each source in detail, retrieving and synchronizing its data reliably, and mapping its native concepts into common semantic schemas that remain useful beyond a single integration. While some services provide excellent public APIs ...

Drive the future of analytics and data intelligence by designing architectures that turn raw data into actionable insights at scale. As a Senior Analytics Solutions Architect, you'll partner with customers to architect end-to-end analytics platforms from data lakes and lakehouses to real-time streaming … Concept — build prototypes demonstrating query performance, cost optimisation, and scalability for customer-specific analytics workloadsCreate reference architectures — develop reusable blueprints for streaming ingestion, CDC pipelines, data mesh, and governed data sharing patternsAdvise enterprise customers — translate BI, reporting, and advanced analytics requirements into scalable, cost-effective technical designsInfluence ...

London/Hybrid £60,900 per annum 12-month Fixed Term Contract We are recruiting a Microsoft Fabric Engineer to join a major data platform transformation programme within a large, complex organisation. This is a hands‐on engineering role where you will help design, build and operate … enterprise data platform based on Microsoft Fabric, creating the foundations for reporting, analytics and AI‐driven services. The role Design, build and operate solutions across Microsoft Fabric, OneLake, Lakehouse and Warehouse. Develop robust ETL/ELT pipelines using Fabric Data Factory, Dataflows Gen2 and Spark Notebooks. Build ...

Drive the future of analytics and data intelligence by designing architectures that turn raw data into actionable insights at scale. As a Senior Analytics Solutions Architect, you’ll partner with customers to architect end-to-end analytics platforms from data lakes and lakehouses to real-time streaming … concept — build prototypes demonstrating query performance, cost optimisation, and scalability for customer‐specific analytics workloads. Create reference architectures — develop reusable blueprints for streaming ingestion, CDC pipelines, data mesh, and governed data sharing patterns. Advise enterprise customers — translate BI, reporting, and advanced analytics requirements into scalable, cost‐effective technical ...

Lake developmentCluster management, compute policies, autoscaling, and workload monitoringData EngineeringStrong Python, PySpark, and SQL development skillsDesign and build ingestion and transformation pipelinesFull and incremental data loadingCDC (Change Data Capture) implementationData quality controls, schema evolution, reconciliation, and error handlingIntegration DevelopmentREST API integration experienceIntegration with databases, SaaS applications … governance and platform standards implementationDiscovery Zone & Migration SupportExperience enabling application deployment within DatabricksBI tooling integration and schedulingSupport for POSIT/RStudio migration activitiesCollaborationWorking with Data Engineers, Data Scientists, and Platform TeamsTechnical documentation and knowledge transferAgile delivery experienceDesirable SkillsPOSIT/RStudio migration experienceAI/ML and LLM integrationRAG ...

Learning We're Atom Learning and our mission is to help every child reach their potential. We combine exceptional teacher-made content with technology, data science and machine learning to make high-quality, personalised education more accessible. Our aim is to give every child access to the kind … apart Experience with BigQuery, Airflow and dbt, or equivalent modern data technologies. Experience with CockroachDB, Postgres or other distributed/relational databases, including CDC or event-driven data pipelines. Knowledge of data visualisation preferably Tableau or Metabase. Experience making data safely self-service through internal tooling ...

Location: Hybrid Division: Engineering Reports to: Chief Architect - Data and Insights ABOUT US Agilisys is at the forefront of digital transformation and innovation in the public services sector. With over two decades of experience, we have established ourselves as a trusted partner for governments, local authorities, and organizations nationwide. … Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency, retry/replay, backfill and source-to-target reconciliation. Own Dev/Test/Production delivery and CI/ ...

rapid expansion of AI and automation, the future of work has never been more challenging for organizations. Beamery’s unique jobs, skills and tasks data platform helps organizations navigate these challenges and make more informed decisions across Talent Lifecycle Management. Our solutions power recruitment, mobility, upskilling, diversity, work architecture … storage (SQL/NoSQL): schema design, modelling at scale, and multi-tenant isolationBack-end engineering: Python (nice to have: Typescript/Node.JS)Pipelines: streaming, CDC, correctness, replayability, and evolution over timeData quality and observability: validation, testing, data contracts, monitoring, alerting, and incident responseInfrastructure as code and containerisation (Terraform, Kubernetes ...

team management responsibilities and offers the opportunity to influence at scale and work across a wide range of stakeholders and technologies Lead Solution Architect - Data & AI Specialist Location: - London - Hybrid 2/3 days per week on-site - Flex working hours Permanent - Full Time Salary: £90,000 + Excellent … data life cycle management, medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) #J-18808-Ljbffr ...

Company Overview EC Markets runs a UK markets business on top of a real engineering estate: trading apps, a CRM, AI services, websites, and data platforms. We move quickly and ship often and our infrastructure has to keep up without breaking things. We're looking for a Platform/… aware (you'll make the calls on things like NAT vs VPC endpoints). Own observability and reliability. CloudWatch alarms and dashboards, SNS alerting, data freshness and quality signals, and automated recovery for the pipelines that need it. When something breaks at 2am, you've already built the thing ...

considering: We are seeking an experienced Teradata Migration Solution Architect to lead large-scale migration and modernization initiatives from Teradata data warehouse platforms to AWS-based cloud ecosystems. In this role, you will define target-state architectures, develop migration strategies, and establish governance frameworks to support enterprise data … Redshift S3 Glue EMR Aurora and Lakehouse platforms Lead migration planning wave management cutover rollback and data validation activities Architect data integration CDC replication and near zero downtime migration approaches Establish data governance security lineage encryption and regulatory compliance controls Drive automation through Terraform CICD DataOps ...

platforms that safeguard the nation's financial system . The Bank of England, in partnership with Inspire People, is seeking a Lead Solution Architect - Data Analytics with strong enterprise and solution architecture experience, deep knowledge of cloud-based data platforms, and a track record of delivering complex data … TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average pension. ...