7 of 7 Change Data Capture Jobs in London

truth for cross-team BI, regulatory reporting, and historical trend analysis). - Orchestration: Kubernetes (EKS), Terraform, Ansible and on-prem. - Data Pipelines: Kafka, CDC (Change Data Capture) tools like Debezium. Key Responsibilities - Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between … PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). - Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. - Schema Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats ...

Palantir Solution Architect (Manager) Lead Data Solutions at Scale Location: Flexible/Hybrid Are you an experienced Palantir Solution Architect (Manager) looking for your next challenge? Our client, a leading organisation in the data and digital space, is seeking a highly skilled Palantir Solution Architect (Manager) to join … their growing team. This is a fantastic opportunity for a Palantir Solution Architect (Manager) to work on complex, high-impact data platforms while leading talented agile teams. As a Palantir Solution Architect (Manager) , you will play a critical role in shaping modern data solutions, driving technical excellence ...

networking, security, environments) Build and maintain CI/CD pipelines and DevOps frameworks Support migration of enterprise databases into AWS using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards … Solid programming skills in Python and SQL Experience supporting or working with data platforms and ingestion pipelines Experience with data migration and CDC approaches Strong communication and stakeholder engagement skills Priyanka Sharma Senior Delivery Consultant Office: 02033759240 Email: psharma@vallumassociates.com ...

GenAI Data Engineer Location: London/Edinburgh - (Hybrid - 2 days per week in the office) Day Rate: Market rate (Inside IR35) Duration: 6 months The Role We are seeking a highly skilled GenAI Data Engineer to join a forward-thinking team delivering advanced data and AI solutions. … distributed data processing (ETL/ELT pipelines) Advanced SQL expertise, including schema design (star/snowflake), indexing and optimisation techniques Proven experience implementing CDC and SCD (Type 1/2/3) in data warehousing environments Advanced Python skills for data engineering, automation and AI/ ...

conventions) Lead platform engineering and infrastructure delivery (IaC, networking, security, environment setup) Oversee migration of ~8–10 enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing …/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations, including CDC approaches Strong Python and SQL skills Understanding of data platforms (e.g. Snowflake/CDP) and ingestion pipelines Exposure to AI/ML enablement frameworks (.e.g ...

Role GenAI Data Engineer Your responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune … processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark, and evaluate GenAI/… processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing. Advanced proficiency in Python for data engineering, automation, and ML/ ...