1 to 3 of 3 Data Pipeline Jobs in West London

SIEM environment, utilizing OpenSearch. The SIEM Onboarding Engineer will work closely with business units to identify devices for onboarding, manage the data pipeline, and assist other engineers in configuring their data sources to provide a resilient pipeline.The SIEM Onboarding Engineer will approach each system to … to identify devices and data sources that need to be onboarded to our SIEM (OpenSearch with Security Analytics). Data Pipeline Management: Configure and manage data collection agents to ensure data is reliably ingested into the SIEM. Automation: Leverage automation scripts … with security engineers and other stakeholders to ensure seamless integration and optimal performance of the SIEM. Monitoring and Troubleshooting: Monitor the data pipeline for issues, troubleshoot problems, and implement fixes to maintain data integrity and system reliability. Documentation: Maintain comprehensive documentation on the onboarding processes more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to … derive valuable insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to … Cloud, a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »