1 to 4 of 4 Permanent Data Pipeline Jobs in West London with Remote Work Options

SIEM environment, utilizing OpenSearch. The SIEM Onboarding Engineer will work closely with business units to identify devices for onboarding, manage the data pipeline, and assist other engineers in configuring their data sources to provide a resilient pipeline.The SIEM Onboarding Engineer will approach each system to … to identify devices and data sources that need to be onboarded to our SIEM (OpenSearch with Security Analytics). Data Pipeline Management: Configure and manage data collection agents to ensure data is reliably ingested into the SIEM. Automation: Leverage automation scripts … with security engineers and other stakeholders to ensure seamless integration and optimal performance of the SIEM. Monitoring and Troubleshooting: Monitor the data pipeline for issues, troubleshoot problems, and implement fixes to maintain data integrity and system reliability. Documentation: Maintain comprehensive documentation on the onboarding processes more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to … derive valuable insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to … Cloud, a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate more »

Senior Data Engineer (GCP, Time-Series Data Sets) Salary: £65,000 - £75,000 - Great Benefits package Location: Cardiff - Hybrid - 10% (2 days on-site per month)/90% remote Unfortunately, we're unable to progress applicants requiring sponsorship The Role This is a great opportunity to … in creating innovative energy and utilities technology to support the construction industry in building zero carbon accommodation. We're looking for a Senior Data Engineer with extensive GCP experience and a passion for Time-Series Data Sets. Essential T echnical Skills GCP - Preferably BigQuery, Postgres, GCS … and DataFlow building out full data systems Advanced knowledge of data transformation GCP network and security infrastructure Development with GCP IaC using Terraform DevOps software delivery CI/CD processes, ideally on GitLab Extensive hands-on experience with Python & SQL ETL tools Awareness of integrating/ more »

Python Data Engineer Location: 2 days WFH/3 days in London Salary: Circa 50K 60K + Bonus + Benefits Python Data Engineer required by fast-growing asset management firm where youll be able to use your Python expertise to drive data-driven decisions … This is a varied, challenging role focusing on building reliable data pipelines and working with large datasets Essential: At least 2yrs Python programming experience and cloud architecture Experience working with large datasets and data pipelines Knowledge of data modelling, data warehousing, and … ETL processes Familiar with Linux, Git & SQL Nice-to-have: GCP Machine learning and/or data science Tremendous opportunity offering plenty of scope for career progression in a friendly, collaborative environment where youll be able to bring ideas and keep up-to-date with the latest technologies more »