1 to 6 of 6 Data Engineering Jobs in West London

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to derive valuable … insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to the Azure Cloud … a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate with diverse departments more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks Lakehouse Platform … working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain data integrity, security, and compliance … with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve as a Databricks SME, sharing knowledge more »

Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and Data Engineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with Data Engineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »

will have acquired special expertise in Transformers, be experienced with API wrappers like LangChain and Auto-GPT, have experience in evaluating LLMs and prompt engineering, semantic search, MLOps, and embedding-based fine tuning of NLP models such as those in Sentence Transformers. You will need: MSc/PhD and … and Large Language Models, eg. GPT-4, Claude, Huggingface, LLaMA, LangChain, LlamaIndex, Pinecone Proven track record of contributions to large AI domain software and data engineering projects relevant to the life sciences, ideally in drug discovery, preferably in a biotech start-up environment Good knowledge of cloud computing … strong leadership and listening skills Knowledge in several of the following will be advantageous: AI/ML approaches to problems in the Life Sciences Engineering and data solutions to support bioinformatic workflow design and development, with a focus on ML/AI applications An understanding of data more »

will have acquired special expertise in Transformers, be experienced with API wrappers like LangChain and Auto-GPT, have experience in evaluating LLMs and prompt engineering, semantic search, and embedding-based fine tuning of NLP models such as those in Sentence Transformers. You will need: MSc/PhD in AI … and Large Language Models, eg. GPT-4, Claude, Huggingface, LLaMA, LangChain, LlamaIndex, Pinecone Proven track record of contributions to large AI domain software and data engineering projects relevant to the life sciences, ideally in drug discovery, preferably in a biotech start-up environment Good knowledge of cloud computing … essential with a preference for AWS Knowledge in several of the following will be advantageous: AI/ML approaches to problems in Life Sciences Engineering and data solutions to support bioinformatic workflow design and development, with a focus on ML/AI applications An understanding of data more »