1 to 25 of 171 Data Lake Jobs in the UK

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

Due to recent and continued expansion an exciting opportunity has arisen at NPIC (National Pathology Imaging Cooperative) based at LTHT for a Data Engineer. The candidate will work closely with the NPIC Senior Data Engineer to ensure that data architecture is effectively implemented, maintained … developed - liaising closely with clinical, technical and system development staff and system suppliers. The role is crucial for undertaking world leading research, enabling data and AI scientists to create new insights from digital pathology data. NPIC works collaboratively with Hospital Trusts, Universities and commercial companies ranging from spinouts … pipelines Develop solutions for data acquisition Design, develop and maintain data acquisition API for central data Lake Ensure architecture supports business requirements Develop dataset processes for data modelling, mining, and production Drive the collection of new data more »

Head of Data/Azure Data Architect Chandlers Ford - £100,000+ plus bonus + excellent package An excellent opportunity for an established Head of Data/Azure Data Architect to join a Global group of companies who are a market-leading provider … a proven ability to deliver strategic data solutions that drive business value. Specific experience with Azure Synapse Analytics, Azure Data Lake, and Azure Databricks for large-scale data processing and analytics. Technical Proficiency: Extensive experience with cloud-based data platforms, particularly … in Microsoft Azure. Proficiency in using Azure SQL Database, Azure Data Factory for ETL processes, Azure Data Lake Storage for scalable data storage, and Azure Stream Analytics for real-time analytics. Familiarity with Azure Purview for data governance and compliance, as more »

brand falls under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Corporation. Are you passionate about technology that enables the use of data to gain insights, improve customer experience, and drive revenue? With over 180 Million highly engaged customers in 109 countries, Sony Interactive Entertainment (SIE) is … integration, data quality, multi-dimensional design and ETL tools, processes and methodology. Experience of designing and implementing Data Lake solutions. Experience of corporate data governance and compliance including GDPR and data protection/privacy rules. Experience of working with … Initio (hosted on AWS) & Databricks (SaaS). Data Streaming: Kafka and Flink. Data Warehouse: Snowflake (SaaS). Data Lake: AWS Lakeformation, Glue and some customised components. Reporting Platforms: MicroStrategy, Domo, Imply and Tableau. Web Analytics & Telemetry: Adobe Experience Platform. Data Science more »

Leading Transportation organisation are seeking to hire a Head of Data & Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole … purpose of providing excellent service to customers. Outside of Data Engineering you will fulfil a broad remit across, Data Architecture, Security and Data Quality Management Client Details Leading Transportation organisation Description Leading Transportation organisation are seeking to hire a Head of Data & Data Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole purpose of providing excellent service to customers. Outside more »

Leading Transportation organisation are seeking to hire a Head of Data & Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole … purpose of providing excellent service to customers. Outside of Data Engineering you will fulfil a broad remit across, Data Architecture, Security and Data Quality Management Client Details Leading Transportation organisation Description Leading Transportation organisation are seeking to hire a Head of Data & Data Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole purpose of providing excellent service to customers. Outside more »

Global Data Platform Design Lead Our Client is seeking a Global Data Platform Desing Lead to join their team as they embark on an ambitious data strategy programme of work to uplift the data capabilities so they can respond simply and quickly … to the needs of their customers. The programme aims to improve how and when their people use data, so it informs and shapes their thinking and enables meaningful conversation and decisions, effecting cultural change that enables them to be both "data-fit" and "data … organisation Data Platform Design including the design of automation, high availability, business continuity and service management. Accountable for enhancing data lake and data warehouse architecture with a strong emphasis on data security, quality and automation. Accountable for designing and implementing automated more »

IT industry (prefer experience in Banking & Financial Services sector Key skills: Databases (RDBMS, No SQL, open source, proprietary), SQL expertise, StreamSets, Kafka, Big Data Hadoop, Spark, Python, Data on Cloud, Test Management tools (Octane), JIRA - Project experience in building Data solutions, experience in utilizing … and feeding data from data lake. - Engineering experience in projects building data patterns around data sourcing , data controls, data on cloud, Data privacy, data accessibility, data lineage, meta data management … public, private) that will require defining new or utilizing existing design patterns. - Experience in integrating applications data with enterprise data lake using Streamsets and Kafka, batch mode for bulk loading and bulk data consumption - Experience in using data from multiple sources more »

Data Architect required by a market leading, award winning, financial services organisation who have 9 UK sites. This will be remote role with 1-2 days a month onsite at one of our clients sites. An exciting opportunity has arisen for a skilled and motivated Data … winning team within a leading financial services organisation. This role offers the chance to make a significant impact by designing and managing the data architecture that supports the business's digital transformation efforts. The Data Architect will play a key role in shaping the company's … data strategy and driving innovative data solutions across multiple business areas. The role offers a blend of business strategy, technical expertise, and creative problem-solving. Key Responsibilities: Lead data initiatives for a business digital transformation program, ensuring seamless data integration and usage more »

Our Future Health is looking for a Data Architect with experience of large data architectures who relishes the opportunity to bring their expertise to the world's largest health research programme. The successful Data Architect will challenge and support technical teams to think critically … and diseases. So future generations can live in good health for longer. What you'll be doing In this role you will define data architecture for our data, analytics and researcher platforms, setting out at high level what data needs to reside where and … why, and how data is managed from collection to use. Your key responsibilities will also include: Oversee the design of multiple data models at a strategic level and have a broad understanding of how each model fulfils the needs of the organisation. Develop principles that guide more »

Leading Transportation organisation are seeking to hire a Head of Data & Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole … purpose of providing excellent service to customers. Outside of Data Engineering you will fulfil a broad remit across, Data Architecture, Security and Data Quality Management Client Details Leading Transportation organisation Description Leading Transportation organisation are seeking to hire a Head of Data & Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey to self-serve information, providing insight and analysis with the sole purpose of providing excellent service to customers. Outside of Data more »

We are looking for an experienced Data Architect to join our client on a transformational journey. As a key member of their Data Architect team, you will play a pivotal role in translating business needs into robust data architecture solutions. Your expertise will drive … the design, development, and optimisation of data models, ensuring data quality, governance, and security across the systems. Key Responsibilities: Design and Development: Create conceptual and logical data models to support business, data, and technical requirements. Develop data flows, automate processes … analyst/modeler, including complex enterprise and dimensional data modelling. Proven experience in a data warehouse, data lake, or operational data store environment. Expertise with major data modelling tools (e.g., SQL Database Modeller, MySQL Workbench, PowerBI). In more »

We are looking for an experienced Data Architect to join our client on a transformational journey. As a key member of their Data Architect team, you will play a pivotal role in translating business needs into robust data architecture solutions. Your expertise will drive … the design, development, and optimisation of data models, ensuring data quality, governance, and security across the systems. Key Responsibilities: Design and Development: Create conceptual and logical data models to support business, data, and technical requirements. Develop data flows, automate processes … analyst/modeler, including complex enterprise and dimensional data modelling. Proven experience in a data warehouse, data lake, or operational data store environment. Expertise with major data modelling tools (e.g., SQL Database Modeller, MySQL Workbench, PowerBI). In more »

Databricks Data Engineer X5 £55-95K - (Depending on experience) + Permanent Benefits + Bonus UK Wide - Flexible working This position would require you to undergo SC CLEARANCE, so you must be eligible. (BRITISH/ILR) A leading IT consultancy is looking to recruit 5X Databricks Data … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. Knowledge of SQL and scripting languages like Python or Scala and hands-on experience with AI more »

daily towards creating the world we want tomorrow. Job Description: Senior Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data more »

Head of Data Management (Data Governance Data Office Programme Manager Buy Side Buy-Side Trading Applications Front Office Risk Regulation Data Governance Management Compliance Regulatory Reporting DORA Data Mesh Technology Soladata Equity Equities FX Fixed Income Commodities Agile Derivatives Finance … Management Hedge Fund) required by our financial trading technology client in London. You MUST have the following: Strong experience as a Head of Data Management/Data Governance/Data Office An excellent background in data governance and data management … to help you deliver this and report into the head of data. The department is also moving from a cloud based data lake to a data mesh architecture. Any experience of this migration would be beneficial but is not essential. Likewise, the team are working more »

Data Engineer Glasgow - hybrid Up to £55,000 + bonus Head Resourcing are pleased to be working with one of Scotland's biggest success stories as they look to hire a Data Engineer. In this role you will work collaboratively with other data engineers … analysts, software engineers, and product managers to leverage data in order to meet business goals. To be successful in this role you will need expert level SQL knowledge, have a strong understanding of data wrangling and have experience with data pipelines - ingesting, validating, cleansing … , and approaches to data encryption Nice to have but not essential: * Experience working with modern PaaS offerings, Data Lake, and Data Lake House approaches * Knowledge of data science or machine learning techniques and approaches This is an exciting more »

Be-IT are working with a well-known Scottish organization to recruit a Data Engineer on a full-time, permanent basis. This role offers hybrid working, and is based in Glasgow. You will be responsible for creating an accurate, consistent and available record of key business information - mastered … data. You will have expert SQL knowledge, be well-versed in data wrangling and have experience with data pipelines – ingesting, validating, cleansing, modelling, and storing data from multiple sources. You will also have an appreciation of a modern DataOps mindset, including resiliency, scalability and … of data science or machine learning techniques is beneficial. Familiarity with modern PaaS platforms, Data Lakes, and Data Lake House architectures is advantageous. Comfort with other programming languages (e.g., Python) is a bonus. The details: Permanent role based in Glasgow Hybrid working: twice more »

leverage our expertise, experience and IP to help our customers achieve their business value through technology solutions. The Solution Architect (SA) – GCP and Data is a Presales professional, responsible for solution development in support of Google Cloud, Data Modernization and Artificial Intelligence engagements in collaboration with … and advocate for addressing non-functional requirements such as usability, reliability, performance, supportability, and security. Design and architect scalable, secure, and cost-effective data solutions using GCP services such as BigQuery, Dataflow, Dataproc, Dataprep, Composer, Data Fusion, Data Studio, Cloud SQL, Cloud Functions and … Cloud Storage. Leverage AI and machine learning technologies, such as TensorFlow, Vertex AI, and AutoML, to enhance data insights and drive business value. Ensure Delivery team requirements are communicated and that IT/Facilities requirements are collected. Implement data modernization initiatives, including data migration more »

Senior Data Technology Consultant Position Description Challenge yourself, change lives and help shape the UK's digital revolution. We look to our Business Consultants, to drive change, inspire trust with clients, and take responsibility for some of the world's most ambitious transformation projects. As a Senior Data … of consulting colleagues, will take a central role in providing support to our clients with a focus on driving their business outcomes using data and technology. You will also support the growth of the wider evolving business consulting function. A key focus of the role will be to … presenting technical concepts in simple, accessible language. • Leverage your deep understanding of legacy and cloud-based data technologies, including Data Lake, Data Warehouse, and Lakehouse concepts. • Bring broad technical knowledge of Azure data products, with subject matter expertise in areas like more »

My client, a leading sports tech business is looking for a Data Architect Job Duties: * Design & Strategy: Architect cutting-edge, scalable data solutions using AWS services, ensuring peak performance and reliability. * Data Management: Masterfully manage data storage, retrieval, and processing across AWS … S3, Redshift, and other AWS tools. * Innovation: Lead the charge in integrating the latest AWS technologies and best practices into our data architecture. * Leadership: Inspire and mentor a team of top-tier data engineers, fostering a culture of relentless improvement and collaboration. * Optimization: Continuously refine data … warehousing and analytics AWS Lambda: Serverless computing for ETL processes AWS Glue: Data integration AWS RDS: Managed relational databases AWS Lake Formation: Data lake management and governance Python/SQL: Programming for data processing and querying Amazon Kinesis: Real-time more »

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: £65,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This … full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive … pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product more »

up our clients' potential, thereby fulfilling our own. Take it seriously. Make it fun. Know it matters. As we develop an enterprise-wide data and digital strategy that moves us toward greater focus on the use of data and data-driven insights, we are … seeking a Data & Digital Solutions Architect. The Data & Digital Solutions Architect is a hands-on, execution-focused role helping translate the data and digital strategy to architecture and to execution. In this role, you will have an understanding of our data and … and experience working within a data driven organization Hands-on experience with architecting, implementing, and performance tuning of: Data Lake technologies (e.g. Delta Lake, Parquet, Spark, Databricks) API & Microservices Message queues, streaming technologies, and event driven architecture NoSQL databases and query languages Data more »

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Key Responsibilities: Design and Develop Data Architecture: Create, optimise, and maintain conceptual, logical, and physical data models to support the enterprise data strategy. Data Strategy and Governance: Define and implement data management strategies, including data governance, metadata management, and data quality controls. Database and Cloud Technologies: Select appropriate database solutions (SQL, NoSQL, Data Lakes) and cloud platforms (AWS, Azure, Google Cloud) to support the … organisation's data infrastructure. Data Integration: Develop and manage ETL (Extract, Transform, Load) processes to ensure data from multiple sources is properly integrated into centralized systems. Collaboration and Communication: Work closely with business stakeholders, data analysts, data engineers, and clients more »

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Key Responsibilities: Design and Develop Data Architecture: Create, optimise, and maintain conceptual, logical, and physical data models to support the enterprise data strategy. Data Strategy and Governance: Define and implement data management strategies, including data governance, metadata management, and data quality controls. Database and Cloud Technologies: Select appropriate database solutions (SQL, NoSQL, Data Lakes) and cloud platforms (AWS, Azure, Google Cloud) to support the … organisation's data infrastructure. Data Integration: Develop and manage ETL (Extract, Transform, Load) processes to ensure data from multiple sources is properly integrated into centralized systems. Collaboration and Communication: Work closely with business stakeholders, data analysts, data engineers, and clients more »