1 to 19 of 19 Contract Data Lake Jobs in the UK

closely with Data Architecture, Data Management, The EDP product owner and the Technology team delivering the EDP. Data Lake Structure and Design: Validate the medallion model data lake structure (bronze, silver, gold) as the optimal approach and recommend alternatives if … needed. Create a Data Lake design including namespace hierarchy, and naming standards. Design to optimise storage and retrieval based on data types, usage patterns, and the emerging Data Domain segregation. Establish policies for moving data between different storage tiers within the … data lake (e.g. hot, warm, cold storage) based on access frequency and cost considerations. Establish policies for data integrity, consistency, conformance, and accuracy when transforming data from Bronze to Silver, and Silver to Bronze. Develop a Data Modelling Design, including a more »

Data Engineer £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Data Engineer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards … hybrid data warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards … hybrid data warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their … team and be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data … role 3+ years GCP experience Data Ingestion & Transformation BigQuery experience advantageous but not essential. Extensive experience with SQL and Data Lake/Warehouse solutions Strong proficiency in languages such as SQL, Python, Java or Scala In-depth knowledge of query optimization techniques and experience in more »

Data and Analytics Developer Overview We are seeking a highly skilled Data and Analytics Developer with extensive experience in ETL/ELT, data warehousing/business intelligence methodologies, and best practices. The ideal candidate will have a strong background in handling big data … hybrid data warehouse design principles. Utilize cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Databricks and PySpark Development Develop in Databricks with experience coding in PySpark and Spark SQL. Ensure ETL code is … hybrid data warehouse design. Proficient in using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Experienced in developing with Databricks and coding in PySpark and Spark SQL. Thorough understanding of coding standards for ETL more »

Senior Azure Data Engineer/Developer - 12 months - INSIDE IR35. Senior Azure Data Engineer/Developer required for a 12 months contract. You will be office based in South East London 2x days per week. The rest remote. Experienced in Data and Analytics solution … design and implementation using Agile, working to deliver complex data and BI products. Detailed knowledge of ETL, data warehousing, data modelling and experience dealing with big data is expected. Skills. Experince of ETL/ELT, data warehousing/business intelligence … Kimball & Inmon and hybrid data warehouse design. Cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data … data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. Participate in code reviews and provide constructive feedback to peers. Required Skills and Experience more »

We are looking for a Senior Data & Analytics Developer to work within the transport sector. Location: Hybrid working - London About the role : You will be responsible for working with others as necessary within the project including the Development Stream Lead, Solution/Data Architects, Product Owners … an optimal solution which meets requirements, adheres to technical standards and strategy constraints. Essential Skills: The ideal candidates will have a proven Senior Data & Analytics Development background, with the following skills/experience: Knowledge of ETL/ELT, data warehousing/business intelligence methodologies and best … and hybrid data warehouse design. Knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Knowledge in developing in Databricks and experience in coding with PySpark, Spark SQL. Experience in design and development of complex more »

Our public sector client requires a Senior Data & Analytics Developer to join their team as part of an on-going project on a 12-month contract. You will have the following skills and experience: Knowledge of ETL& ELT, data warehousing/business intelligence methodologies. Experience handling … big data, cloud technology and unstructured data. Star Schema structure & design, Kimball … inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques more »

/2d/w in London Duration: 12 months with possible extension Key Knowledge/Skills Detailed working knowledge of ETL/ELT, data warehousing/business intelligence methodologies and best practice including dealing with big data, cloud technology and unstructured data and the … hybrid data warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code … is standardised, self-documenting and can be reliably tested Knowledge of best practice data encryption techniques and standards Knowledge of relevant national and international legislation pertaining to the Government/Public Sector IT - eg Data Protection Act, EU Procurement Directives and Freedom of Information Act, including more »

DATA ENGINEER Location: Remote Hybrid (1 day per month in London) Job Type: Contract - 6 Months Daily Rate: £(Apply online only) per day INSIDE IR35 Concept Resourcing are currently working with one of the UK's leading IT consultancies. We are seeking an experienced Data Engineer … Key Responsibilities: Architecture, modelling and leadership skills Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data more »

Service for Apps Experience of working with Microsoft Power platform including Azure, Active Directory, Office 365, Sharepoint, SQL Server, Data Lake and Power BI. Experience in integration of data from external systems and on-premises data sources Experience in Application Lifecycle … Tools which automate or assist part of the development process Familiar with Database Software which enables the user to create, populate and manipulate data structures Excellent communication skills at all levels of the organisation including experience of communicating technical information to a non technical audience. Ability to demonstrate more »

Service for Apps Experience of working with Microsoft Power platform including Azure, Active Directory, Office 365, Sharepoint, SQL Server, Data Lake and Power BI. Experience in integration of data from external systems and on-premises data sources Experience in Application Lifecycle … Tools which automate or assist part of the development process Familiar with Database Software which enables the user to create, populate and manipulate data structures Excellent communication skills at all levels of the organisation including experience of communicating technical information to a non technical audience. Ability to demonstrate more »

Service for Apps Experience of working with Microsoft Power platform including Azure, Active Directory, Office 365, SharePoint, SQL Server, Data Lake and Power BI. Experience in integration of data from external systems and on-premises data sources Experience in Application Lifecycle … Tools which automate or assist part of the development process Familiar with Database Software which enables the user to create, populate and manipulate data structures Excellent communication skills at all levels of the organisation including experience of communicating technical information to a non-technical audience. Ability to demonstrate more »

implemented by a Sales focused Cloud Architect with an ability to secure UK eDV security clearance. With Machine Learning techniques, Encryption and Big Data tools, this firm have solved a critical privacy issue that will benefit National Security and Intelligence clients across the world and is equally impactful … for other sectors, allowing private access to Neural Networks and Data sets for knowledge growth. If you are interested in delivering impactful product presentations and able to highlight mission-critical benefits of a software product, you will be highly valued in this role. Youll need to lead during … consultative selling of B2B software Demonstrable experience working with Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine more »

Receivable, Fixed Assets, Chart of Accounts, Tax Rules Strong analytical approach and knowledge of the possibilities in Dynamics AX/365 programming and data structures/database. Proven ability to lead functional teams. Excellent verbal and written English communication skills with the ability to communicate across all levels … Services (LCS), Microsoft Sure step Understanding of SCM Modules and strong understanding of Microsoft Technologies, including Power Apps, Power Automate, Azure Data Lake, Azure DevOps and Power BI. If you are interested please apply via this ad in the first instance or send a CV with covering more »

Your new role You will be working within the business to help to understand and map the non-existent data practice within the company. You will be part of developing and creating the data sets needed for BI and analytics including, where needed, the data … What you'll need to succeed Significant experience in leading a brand-new division within this organisation, supporting the development and maintenance of data repositories, warehouses, data lakes, cloud platforms (such as MS Azure) and modern reporting and business intelligence and visualisation platforms (such as MS … Power BI) Significant experience with building and exploiting data models, statistical or predictive analytics, machine learning or artificial intelligence What you'll get in return 3-month contract, remote based role but will be required to go on site for meetings when required (once or twice a month more »

SR2 are partnered with an established UK based consultancy who are looking for an SC Cleared Azure Data Architect with a background in financial services to come in to support the team on an exciting new project. £(Apply online only) Outside IR35 Hybrid - Occasional travel to London Office … Required Final stage interview will be face to face in London. 6 Month CX with potential extension Requirements: 5+ Years as an Azure Data Architect Must have Active SC Clearance Background in financial services Experience working with Databricks Extensive data modelling knowledge Will have designed data more »