26 to 50 of 215 Data Lake Jobs in the UK

Data Architect/Cloud Data Architect (GCP) Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £100k-£140k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such … as automating manual tasks and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes more »

have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »

Lead Data Engineer - Azure/Python/Power BI My client, a London Market Specialty Insurance company are currently recruiting for a Lead Data Engineer to join their team on a Permanent basis. This is a great opportunity for an experienced Data Engineer to … be an integral part of leading a team of developers and engineers that build and deliver the components of an Azure Data Lake Platform. This opportunity is based in London (Hybrid working) and is paying up to £100,000 per annum Key Skills Required Tools - Data Factory/Data Bricks/Python/PySpark/SQL/Power BI Commercial experience of Kimball/Inmon Datamodelling Knowledge of London Market Insurance is Highly Desirable Experience of Synapse beneficial The processing and use by us of your personal data is in more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits • Up to 10% matched pension scheme with Standard Life • Death in Service: 4 x salary • Annual Car Parking permit • Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills • Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences • Experienced in working Microsoft Cloud Data and Automation technologies • Experienced working with Tableau and or Power BI • Experienced in data more »

specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. … Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Azure cloud solutions. Proficiency in Azure App Services, Azure SQL Database, Azure Kubernetes Service, Azure Active Directory, Azure Blob Storage, Azure data lake, Azure data factory pipelines, Powershell, Terraform, and Kubernetes. Strong collaboration, communication, and problem-solving skills. E: j.bhard@locke-mccloud.com Locke & McCloud are more »

Senior Data Modeler UK - Fully remote £65k - £90k plus Benefits and Bonus TECH STACK: SSAS, SQL, Excel, MDX, PowerBI/Tableau This is an exciting opportunity to join one of the largest media technology brands in the world and lead a major project relating to the development of … their data cubes. ABOUT THE COMPANY This business is a household name in the UK and their products and services are used by millions of people each day. They have recently completed a major migration project to a new cloud data environment and as a result … be responsible for are: Building a variety of SSAS tabular and dimensional cubes Build out Cloud cubes Work on improving current data lake processing activities Work across multiple business stakeholders to ensure that their various requirements are supported by cutting edge technical solutions Document all processes to more »

Data Consultant (Azure) £40,000-£50,000 salary Hybrid (London) Azure, Power BI, Purview, Python, ETLs, Consulting One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out … with an urgent hire for a Data Consultant to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** The ideal candidate will be working on projects using products in within the … MS Data stack, including Power BI, Synapse, Data Lakes, and Fabric. This is a customer-facing role, so you'll be regularly liaising with clients to understand their business needs and offer technical solutions. Essentials: Experience in a consultancy . Experience with Data Quality more »

Here at Vallum, we are looking for a Power BI Developer to assist the Head of Data & Reporting and the Project Controls Manager. In this role, you will coordinate Project Controls activities related to the development, design, manufacture, construction, and commissioning of two EPRs. Your efforts will ensure … on licence management and support. Principal Accountabilities: Report Development : Develop and implement Power BI reports and dashboards for the project and external clients. Data Organisation : Structure data to ensure compliance with WBS, CBS, and OBS for consistent reporting. Trend Analysis : Use data to predict … trends and perform statistical analysis, visualising data in user-friendly formats. Digital Reporting : Implement digital reports and dashboards using data from the Data Lake. Support Monthly Reports : Provide intelligent information and analysis for monthly report production. Training and Support : Develop training materials, conduct sessions more »

Lead Data Engineer £80,000 - £100,000 DOE Mainly remote, some travel may be required Blue Wolf Digital are partnered with a boutique consulting firm who are looking to grow significantly this year due to some greenfield project wins. I'm looking for an experienced Lead Data … touch. Key Responsibilities: Design, develop, and maintain cutting-edge Databricks or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize … SQL queries for data extraction and analysis. Stay updated on industry trends and regulatory changes within the insurance sector to inform data strategies and solutions. Experience: Proven experience in building and maintaining data lakes or data warehouses using Databricks on Azure. Strong more »

Head of Integrations 🏡 London - Hybrid 🔵 Permanent 💸 Salary - £65K Extensive experience of implementing an Enterprise Service Bus, Data lakes and design patterns. Experience with Azure Previous experience of managing a team in a complex environment Experience of automating tasks using Azure Dev-Ops, Terraform, C# or Python. Substantial experience more »

We're on the hunt for a top-tier Data Product Manager obsessed with all things data product, BI & AI centred to join the exhilarating journey of a cutting-edge digital tech company's Data Tribe! Workplace Policy | Location: Hybrid Working between … up to £55,000 You will play a key role in delivering outcomes and quantifying real customer problems. Utilising the brand's extensive data, you will lead the product management framework and define/solve customer problems using BI & AI. Excellent communication and product management skills are essential … a great client... what more could you ask for? What else will you be doing? Take ownership of all aspects of the new data platform and ensure it remains aligned with the rest of the business Uncover and measure real customer issues using data analysis tools more »

Lead Data Analyst Exeter, Devon (Hybrid-Working with a minimum of 2 days in the office you must be based locally) Up to £70,000 per year Plus excellent benefits (including Pension, Bonuses, Life Insurance, Healthcare, etc.) The Opportunity: My client operating in the sustainability sector are currently … on the lookout for a Lead Data Analyst on a permanent basis to help with a period of transition as they build there all new Azure Data Lake. They are seeking a highly motivated individual to help them grow there analytical capabilities and within this role … and lead from the front to help create a skilled team for the future as you will be leading a skilled team of data analysts. In this role you must be comfortable working with some archaic legacy systems such as VBA, Excel and PowerPoint as they will need more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … ETL/ELT background developing data pipelines, optimising queries, and enhancing overall database performance. Deep expertise in SQL and Data Lake/Warehouse solutions Advanced skills in programming languages such as SQL, Python, Java, or Scala Extensive knowledge of query optimisation techniques and a proven more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Java Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »