101 to 125 of 147 Azure Data Factory Jobs in the UK

promotion that seen the Head of Engineering promoted into the CTO role there’s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data Warehouse Design: Design and develop a data warehouse more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This … role involves leveraging Azure’s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. … What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance more »

and insurance businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Retail’s Group Protection Data team are currently hiring for a Data Engineer as they begin the journey of delivering a new, modernised data platform … the business to gather requirements, working with the team to identify potential tools and through the migration on to a centralised platform consolidate data sources. What you'll be doing: Contributing towards improvements to database systems and linking the understanding of source data to value-adding … data engineering solutions (across storage, transformation, and data quality) Continuously developing processes so that deliverables are created in the most efficient way to improve performance, ensuring code is scalable, portable, and reusable, ensuring timely and accurate delivery of data solutions to the business Developing more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure more »

+ bonus up to 20%) I am currently recruiting for a business within the Lloyds of London space who are building out a Data Analytics and Science practise from the ground up. As part of this, I am currently recruiting for a Enterprise Data Architect. The … successful candidate will play a critical role, being responsible for the overall strategic design of the company's applications, systems infrastructure, and data architecture. You will ensure that the design frameworks, governance, and processes that underpin them are aligned with the business strategy. Responsibilities Define the target data … goals and objectives Provide technical leadership and guidance by driving the technical vision and roadmap. Evaluate, standardize, and implement technologies and products for data architecture. Mentor and lead a small team of architects and engineers Manage architecture projects and initiatives, including solution design, system integration, and technology upgrades. more »

your team's documentation. You’ll have strong mentoring skills, to support team members and the wider Innovation team. Our Tech Stack Infrastructure: Microsoft Azure, Terraform, Docker, Linux, Git, Azure DevOps Databases: Azure SQL, MongoDB Backends: Java/Spring, C#/.NET Core Frontends … Typescript/ReactJS Search and AI: Apache Lucene, Huggingface Data: Azure Data Factory, Apache Hop Test: Playwright Legacy: Windows, .NET Framework What is in it for you? We offer an intrapreneurial environment where people are supported to do their best work, and more »

business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to … extensive career development plans which are built specifically around each individual and their aspirations. Required skills: ADF; ability to build pipelines from scratch Azure Databricks Power BI; Ability to build reports from scratch Stakeholder management This is a great opportunity to join outstanding organisation who pride themselves on more »

developers when they require support. This role requires someone with excellent problem solving skills, using creativity to find resolutions. Our Tech Stack Infrastructure: Microsoft Azure, Terraform, Docker, Linux, Git, Azure DevOps Databases: Azure SQL, MongoDB Backends: Java/Spring, C#/.NET Core Frontends … Typescript/ReactJS Search and AI: Apache Lucene, Huggingface Data: Azure Data Factory, Apache Hop Test: Playwright Legacy: Windows, .NET Framework What is in it for you? We offer an intrapreneurial environment where people are supported to do their best work, and more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … is currently on-prem, but the direction of travel is cloud engineering, and you'll be executing code across the following tech stack: Azure, Databricks, PySpark and Pandas. DWP Digital is a great place to work, we offer a supportive and inclusive environment where you can grow your … career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data more »

Lead Data Engineer - Python/SQL/Azure My client, a London Market Specialty Insurance company are currently recruiting for a Lead Data Engineer to join their team on a Permanent basis. This is a great opportunity for an experienced Data Engineer … to be an integral part of leading a team that is building a new data function for a fantastic client who are moving to a more data driven environment. This opportunity is based in London (requiring 2-3 days onsite) and is paying up to … per annum Key Skills Strong commercial experience with Python/SQL/PySpark Knowledge of converting business requirements to engineering processes Azure environment - Data Bricks & Data Factory Industry experience with Insurance would be highly desirable The processing and use by us of more »

our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and … gather requirements. Required Experience Track record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or more »

Development team. You will engage in all phases of the software development lifecycle, focusing on creating a low & no-code solution for batch data operations in reporting and visualization. Their solution leverages Azure services, including Azure Web App, Storage Accounts, Azure Data Factory, and Databricks, with Python and C# as primary languages. Responsibilities: Collaborate on data harmonization and transformation requirements. Develop and maintain data processing libraries and pipelines. Optimize data processes for performance and scalability. Ensure data quality through validation … and testing. Requirements: 5+ years of software development experience. Expertise in Databricks, Python, and cloud deployment (preferably Azure). Experience with batch processing data. Nice to Have: Market research or retail data management experience. Familiarity with Agile, TDD, and Lean methodologies. Experience with Large Language Models more »

Are you ready to join a global investment manager who are at the forefront of shaping the future of data technology? You’ll play an integral role in the new team where you will be instrumental in driving the development of their new data analytics platform. … technology; then this could be the perfect role for you. Key Responsibilities: Spearhead the architectural design and implementation of a greenfield cutting-edge data platform, contributing to the transformation of our client's data landscape. Collaborate with a cross-functional team of software engineers, data engineers, and data analysts to support and enhance both existing and new data platforms. Varied role including improving the data quality and software development Be the driving force in identifying anomalies within the data, leveraging your expertise to enhance decision more »

role is responsible for the maintenance and support of database systems across the organisation. Support the administration and optimisation of MS SQL and Azure SQL databases and associated technologies, ensuring data security, quality, and efficient operation. Contribute to the design of database architectures, data … within an agile project environment. Duties and responsibilities: Database Management and Administration: Support the management and administration of multiple MS SQL databases and Azure SQL databases. Assist in the design and administration of Azure SQL databases that underpin key business systems. Support the management and oversight … of the data warehouse and all associated data flows. Azure Ecosystem Management: Assist in the administration and functioning of Azure Logic Apps and Azure Data Factory. Support the seamless data integration and flow within the Azure more »

Our Financial Services client based near Bournemouth are seeking a Data Engineer to join their growing business. The role is hybrid with some travel to the office required. Please note this role does not offer sponsorship, we can only accept applications from candidates with a right to work … in the UK. The Role (Key Responsibilities) Automate the collection of disparate data sources to Data Lakes and Data Warehouses. Produce underlying SQL (tables, views, stored procedures, SSIS packages etc.) Develop reporting solutions. Manage Tableau … ADF (Azure Data Factory) and SQL Server reporting deployments. Key Skills/Experience Experienced in working Microsoft Cloud Data and Automation technologies. Experienced working with Windows SQL Servers. Experienced working with Tableau and or Power BI. Experienced in writing SQL scripts including more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … the design and implementation of a modern data platform as a Greenfield Project. Establish and maintain data flows to integrate operational systems, data analytics, and business intelligence (BI) systems. Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven more »

provide constructive feedback to team members to promote continuous improvement and knowledge sharing. Lead efforts in systems integration, including third-party integrations and data synchronisation between different systems, ensuring data consistency and integrity. Troubleshoot and debug complex issues in backend systems, identifying root causes and implementing … of backend development principles, including GraphQL & RESTful APIs, microservices architecture and database design. Experience with systems integration, including third-party API integration and data synchronisation between disparate systems. Experience with frontend development frameworks such as React and Next.js An understanding or exposure to caching and security considerations when … fast-paced, dynamic environment and adapt quickly to changing priorities and requirements. Nice to Haves Experience with deployment platforms like Vercel. Experience with Azure API Management, Azure Data Factory and Azure SQL. Experience in working on web development projects based more »

Data Engineer Leeds - on site 2x per week up to £55,000 Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. Working closely with the Senior Data … automation whilst maintaining a core SAS user base. Requirements: Demonstratable proficiency with SAS platforms Strong commercial experience with SQL Hands on experience with Azure Data Factory and the build of data pipelines Proficiency in Python for data manipulation, transformation and … analysis Experience with Azure Synapse including ingestion and querying We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age. more »

an exciting opportunity to join a great team with opportunity to develop skills and implement new technologies as we look to develop the data platform and support national developments. You will have experience working with large datasets and experience of working with a range of data … the opportunity to implement and improve processes and methodology where necessary. As a Senior Developer you will have experience working in a similar data environment and delivering complex ETL/ELT processes. You will be able to manage the workload of yourself and the team and be able … NHS values underpin everything we do. The development team are a small team within the wider Business Intelligence team responsible for ensuring the data flows and data pipelines operate effectively and efficiently to support onward analysis. The team is based in various locations, mostly working from more »