1 to 25 of 41 Data Lake Jobs in the South East

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … scalable data solutions aligned with business requirements.Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services.Develop, optimize, and maintain data pipelines for automated data integration from various … Engineer and/or BI Developer.Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake.Strong data engineering and data modeling skills, with the ability to craft complex data models.In-depth more »

note: you must have the right to work in the UK without the requirement of a Skilled Worker Sponsorship. Duties and Responsibilities Perform data analysis and modeling for development and maintenance projects; participate in the development of standards and procedures affecting Dynamics reporting. Provide development, support, maintenance, governance … storage, processing, and analytics. Azure Synapse Serverless Leveraging Azure Synapse Serverless for scalable and cost-effective data analytics. Data Lake, Lake House and Delta Lake Experience Familiarity with Data Lake and Delta Lake technologies for storing and processing … of years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake Experience Following Tools Experience : Microsoft Power BI Synapse Paginated Report Builder Power Platform KBR Company Information When you become part of the KBR team more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … warehouse/BI projects.4+ years' experience working with Data Analysis Expressions (DAX)Extensive experience with SQLExperience with Data VerseData Lake, Lake House, and Delta Lake ExperienceResponsibilities:Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and reporting … dashboards, and generate insights that drive business decisions.SQL Experience for ETL: Designing and executing Extract, Transform, Load (ETL) processes using SQL to facilitate data integration and reporting.Azure Resource Procurement: Procuring resources in Azure Portal to support data storage, processsing, and analytics.Azure Synapse Serverless Leveraging Azure Synapse more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

Job DescriptionLead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/CharityRate: £500-650 per dayDuration: 6-12 monthsIR35: OutsideLocation: Remote with occasional travel to London (Once every two months max)Essential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake/Data Bricks/Data FactoryBe happy to act as a lead and mentor to the other permanent Azure Data … and lineageThis is an urgent contract, so if you are interested apply ASAP.Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

understand business requirements and designing integration solutions to connect Dynamics 365 Finance and Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies … such as X++, C#, SQL, XML, JSON) to create seamless data flow and functionality between different systems. API Development: Utilizing APIs (Application Programming Interfaces) provided by Dynamics 365 Finance and Operations and other systems to facilitate data exchange and communication between them. Data Mapping … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

Data is crucial to providing a first-class service to our customers and managing our business effectively. The Data Quality Team has a proud history of working with colleagues across numerous business units to help influence behaviour and decisions at all levels of the organisation in … expanding its influence into more of the business's key strategic projects in 2024 and beyond. As well as ensuring that business-critical data is fit for purpose, the team is also responsible for the purchase of third party marketing suppression and enhancement data. We continually assess the … business' use of these assets. Strong technical skills encompassing the ability to understand data from source systems and the data lake, interrogate this data competently using SQL-based code, build automated reports in PowerBI and communicate the results in a timely manner to more »

Azure Developer (C#, DevOps, Data Lake, Logic Apps) Havant, Portsmouth (1-2 days per week in the office). £45000 - £62000 + Benefits Your new company I’m working with an energy provider with a focus on modern DevOps practices that have considerably grown their Development team … Azure Developer strong fundamental C#. Deep knowledge of Azure is essential – Azure DevOps (Functions, Redis, Service Bus etc), plus knowledge of Data Lake, Logic Apps, Power BI etc. Working here you’ll use the latest versions of .Net daily to build complex applications. You should have good more »

Job DescriptionData Integration ManagerA brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities.We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud.Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role.Skills that are required for a Data Integration Manager are:Expert in AzureExperience working with data flowsGreat more »

Job DescriptionLead Data Engineer - Azure/Spark/DatabricksRole: Lead Data EngineerLocation: London (3 days a week)Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this … engineering stack. Key Responsibilities:Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks.Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices.Lead and mentor a team of … effectively with remote teams, leveraging your experience in leading distributed teams to drive success.Requirements:Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks.Proficiency in coding with Spark and a strong understanding of design aspects.Deep understanding of engineering best practices and the ability to implement more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Job DescriptionI am searching for a talented Data Architect to join my client, a leading Fintech company in London.In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions.Job Title: Data Architect Location: London (Hybrid)Salary: £95,000 - £100,000Industry: FintechStart: ASAPWhat you'll be doing:Design and develop enterprise-level data architectures … and solutions.Select and implement appropriate data management tools and technologies.Ensure data quality, consistency, and security across the organization.Collaborate with data engineers and analysts to deliver successful data projects.Stay up-to-date on the latest trends and technologies in data architecture.Requirements more »

Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. … having impacts across the education sector, parts of the NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azure synapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part of this project helping to analyse the current data estate, identify opportunities and weaknesses then build a roadmap for the data strategy. Key Skills: Highly advanced level of SQL querying more »

in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real … be up to?:Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse.Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed.Modern tech stack … several teams, this is key as you will be reporting directly to the CTO.2 + years of programming language experience (e.g. Python, SQL)Data modeling/ETL tool experience A startup/greenfield mentalityWhat's in it for you?:Hybrid workingPrivate healthcare and wellness supportEmployee Discount: 75% discount more »

Job DescriptionAbout Tredence­: -Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve … Agile development methodology; think strategically and execute methodicallyDevelop and manage capacity and growth projection forecasts of the environment within budgetsCreate and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirementsDrive optimization, testing and tooling to improve quality … on experience in Data bricksExperience managing distributed teams preferred.Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projectsComfortable working with ambiguity and more »

Salary : £55,000 GBP per annum and Benefits applicable by the Client Purpose of Role: At Client we are committed to ensuring our data and processes are successfully maintained and enhanced to keep our customers moving. We are therefore recruiting for a Data Product Owner to … purpose today and ready for the challenges of the future, providing a bridge between our operational teams and technology department and facilitating better data decision making for our customers. Reporting to the Data Product Manager, you will: Play a vital role in owning and developing the … on their needs; successfully gathering and acting on user feedback and effectively communicating on updates and issues. Become an expert in Asset Risk data systems and processes and provide business knowledge when interacting with internal stakeholders and 3rd parties. Collaborate with key business stakeholders from a variety of more »

the impact on user experience of a range of clinical and non-clinical features. Key duties: Proposing a range of innovative, cost-effective, data collection techniques to quantify benefits and usage of software products in a complex fast-moving environment. Planning, documenting, and conducting suitable experiments to test … hypotheses on the usage and benefits of Blatchford products. Recruiting suitable individuals for studies. Ensuring data is collected in line with patient privacy stipulations and relevant legislation. Facilitating a range of data collection forums. Collating information, writing documents and reports to provide insights and information to … inquisitive, and eager to learn. Familiar with agile software development cycles and ceremonies Understanding of Business Intelligence, Data Warehouse, Data Lake concepts Experience and interest in analysing human performance data. Strong communications and interpersonal skills. This is a fantastic opportunity to work as part of more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to … enrich our dynamic team.Responsibilities:Experience designing data models and developing industrialized data pipelines.Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor).Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers, preferably more »

Job DescriptionData Architect - Azure/Spark/DatabricksRole: Data ArchitectLocation: London (3 days a week)Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading Azure-based data solutions and helping them further the development of their award winning data platform. In this pivotal role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities:Lead the design and implementation of Azure-based data … comprehensive data design documents to articulate architecture decisions and implementation plans clearly.Requirements:Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks.Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non-technical audiences.Experienced and knowledgeable of Data more »

Security Audits and Assessments regularly.Create and maintain the Security Architecture for the company and maintain network securityEnsure the continual security of the sensitive data that is held within the company.💸The salary on offer for this Lead InfoSec Engineer Role, is paying £75,000 + Benefits Package + … threats. Strong understanding of key aspects of data security including encryption methods, access management, data warehouse/data lake security etc. Experience with tools like PowerBI, Nessus, CrowdStrike and Sentinel or similar.Experience in leading internal security audits and developing and embedding comprehensive infosec … strategies across the business.Experience managing cyber incident response processes and working with specialist partners.Experience with SQL-based data warehouse solutions.Understanding of network-level security principles and practices Strong understanding of security frameworks and standards such as ISO 27001, NIST, or CIS.Relevant certifications such as CISSP, CISM, CompTIA Security more »

Open Targets (OT) is a unique public-private partnership working to deliver experimental data and informatics platforms that enable researchers to make more informed decisions about target selection for drug discovery. OT is a shared initiative between the European Bioinformatics Institute (EMBL-EBI), a global leader in the … management, integration and analysis of public domain life science data; world-leading pharmaceutical companies GSK, Sanofi, Bristol Myers Squibb, Pfizer and Genentech; and the Wellcome Sanger Institute. Generative AI has revolutionised the way we interact with knowledge. To benefit from the advances in LLM technology inside Open Targets … collaborative, and international team, you will be responsible for: Developing and implementing a knowledge graph framework on top of the existing data lake to improve our data sharing and analysis pipelines to assist drug discovery user stories. Working closely with data provision and more »