1 to 25 of 270 Data Lake Jobs

people love, we want to hear from you. Role Summary: The Business Intelligence Developer is the subject matter expert in researching and developing data pipelines, data governance, data quality, and Extract Transform Load (ETL/ELT) activities supporting analytical and data science … role defines long-term strategy for analytics using the cloud and exercises considerable latitude and initiative to turn business problems into query-able data sets to drive business performance. Key Duties: Design and implement strategy for migration of data from on-prem to cloud to drive … data from multiple sources using SQL, Python, Spark or other advanced query/database techniques. Experience in working in data lake and unstructured data environments. Knowledge of visualization techniques, dashboard design, and decision support tools (such as Tableau, management systems). Excellent communication more »

and sales force integrations. Required: Configuration, Commerce, Document Designer, Workflow Approvals, Email Templates, Steps, Commerce & Configuration Layout Design, BOM Mapping Administration: Environment Setup, Data Table Management, File Manager, User and Group Management, Parts creation, Code Migration, and Cascading Stylesheets (CSS) Required: Apex; Visualforce; Lightning Component framework; SOQL; Custom … Server or Oracle) Preferred: Experience with Extract, transform, and load (ETL) combining data from multiple sources into data warehouse/datalake CI/CD, Git source Ability to understand the big picture, look forward, anticipate problems, and assess risk Highly organized, detail oriented, and able to more »

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

You will be responsible for designing, developing, and implementing solutions using Microsoft PowerApps and overseeing the ETL processes necessary for integrating and maintaining data across our business systems. This role demands a high level of technical expertise, problem-solving skills, and the ability to collaborate with cross-functional … applications using Microsoft PowerApps. Collaborate with stakeholders to understand requirements and deliver solutions that meet business needs. ETL Processes: Handle ETL tasks for data integration, transformation, and loading between various sources and destinations. Ensure data quality and consistency across systems. Data Management: Work with … SQL databases, data lakes, and other storage solutions to manage data used within PowerApps. Implement data governance and security measures. Application Lifecycle Management: Use best practices for version control, testing, and deployment of PowerApps solutions. Monitor and optimize app performance and user experience. Collaboration more »

Data Intelligence Platform are: • Efficiently load and transform data into a DWH • Provide advanced orchestration to use Data Lake based approach • Integration with 3rd party sources, open-source APIs • Data movement in both batch and real-time change data capture • Leverage Big Data technologies (Spark) to ingest, clean & transform data • Apply Machine Learning on DWH to proactively figure out issues and generate insights • Create dashboards in Oracle Analytics Cloud to drive decision-making Your Opportunity You will be responsible for applying your extensive … knowledge as a data engineer and building Digital Government Data Platform . Our Ideal Candidate We are looking for a strong Data Engineer who thrives on research and development projects. Be technically strong and hands-on, who works efficiently with other product groups and more »

Senior Data Engineer (Azure/Data Lake/Databricks/Data Factory/SQL Data Warehouse/SQL Database) A leading energy company in the low-carbon sector is looking for a Senior Data Engineer . Base Location: Flexible … are also possible. Working Pattern: Permanent | Full Time | Hybrid (1 day at the office per week) What is the Role? As a Senior Data Engineer , you'll develop and optimize data pipelines on the Microsoft data stack, particularly the new Fabric data … and development skills. Experience with Azure cloud technologies for analytics solutions. Proficiency with Azure resources like Data Factory, Databricks, Data Lake, SQL Database, and SQL Data Warehouse. Senior-level experience in data engineering, including designing data models, ETL pipelines more »

for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor’s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

mission by providing a hugely diverse set of technical solutions and platforms. From supporting critical systems which underpin the UK economy, to evolving data analytics, reinventing our online presence, and introducing a fully digital workplace. Be part of a team that’s constantly evolving, just like our industry.We … deliver services to both the Bank and external users. These include critical systems and services that underpin the UK economy, financial supervision, evolving data analytics, collaboration and research.This role sits within the Technology Strategy and Architecture (TSA) division in the Technology Directorate who are accountable for technical strategy … and experience in architecture modelling toolsDeep domain expertise in cloud scale analytics and experience in one or more technologies e.g. Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Synapse, Azure ML, Azure Cognitive Services, PowerBIKnowledge and exposure of financial regulation is more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of superior … data services The Data Analyst for Data Operations will be responsible for managing stakeholders, gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. Working early some mornings, on a scheduled basis to monitor overnight operational batches and resolve more »

Job Title: Azure Data Engineer (Contract) Duration: 3 months Rate: £400 per day Location: Remote Skills: Databricks/Azure Data Lake/Kubernetes IR35 Determination: Outside IR35 Company Overview: We are seeking a skilled and experienced Azure Data Engineer to join our team … on a contract basis. This is an exciting opportunity to contribute to our data infrastructure and play a key role in ensuring the reliability, efficiency, and performance of our data solutions on the Azure platform. Responsibilities: Design, develop, and implement data solutions using Azure … services, including Azure Databricks, Azure Data Lakes, and other cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … This is an urgent contract, so if you are interested apply ASAP. Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data … AWS cloud, including Platform-as-a-Service, server-less, and container technologies. • Diverse skills in ETL, data warehouse, and Data Lake design. • Familiarity with various tools, cloud technologies, and approaches. • Expertise in AWS or equivalent open-source tools. • Proficient in defining the end-to-end more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

inside IR35 Our client is currently working on several end-client programmes, for several Government technical Consultancies to support various public body Government Data Engineering departments as part of their respective cloud migration strategies. The Data Platform Engineer will be assigned to one (perhaps more depending … on project timelines) of our client's data engineering projects based on data engineering and technical skills. The successful candidate will fulfil the following responsibilities: Requirements analysis and design of solutions … for the data platform; Integration and analysis of solutions; Understanding of toolsets including AWS hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena); Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway; ETL services (AWS Glue, Step functions); Infrastructure more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … people really love; and, importantly, a career model that lets you take control of your development and progression. OUR VISION To be the data analytics company most admired for its people, culture and innovation. THE ROLE The primary focus for you will be the design and delivery of … DAX Data Modelling/Data Warehouse Theory Nice to Have Azure Modern Data Platform Services (Data Lake, Data Factory, Databricks, Synapse) Azure DevOps/CI/CD/YAML/ARM/Terraform MSBI Traditional Stack (SQL, SSAS, SSIS more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … you needProven experience in defining data architectures to satisfy multiple stakeholders with varying data proficiencyThorough understanding of data lake and data warehousing principles and full project involvement in one or more major technology platforms, e.g. Snowflake, DatabricksProven experience with one or more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … you needProven experience in defining data architectures to satisfy multiple stakeholders with varying data proficiencyThorough understanding of data lake and data warehousing principles and full project involvement in one or more major technology platforms, e.g. Snowflake, DatabricksProven experience with one or more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … you needProven experience in defining data architectures to satisfy multiple stakeholders with varying data proficiencyThorough understanding of data lake and data warehousing principles and full project involvement in one or more major technology platforms, e.g. Snowflake, DatabricksProven experience with one or more »

Data Engineer – London/Hybrid – Leading Communications Consultancy – Upto £120k Salary D.o.E + The Company A highly innovative and creative communications agency is looking for an experienced Data Engineer to join their insights practice. This company are a true powerhouse within their industry. They work with … challenges of our time through science, technology and engineering. They help them tell their story! The Role Collaborate closely with business operations and data science teams to comprehend data sources and business requirements. Develop, cleanse, enrich, and transform structured, semi-structured and unstructured data … around PowerBI. You Excellent experience in using Python. Excellent experience of SQL, relational databases, and modern data warehousing (Azure data lake/warehousing and snowflake desirable). Experienced with Azure Platform, architecture and costing. Building and maintaining reliable ETL/data pipelines. Experienced more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … Engineering. 1+ years in a Lead/Principal Engineer role. 3+ years of experience with GCP. Extensive experience with SQL and Data Lake/Warehouse solutions. Proficiency in languages such as SQL, Python, Java, or Scala. In-depth knowledge of query optimization techniques and experience in fine more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

Data And Reporting Lead Main Job Purpose OmniTech is working with a confidential client to source a Data & Reporting Lead. The potential candidate will be supporting the development of business intelligence solutions using Microsoft Power Bi to the business. We have a mature reporting environment that … Microsoft application stack and works using the Agile Scrum Development methodology. The role compromises the following activities: • Various Integration activity (ETL) using Azure Data Factory, SSRS and C#. Connecting multiple data sources to our Datawarehouse and integration into our data model • Data … Management Server, SSRS, SSIS and other related systems • Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc • Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc • ETL Related experience more »

Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Vivo Talent are engaged with an organisation who is going through a huge transformation in how their data is used and managed. They require a Data Architect who is passionate … utilising their understanding of Azure data tools to implement and maintain an effective platform. Skills Azure Stack (SQL, Synapse, Data Lake) Power Bi Demonstrated experience in a similar position Strong stakeholder management skills both internal and external If you are interested in hearing more about … this opportunity, please get in touch. Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent more »