26 to 50 of 283 Databricks Jobs in the UK

experience working as a Data Engineer, preferably on the Azure platform. Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and ETL/ELT concepts. Strong problem more »

and the business stakeholders Investigate and provide solutions for issues (bugs, data errors) Key skills PowerBI– DAX, Power Query (M) Power apps – Advantageous Azure, Databricks Stakeholder management What’s on Offer Up to £90k Salary Bonus package Hybrid working in either Leeds, Manchester or London + flexible hours More exciting more »

them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the … lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

to better the existing architecture Key skills/experience: Azure PaaS components including: API Management/App Services + Insights/Data Factory/DataBricks/Function/Networks... Azure DevOps stack AKS/Helm/Flux PowerShell/Azure CLI IAC/Terraform Containers This is an excellent opportunity more »

used Python, R and SQL in your current or previous roles. Any exposure to ML models and/or Cloud tools such as Azure Databricks would be advantageous. The role would be based mainly from home with travel into Sheffield once a week, so ideally you will drive. If this more »

Senior Data Engineer (Databricks) – Remote – Leeds - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/… centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and … storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills more »

Databricks Engineer – Remote – Manchester - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Databricks Engineers on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of … BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on … AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as more »

using Azure AI services for various use cases. Integrating Azure AI services with other Azure products and services, such as Azure Machine Learning, Azure Databricks, Azure App Service, and Azure Cognitive Search. Enabling data capture, ingestion, processing, and storage to serve AI and analytics using Azure technologies Optimising the performance more »

using Azure AI services for various use cases. Integrating Azure AI services with other Azure products and services, such as Azure Machine Learning, Azure Databricks, Azure App Service, and Azure Cognitive Search. Enabling data capture, ingestion, processing, and storage to serve AI and analytics using Azure technologies Optimising the performance more »

to meet the changing expectations of customers and regulators. Yorkshire Water has a significant data footprint and partnerships with global organisations like Microsoft, SAP, Databricks, and ESRI. Our data is spread across the county of Yorkshire, with over 1 million real time data points monitoring reservoirs, treatment facilities, pipework, and more »

Senior Data Engineer | DataBricks | AWS/Azure | Full Remote Outside IR35 up to £500 per day 6 months initial Start - Immediate FRG Data are looking for a Senior Data Engineer with strong DataBricks experience. Skills & Experience: We are looking for someone that has a strong mix of the following skills … experience utilising the Microsoft Azure stack for data engineering ie Azure Functions * Core skills in coding with SQL, Python and Spark * Proven experience using DataBricks ie lakehouse, delta live tables, Pyspark etc more »

Azure. The Platform Engineer also have a focus on Azure data platform services with skills in Azure Data Factory (ADF), Data Analytics, and Azure Databricks and DevOps practices. Primary requirements for the Platform Engineer will include: Experienced Platform Engineer - CAF (Cloud Adoption Framework) Strong experience and understanding of Infrastructure as more »

warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is standardised, self-documenting and can be reliably tested Knowledge of more »

storage Highly Preferred Technical Skills: Experience with Kubernetes for container orchestration and data platform scalability Expertise in database tuning for performance optimization Familiarity with Databricks for large-scale data processing If interested, please apply or message me directly at more »

and incremental development. Track record in problem resolution & selection of technical solutions. Qualified to relevant development certification (or equivalent experience). Experience working with Databricks/Apache Spark. Experience working with infrastructure-as-code. Desirable: Experience working with Geospatial Data. Experience using Terraform. The rewards: We want you to love more »

create effective data models supporting business processes, including knowledge of dimensional modeling and normalization. Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics. Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance more »

ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of data quality Becoming a subject matter expert on the company's data sources and ingestion methods. Assisting in developing and adhering more »

an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »

a Data Engineer Experience with analytical reporting and reporting tools - Tableau, Powerbase, SAP BO, Cognos (or similar) Experience with Data Integration tooling/Frameworks - Databricks, Oracle Data, Oracale Warehouse, AWS Glue, Azure Data Factory (or similar) Extensive experience with Python, Spark, SQL, SAS, MATLAB Strong SQL experience Good understanding of more »

Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »

in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »

data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns more »

software development principles. Extensive experience with Azure AI solutions, including Azure Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or more »

Senior Data Engineer (Azure/Data Lake/Databricks/Data Factory/SQL Data Warehouse/SQL Database) A leading energy company in the low-carbon sector is looking for a Senior Data Engineer . Base Location: Flexible, with a preference for key Scottish sites including Perth, Aberdeen, or … Professional-level technical computing, analysis, design, and development skills. Experience with Azure cloud technologies for analytics solutions. Proficiency with Azure resources like Data Factory, Databricks, Data Lake, SQL Database, and SQL Data Warehouse. Senior-level experience in data engineering, including designing data models, ETL pipelines, and conducting testing/QA. more »

practices. A team player with excellent communication & collaboration skills. Desirable: Experience developing and maintaining data warehouses/lakes using big data solutions (e.g., Snowflake, Databricks). Familiarity with SQL Server, PostgreSQL or NoSQL database technologies. Previous experience within banking or finance desirable, but by no means necessary. If you're more »