1 to 25 of 129 Databricks Jobs in London

and coordinating release schedules Preferred Qualifications Experience owning/driving roadmap strategy and definition Understanding of data warehouses or Lakehouses, such as on BigQuery, Databricks or Snowflake Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems WHO WE ARE: Do Your Best Work The opportunity more »

data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns more »

Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Pyspark, Databricks Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance. Please apply today or get more »

some greenfield project wins. I'm looking for an experienced Lead Data Engineer to play a pivotal role in building state-of-the-art Databricks and Snowflake Lakehouse solutions from scratch. If you have experience with Azure, Databricks or Snowflake, SQL, ETL, and a passion for consulting, please get in … touch. Key Responsibilities: Design, develop, and maintain cutting-edge Databricks or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize SQL queries for data … changes within the insurance sector to inform data strategies and solutions. Experience: Proven experience in building and maintaining data lakes or data warehouses using Databricks on Azure. Strong expertise in SQL and ETL processes. Recent experience working within consulting, with a deep understanding of how to be a true 'consultant more »

Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling more »

create effective data models supporting business processes, including knowledge of dimensional modeling and normalization. Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics. Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance more »

Headcount, Staff Reconciliation Adhoc Represent Tech Media at Kantar Tech Finance forums and initiatives. Understand and reallocate central recharges such as Kyndryl, Azure, AWS, Databricks Work with advisors on annual UK R&D tax credit. Form relationships with key vendor partners such as Cognizant and Persistent Supplier/procurement/ more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions more »

/marketing models but not required Candidates should be looking to work in a fast paced startup feel environment Tech across: Python, SQL, AWS, Databricks, MLFlow, APIs Apply below more »

an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »

like Snowflake, FiveTran, and dbt. Requirements: Proven experience leading and mentoring data engineering teams. Hands-on with cloud-based data warehousing (Snowflake, Redshift, or Databricks) and SQL. Extensive knowledge of data management and Data Ops (ingestion, pipelines, CI/CD). Strong project management skills in a fast-paced environment. more »

in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling more »

Engineer A brand new and exciting opportunity has recently arisen for a Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and SQL to join one of the UK's Largest Charity based in London. As the Data Engineer you will be shaping the data eco … working on greenfield projects and improving their data function. If you are currently a Data Engineer with experience in ETL, Azure Data Factory, Azure DataBricks, SQL and keen to be influential in greenfield projects then this is the perfect opportunity for you! Skills that are required for a Data Engineer … are: Experience in Azure Data Factory and Databricks Experience working with ETL pipelines Great understanding of Data Engineering principles Salesforce would be a nice to have but not essential Azure Data Engineer/Data Engineer/Senior Data Engineer/Azure/ETL/SQL/Azure Data Factory Salary more »

software development principles. Extensive experience with Azure AI solutions, including Azure Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or more »

Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up more »

practices. A team player with excellent communication & collaboration skills. Desirable: Experience developing and maintaining data warehouses/lakes using big data solutions (e.g., Snowflake, Databricks). Familiarity with SQL Server, PostgreSQL or NoSQL database technologies. Previous experience within banking or finance desirable, but by no means necessary. If you're more »

bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data … in training and learn new technologies and techniques Tackle challenging project tasks demonstrating ownership and responsibility Skills: Experience in processing data using Spark/Databricks or similar Experience working in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building more »

Senior Data Engineer (Databricks) – Remote - 6 Months Contract (Initial) – Outside IR35 VIQU are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising … a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise … storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills more »

Senior Data Engineer | DataBricks | AWS/Azure | Full Remote Outside IR35 up to £500 per day 6 months initial Start - Immediate FRG Data are looking for a Senior Data Engineer with strong DataBricks experience. Skills & Experience: We are looking for someone that has a strong mix of the following skills … experience utilising the Microsoft Azure stack for data engineering ie Azure Functions * Core skills in coding with SQL, Python and Spark * Proven experience using DataBricks ie lakehouse, delta live tables, Pyspark etc more »

Azure. The Platform Engineer also have a focus on Azure data platform services with skills in Azure Data Factory (ADF), Data Analytics, and Azure Databricks and DevOps practices. Primary requirements for the Platform Engineer will include: Experienced Platform Engineer - CAF (Cloud Adoption Framework) Strong experience and understanding of Infrastructure as more »

warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is standardised, self-documenting and can be reliably tested Knowledge of more »

storage Highly Preferred Technical Skills: Experience with Kubernetes for container orchestration and data platform scalability Expertise in database tuning for performance optimization Familiarity with Databricks for large-scale data processing If interested, please apply or message me directly at more »

10 years of exp Job Overview: Data Scientist role within the Data & Analytics Project Pool Team to work alongside other Data Scientists to lead and support the implementation of new cloud Data & Analytics services to business users, as well as more »