1 to 25 of 264 Databricks Jobs in England

Data Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture more »

create effective data models supporting business processes, including knowledge of dimensional modeling and normalization. Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics. Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance more »

Databricks Engineer – Remote – Manchester - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Databricks Engineers on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of … BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on … AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as more »

person to have worked on real-time Azure projects in various commercial domains. The person will have exposure to modern data tools including Azure Databricks, Cosmos, and data integration technologies. Additional exposure to working with data science teams, and supporting machine learning activity would be highly valued. MAIN RESPONSIBILITIES Be more »

experience in data engineering roles, preferably within a consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity more »

or more of the following Azure data services (ADS): Azure Data Factory, Azure Data Lake Store and Azure Data Lake Analytics with uSQL, Azure Databricks, Azure SQL DB and Azure SQL DW/Azure Synapse Analytics, Azure Analysis Services with DAX, etc... Power BI data visualization (Power BI Desktop, Power more »

as an Azure Solution Architect in Microsoft Data and AI. Extensive, hands-on, current experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure more »

activities Lunch allowance for use within our subsidized onsite canteen Must have skills Working knowledge of Azure DevOps (Git, build and release pipelines), Python, databricks, and snowflake as a requirement. Nice to haves are: PowerBI, and Attunity Replicate Significant information technology and/or application development, database development and/ more »

ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring of data quality Becoming a subject matter expert on the company's data sources and ingestion methods. Assisting in developing and adhering more »

Inmon and hybrid data warehouse design. Cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is standardised, self-documenting and can be reliably tested Knowledge of more »

Continuity processes and procedures The Data Platform Engineer (Azure) will have the following: Understanding and detailed knowledge of Microsoft Azure DevOps, ITIL, Azure Synapse, Databricks, PowerBI, Data Factory, HD Insights, Python Sparks, and have a strong IT service background. Strong administration of Windows Domains and Windows Server technologies Strong administration more »

and unstructured data, including cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. * Proficiency in developing with Databricks and coding with PySpark and Spark SQL. * Experience in delivery of data and analytics solutions/applications to automate business processes and meet user function more »

working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL … working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL more »

solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and more »

experience working as a Data Engineer, preferably on the Azure platform. Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and ETL/ELT concepts. Strong problem more »

and unit testing. Infrastructure-as-code expertise with CI/CD pipelines. Ability to communicate complex topics clearly. Nice to Have: Experience with Snowflake, Databricks, and GCP or Azure. Knowledge of streaming data architectures. Data security and compliance implementation. Machine Learning Operations (MLOps) experience. more »

use the data to make better and more informed decisions - Have experience of Databases (ideally SQL Server) and tools such as Python or Azure DataBricks The role is offered on a hybrid basis with travel to one of the core offices - Ideally this would be Birmingham so a Midlands base more »

experience working in industry as an Azure Data Engineer and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. In-depth understanding of more »

to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines on more »

to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines on more »

Kimball & inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection more »

Kimball & inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection more »

development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both more »

data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data solutions on a cloud based, big data distributed system (AWS/Azure etc.) Hands-on more »

to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working in an more »