performance and responsiveness. Stay Up to Date with Technology : Keep yourself and the team updated on the latest Python technologies, frameworks, and tools like Apache Spark , Databricks , Apache Pulsar , Apache Airflow , Temporal , and Apache Flink , sharing knowledge and suggesting improvements. Documentation : Contribute to clear and concise … or Azure . DevOps Tools : Familiarity with containerization ( Docker ) and infrastructure automation tools like Terraform or Ansible . Real-time Data Streaming : Experience with Apache Pulsar or similar systems for real-time messaging and stream processing is a plus. Data Engineering : Experience with Apache Spark , Databricks , or similar … big data platforms for processing large datasets, building data pipelines, and machine learning workflows. Workflow Orchestration : Familiarity with tools like Apache Airflow or Temporal for managing workflows and scheduling jobs in distributed systems. Stream Processing : Experience with Apache Flink or other stream processing frameworks is a plus. Desired More ❯
Richmond, North Yorkshire, Yorkshire, United Kingdom
Datix Limited
knowledge of programming languages, specifically Python and SQL. Expertise in data management, data architecture, and data visualization techniques. Experience with data processing frameworks like Apache Spark, Hadoop, or Flink. Strong understanding of database systems (SQL and NoSQL) and data warehousing technologies. Familiarity with cloud computing platforms (AWS, Azure) and More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Evri
flexibility for remote work. Office visits required for key meetings and collaboration sessions. Key Responsibilities: Develop and maintain scalable data pipelines using Databricks and Apache Spark to process logistics and delivery data Design ETL workflows that integrate data from multiple delivery and warehouse systems Development of Data Marts on More ❯
on tech to our customers. Create and document installation, configuration, maintenance and support procedures for all systems under management. Manage the Lamp stack (Linux, Apache, MySQL and PHP servers), Linux email platforms, MS Windows Servers, VM-Ware platform and our monitoring & alerting tools. Provide assistance with troubleshooting our internal More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
University of Leeds
Data Engineering at Scale: You will have expertise in manipulating and analysing large datasets. This will include knowledge of SQL, and experience with Hadoop, Apache Spark, or similar platforms would be beneficial. Geospatial data: You will have expertise in manipulating, analysing and visualising data that contains geospatial information. For More ❯
Sheffield, Yorkshire, United Kingdom Hybrid / WFH Options
Reach Studios Limited
with web applications utilising the power of Laravel for back-end processes. Front-ends are built in Alpine.js/React/Next.js, rendered by Apache or NGINX servers. Both REST and GraphQL APIs are utilised to integrate and extend the services we provide to our array of clients. What More ❯
Synchronous and Asynchronous integrations into a Salesforce environment. Advanced Database skills in SQL, Stored Procedures, Triggers, Architecture. Practical commercial experience across Azure Data Factory, Apache Airflow, Databricks AutoLoader. Success in IAC lead solutions (Infrastructure as Code). Strong understanding of data flow and message services such as Event Hub … Apache Kafka. Please note: This role requires you to be onsite 3 days a week; therefore, a reasonable commutable domicile is expected. Where Leeds is the preferred location, other offices such as Middlesbrough, Bristol, or Bournemouth can be considered. This role does not currently provide sponsorship support. Reward This … enhanced pension, and an extensive employee benefits programme. Data Integration Engineer, Integration Engineer, Salesforce, .Net, Azure, Azure Data Factory, RDBMS, SQL, Stored Procedures, Triggers, Apache Airflow, Databricks, Autoloader, CI, CD, IAC, Infrastructure as Code, DevOps, Agile, Event Hub, Apache Kafka. We are Disability Confident and neurodiverse aware. If More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Oliver James Associates Ltd
sync/async methods. Expertise in databases, database architecture, SQL, and stored procedures. Strong background in data integration technologies such as Azure Data Factory, Apache Airflow, and Databricks AutoLoader. Proficiency in building CI/CD pipelines and implementing infrastructure as code. Experience with event-driven data flows and message … aggregation technologies (Event Hub, Apache Kafka). A solid understanding of current and emerging technologies and how they can deliver business value. Desirable experience with data matching processes. Strong ability to translate business strategies into technical solutions and business requirements into technical designs. If you're passionate about driving More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Sportserve
Sportserve forms part of a remarkable group of B2C sports betting and B2B sportsbook technology companies, focused on delivering first class sports betting experiences and casino products for our users worldwide. Along with Sportion, TechSpirit, Standard Focus and Sportelligent, we More ❯
Birmingham, Leeds, Liverpool, London, United Kingdom Hybrid / WFH Options
UK Health Security Agency
/implementing Unix/Linux system and services open source solutions and performance tuning; Open-source storage technologies such as: Lustre, CEPH, NFS, SMB, Apache, Ngnix, HAproxy Experience of providing a support service for own specialist area Experience of implementing risk management processes and monitoring system risks Candidate must …/implementing Unix/Linux system and services open source solutions and performance tuning; Open-source storage technologies such as: Lustre, CEPH, NFS, SMB, Apache, Ngnix, HAproxy Desirable criteria may be used in the event of a large number of applications/large amount of successful candidates (see attached More ❯