Data Engineering Jobs

Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 176 142 167
Rank change year-on-year -34 +25 +93
Permanent jobs citing Data Engineering 1,716 2,367 4,288
As % of all permanent jobs advertised in the UK 1.64% 2.50% 2.54%
As % of the Processes & Methodologies category 1.95% 2.62% 2.65%
Number of salaries quoted 921 1,133 1,507
10th Percentile £42,439 £46,300 £47,500
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +11.11%
75th Percentile £90,000 £97,290 £91,250
90th Percentile £105,000 £130,000 £108,750
UK excluding London median annual salary £65,000 £62,500 £65,000
% change year-on-year +4.00% -3.85% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 87,829 90,354 161,874
As % of all permanent jobs advertised in the UK 83.68% 95.46% 95.93%
Number of salaries quoted 61,251 54,292 82,971
10th Percentile £29,250 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £60,800 £60,000
Median % change year-on-year -9.54% +1.33% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 1 June 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -26 1,532 £70,000 -9.68% 413
UK excluding London +13 1,139 £65,000 +4.00% 182
Work from Home -59 568 £70,000 - 186
London -61 506 £82,500 -2.94% 242
North of England +15 411 £60,000 -7.69% 69
North West +22 262 £55,000 - 47
South East +46 201 £67,500 -3.57% 41
Midlands -27 189 £57,500 +4.55% 30
South West -5 152 £75,288 +12.79% 18
West Midlands -48 120 £59,300 +7.82% 19
Scotland -21 116 £70,000 +16.67% 13
Yorkshire -20 89 £65,066 -2.99% 16
East Midlands +10 67 £45,000 -21.74% 11
North East +39 60 £75,000 +15.38% 6
East of England -18 43 £75,000 +30.43% 7
Wales -1 18 £97,500 +118.29% 3
Northern Ireland +23 9 £55,000 - 2

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 176 (10.26%) Apache Spark
2 104 (6.06%) Apache
3 92 (5.36%) Apache Airflow
4 28 (1.63%) Confluence
5 25 (1.46%) SAS
6 19 (1.11%) Jupyter
7 16 (0.93%) nginx
8 5 (0.29%) Apache Pulsar
9 3 (0.17%) Luigi
10 2 (0.12%) SharePoint
Applications
1 27 (1.57%) Microsoft Excel
2 6 (0.35%) Spreadsheet
3 5 (0.29%) Microsoft Office
4 3 (0.17%) MS Visio
4 3 (0.17%) SPSS
5 2 (0.12%) Chatbot
Business Applications
1 3 (0.17%) Dynamics CRM
2 1 (0.058%) NetSuite
2 1 (0.058%) SAP ERP
Cloud Services
1 733 (42.72%) Azure
2 563 (32.81%) GCP
3 556 (32.40%) AWS
4 266 (15.50%) Power Platform
5 175 (10.20%) Azure Data Factory
6 149 (8.68%) Azure DevOps
7 142 (8.28%) Snowflake
8 140 (8.16%) Azure Synapse Analytics
9 95 (5.54%) Amazon S3
10 87 (5.07%) dbt
11 57 (3.32%) Azure Cosmos DB
12 52 (3.03%) Serverless
13 44 (2.56%) GitHub
14 37 (2.16%) SaaS
15 36 (2.10%) AWS Lambda
16 34 (1.98%) Matillion
17 29 (1.69%) Amazon EC2
18 26 (1.52%) Amazon Kinesis
19 19 (1.11%) Cloud Computing
20 18 (1.05%) Fivetran
Communications & Networking
1 6 (0.35%) Firewall
1 6 (0.35%) Network Security
2 3 (0.17%) VoIP
2 3 (0.17%) Wi-Fi
3 2 (0.12%) Broadband
3 2 (0.12%) LAN
3 2 (0.12%) WAN
3 2 (0.12%) Wireless
4 1 (0.058%) 3GPP
4 1 (0.058%) 5G
4 1 (0.058%) PPP
4 1 (0.058%) VPN
Database & Business Intelligence
1 573 (33.39%) Data Warehouse
2 422 (24.59%) BigQuery
3 378 (22.03%) Looker
4 264 (15.38%) Power BI
5 252 (14.69%) Data Lake
6 152 (8.86%) SQL Server
7 130 (7.58%) Big Data
8 115 (6.70%) Tableau
9 88 (5.13%) Amazon Redshift
10 73 (4.25%) Hadoop
11 66 (3.85%) Relational Database
12 65 (3.79%) SQL Server Integration Services
13 64 (3.73%) NoSQL
14 56 (3.26%) Azure SQL Database
15 50 (2.91%) Metadata
16 40 (2.33%) Amazon Athena
16 40 (2.33%) SQL Server Reporting Services
17 39 (2.27%) PostgreSQL
17 39 (2.27%) Star Schema
18 38 (2.21%) Elasticsearch
Development Applications
1 77 (4.49%) Git
2 58 (3.38%) Jenkins
3 50 (2.91%) GitLab
4 37 (2.16%) JIRA
5 16 (0.93%) Atlassian Bamboo
6 15 (0.87%) MLflow
7 13 (0.76%) CircleCI
8 12 (0.70%) Spinnaker
9 8 (0.47%) ERwin
10 6 (0.35%) Oracle Forms
11 5 (0.29%) ER Studio
12 4 (0.23%) Bitbucket
12 4 (0.23%) Snakemake
13 3 (0.17%) Deequ
13 3 (0.17%) Octopus Deploy
14 1 (0.058%) Artifactory
14 1 (0.058%) Mockito
14 1 (0.058%) Postman
14 1 (0.058%) SoapUI
14 1 (0.058%) SpecFlow
General
1 513 (29.90%) Analytical Skills
2 289 (16.84%) Finance
3 260 (15.15%) Social Skills
4 254 (14.80%) Inclusion and Diversity
5 94 (5.48%) Law
6 75 (4.37%) Banking
7 72 (4.20%) Billing
8 69 (4.02%) Marketing
9 68 (3.96%) Retail
10 49 (2.86%) Legal
11 40 (2.33%) Presentation Skills
12 39 (2.27%) Games
13 29 (1.69%) Public Sector
14 22 (1.28%) Influencing Skills
15 18 (1.05%) Front Office
16 12 (0.70%) Investment Banking
17 10 (0.58%) Manufacturing
17 10 (0.58%) Pharmaceutical
18 9 (0.52%) Publishing
18 9 (0.52%) Telecoms
Job Titles
1 730 (42.54%) Data Engineer
2 272 (15.85%) Senior
3 211 (12.30%) Architect
4 210 (12.24%) Lead
5 197 (11.48%) Data Manager
6 196 (11.42%) Principal Engineer
7 184 (10.72%) Principal Data Engineer
8 177 (10.31%) Platform Engineer
9 154 (8.97%) Data Architect
10 153 (8.92%) Engineering Manager
11 146 (8.51%) Senior Data Engineer
12 118 (6.88%) Software Engineer
13 82 (4.78%) Azure Engineer
14 80 (4.66%) Lead Data Engineer
15 71 (4.14%) Lead Software Engineer
16 67 (3.90%) Developer
17 62 (3.61%) Azure Data Engineer
18 51 (2.97%) Analyst
19 49 (2.86%) Python Engineer
20 39 (2.27%) Software Architect
Libraries, Frameworks & Software Standards
1 146 (8.51%) PySpark
2 65 (3.79%) Kafka
3 42 (2.45%) React
4 36 (2.10%) Pandas
5 35 (2.04%) AngularJS
6 33 (1.92%) NumPy
7 29 (1.69%) Apache Beam
7 29 (1.69%) TensorFlow
8 25 (1.46%) Spring
9 23 (1.34%) RabbitMQ
10 22 (1.28%) .NET
11 20 (1.17%) ActiveMQ
11 20 (1.17%) RESTful
11 20 (1.17%) YAML
12 19 (1.11%) PyTorch
13 18 (1.05%) Apache NiFi
14 17 (0.99%) Web Services
15 16 (0.93%) Elastic Stack
15 16 (0.93%) Keras
16 14 (0.82%) REST
Miscellaneous
1 315 (18.36%) Self-Motivation
2 116 (6.76%) Cyberattack
3 110 (6.41%) Product Ownership
4 89 (5.19%) Data Structures
5 83 (4.84%) Algorithms
6 74 (4.31%) Cloud Native
7 46 (2.68%) Management Information System
8 37 (2.16%) Onboarding
9 23 (1.34%) Hybrid Cloud
10 21 (1.22%) Greenfield Project
10 21 (1.22%) Reference Data
11 16 (0.93%) Distributed Systems
12 15 (0.87%) Client/Server
12 15 (0.87%) NHS
13 14 (0.82%) IoT
14 13 (0.76%) Taxonomies
15 12 (0.70%) Public Cloud
16 10 (0.58%) Mainframe
17 9 (0.52%) Data Protection Act
17 9 (0.52%) Online Games
Operating Systems
1 42 (2.45%) Linux
2 11 (0.64%) Windows
3 6 (0.35%) Windows Server
4 4 (0.23%) Unix
5 1 (0.058%) Red Hat Enterprise Linux
Processes & Methodologies
1 737 (42.95%) Agile
2 730 (42.54%) Problem-Solving
3 628 (36.60%) ETL
4 610 (35.55%) Data Modelling
5 579 (33.74%) Mentoring
6 559 (32.58%) Analytics
7 526 (30.65%) Data Pipeline
8 495 (28.85%) Data Science
9 441 (25.70%) DevOps
10 421 (24.53%) Machine Learning
11 401 (23.37%) Platform Engineering
12 347 (20.22%) Business Intelligence
13 316 (18.41%) CI/CD
13 316 (18.41%) Data Governance
14 273 (15.91%) Software Engineering
15 271 (15.79%) Data Architecture
16 255 (14.86%) Data Integration
17 253 (14.74%) Visualisation
18 206 (12.00%) DataOps
19 191 (11.13%) Change Management
Programming Languages
1 688 (40.09%) SQL
2 642 (37.41%) Python
3 190 (11.07%) Java
4 80 (4.66%) Scala
5 64 (3.73%) T-SQL
6 52 (3.03%) R
7 37 (2.16%) C#
8 30 (1.75%) MATLAB
9 23 (1.34%) Go
9 23 (1.34%) Shell Script
10 22 (1.28%) Bash
10 22 (1.28%) Data Analysis Expressions
11 15 (0.87%) PowerShell
12 11 (0.64%) C
12 11 (0.64%) JavaScript
13 10 (0.58%) VBA
14 9 (0.52%) Ruby
15 8 (0.47%) C++
15 8 (0.47%) Perl
15 8 (0.47%) TypeScript
Qualifications
1 175 (10.20%) Degree
2 67 (3.90%) Computer Science Degree
2 67 (3.90%) Security Cleared
3 43 (2.51%) DBS Check
4 42 (2.45%) DV Cleared
5 39 (2.27%) Master's Degree
6 29 (1.69%) SC Cleared
7 28 (1.63%) Azure Certification
8 24 (1.40%) Microsoft Certification
9 15 (0.87%) PhD
10 8 (0.47%) PMI Certification
11 7 (0.41%) ISTQB
12 6 (0.35%) MBA
13 4 (0.23%) AWS Certification
14 3 (0.17%) AWS Certified Solutions Architect
14 3 (0.17%) PMP
15 2 (0.12%) MCP
16 1 (0.058%) MCSE
16 1 (0.058%) TOGAF Certification
Quality Assurance & Compliance
1 378 (22.03%) Data Quality
2 299 (17.42%) GDPR
3 108 (6.29%) QA
4 26 (1.52%) Accessibility
5 10 (0.58%) California Consumer Privacy Act
6 4 (0.23%) ISO/IEC 27001
6 4 (0.23%) Solvency II
7 3 (0.17%) Actionable Recommendations
8 2 (0.12%) COBIT
8 2 (0.12%) Cyber Essentials
8 2 (0.12%) PCI DSS
8 2 (0.12%) SLA
9 1 (0.058%) NCSC
9 1 (0.058%) SNOMED CT
System Software
1 75 (4.37%) Docker
2 11 (0.64%) IAG
3 8 (0.47%) HDFS
4 4 (0.23%) Active Directory
4 4 (0.23%) Virtual Machines
5 2 (0.12%) Apache ZooKeeper
Systems Management
1 111 (6.47%) Kubernetes
2 101 (5.89%) Terraform
3 36 (2.10%) Ansible
4 16 (0.93%) Grafana
4 16 (0.93%) HAProxy
4 16 (0.93%) Prometheus
5 7 (0.41%) SysTrack
6 5 (0.29%) logstash
7 3 (0.17%) Argo
7 3 (0.17%) Kubeflow
8 2 (0.12%) Oozie
9 1 (0.058%) Podman
9 1 (0.058%) Progress Chef
9 1 (0.058%) Puppet
Vendors
1 440 (25.64%) Google
2 244 (14.22%) Databricks
3 176 (10.26%) Microsoft
4 73 (4.25%) Oracle
5 29 (1.69%) Informatica
6 24 (1.40%) Teradata
7 19 (1.11%) Cloudera
8 10 (0.58%) Alteryx
9 8 (0.47%) Samsung
9 8 (0.47%) SAP
10 7 (0.41%) Dataiku
10 7 (0.41%) ServiceNow
10 7 (0.41%) Snow
11 6 (0.35%) F5
11 6 (0.35%) SnapLogic
12 5 (0.29%) OpenAI
12 5 (0.29%) Salesforce
13 4 (0.23%) Ab Initio
13 4 (0.23%) Dell
13 4 (0.23%) Talend