Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 10 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
10 May 2024
Same period 2023 Same period 2022
Rank 183 127 169
Rank change year-on-year -56 +42 +91
Permanent jobs citing Data Engineering 1,584 2,797 3,783
As % of all permanent jobs advertised in the UK 1.60% 2.77% 2.41%
As % of the Processes & Methodologies category 1.87% 2.90% 2.51%
Number of salaries quoted 905 1,210 1,483
10th Percentile £41,492 £46,250 £47,500
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,750 £97,500 £90,000
90th Percentile £105,000 £130,000 £108,750
UK excluding London median annual salary £63,500 £60,249 £65,000
% change year-on-year +5.40% -7.31% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 84,917 96,578 150,488
As % of all permanent jobs advertised in the UK 85.59% 95.61% 95.67%
Number of salaries quoted 59,883 56,844 82,330
10th Percentile £29,008 £34,000 £33,515
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,190 £60,000
Median % change year-on-year -10.12% +1.98% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 10 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 10 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -50 1,395 £70,000 -6.67% 321
UK excluding London -49 1,042 £63,500 +5.40% 144
Work from Home -90 568 £70,000 - 173
London -67 474 £82,500 -5.71% 185
North of England -42 317 £60,000 - 41
South East +30 202 £67,500 -3.57% 25
Midlands -47 177 £59,300 +6.85% 28
North West -40 173 £55,000 +4.76% 23
South West -12 154 £75,000 +24.48% 21
Scotland -28 121 £70,000 +3.70% 11
West Midlands -53 112 £61,616 +10.03% 23
Yorkshire -39 90 £65,066 +0.10% 7
East Midlands -1 64 £43,750 -20.45% 5
North East +18 54 £75,000 +11.11% 11
East of England -38 43 £70,000 +21.74% 12
Wales -5 19 £97,500 +118.29% 5
Northern Ireland +23 9 £55,000 - 6

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 174 (10.98%) Apache Spark
2 101 (6.38%) Apache
3 90 (5.68%) Apache Airflow
4 28 (1.77%) Confluence
5 24 (1.52%) SAS
6 20 (1.26%) Jupyter
7 17 (1.07%) nginx
8 3 (0.19%) Apache Pulsar
9 2 (0.13%) Luigi
9 2 (0.13%) SharePoint
Applications
1 27 (1.70%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 4 (0.25%) Microsoft Office
4 3 (0.19%) MS Visio
4 3 (0.19%) SPSS
Business Applications
1 3 (0.19%) Dynamics CRM
2 1 (0.063%) NetSuite
2 1 (0.063%) SAP ERP
Cloud Services
1 720 (45.45%) Azure
2 570 (35.98%) GCP
3 564 (35.61%) AWS
4 254 (16.04%) Power Platform
5 178 (11.24%) Azure Data Factory
6 147 (9.28%) Azure DevOps
7 140 (8.84%) Snowflake
8 128 (8.08%) Azure Synapse Analytics
9 99 (6.25%) Amazon S3
10 82 (5.18%) dbt
11 57 (3.60%) Azure Cosmos DB
12 54 (3.41%) Serverless
13 49 (3.09%) GitHub
14 39 (2.46%) AWS Lambda
15 37 (2.34%) SaaS
16 32 (2.02%) Matillion
17 28 (1.77%) Amazon EC2
17 28 (1.77%) Amazon Kinesis
18 19 (1.20%) Cloud Computing
19 18 (1.14%) GitHub Actions
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.32%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) VPN
Database & Business Intelligence
1 571 (36.05%) Data Warehouse
2 423 (26.70%) BigQuery
3 374 (23.61%) Looker
4 252 (15.91%) Power BI
5 237 (14.96%) Data Lake
6 150 (9.47%) SQL Server
7 122 (7.70%) Big Data
8 108 (6.82%) Tableau
9 84 (5.30%) Amazon Redshift
10 76 (4.80%) Hadoop
11 67 (4.23%) Relational Database
11 67 (4.23%) SQL Server Integration Services
12 59 (3.72%) NoSQL
13 55 (3.47%) Metadata
14 50 (3.16%) Azure SQL Database
15 43 (2.71%) Star Schema
16 40 (2.53%) PostgreSQL
16 40 (2.53%) SQL Server Reporting Services
17 38 (2.40%) Elasticsearch
18 33 (2.08%) MySQL
Development Applications
1 74 (4.67%) Git
2 65 (4.10%) Jenkins
3 50 (3.16%) GitLab
4 36 (2.27%) JIRA
5 17 (1.07%) Atlassian Bamboo
6 14 (0.88%) CircleCI
7 13 (0.82%) MLflow
7 13 (0.82%) Spinnaker
8 9 (0.57%) ERwin
9 6 (0.38%) Oracle Forms
10 5 (0.32%) ER Studio
11 4 (0.25%) Bitbucket
11 4 (0.25%) Snakemake
12 3 (0.19%) Deequ
12 3 (0.19%) Octopus Deploy
12 3 (0.19%) Visual Studio
13 1 (0.063%) JMeter
13 1 (0.063%) JUnit
13 1 (0.063%) Postman
13 1 (0.063%) Toad
General
1 505 (31.88%) Analytical Skills
2 295 (18.62%) Finance
3 266 (16.79%) Social Skills
4 140 (8.84%) Inclusion and Diversity
5 97 (6.12%) Law
6 80 (5.05%) Banking
7 75 (4.73%) Marketing
8 72 (4.55%) Billing
9 63 (3.98%) Retail
10 45 (2.84%) Legal
11 41 (2.59%) Presentation Skills
12 39 (2.46%) Games
13 37 (2.34%) Public Sector
14 22 (1.39%) Influencing Skills
15 13 (0.82%) Manufacturing
15 13 (0.82%) Retail Banking
15 13 (0.82%) Telecoms
16 12 (0.76%) Investment Banking
17 11 (0.69%) Front Office
18 10 (0.63%) Electronics
Job Titles
1 727 (45.90%) Data Engineer
2 268 (16.92%) Senior
3 202 (12.75%) Data Manager
4 194 (12.25%) Principal Engineer
5 182 (11.49%) Principal Data Engineer
6 175 (11.05%) Lead
6 175 (11.05%) Platform Engineer
7 170 (10.73%) Architect
8 156 (9.85%) Engineering Manager
9 153 (9.66%) Data Architect
10 143 (9.03%) Senior Data Engineer
11 80 (5.05%) Software Engineer
12 79 (4.99%) Azure Engineer
12 79 (4.99%) Lead Data Engineer
13 62 (3.91%) Azure Data Engineer
14 56 (3.54%) Developer
15 46 (2.90%) Analyst
16 44 (2.78%) Python Engineer
17 40 (2.53%) Senior Software Engineer
18 38 (2.40%) Head of Engineering
Libraries, Frameworks & Software Standards
1 133 (8.40%) PySpark
2 62 (3.91%) Kafka
3 41 (2.59%) React
4 35 (2.21%) AngularJS
5 32 (2.02%) Apache Beam
6 31 (1.96%) Pandas
7 27 (1.70%) NumPy
7 27 (1.70%) TensorFlow
8 25 (1.58%) Spring
9 23 (1.45%) RESTful
10 21 (1.33%) RabbitMQ
10 21 (1.33%) YAML
11 20 (1.26%) ActiveMQ
11 20 (1.26%) Apache NiFi
12 19 (1.20%) PyTorch
13 18 (1.14%) .NET
13 18 (1.14%) Elastic Stack
14 17 (1.07%) Web Services
15 14 (0.88%) Keras
15 14 (0.88%) REST
Miscellaneous
1 315 (19.89%) Self-Motivation
2 116 (7.32%) Product Ownership
3 84 (5.30%) Data Structures
4 78 (4.92%) Algorithms
5 77 (4.86%) Cloud Native
6 44 (2.78%) Management Information System
7 32 (2.02%) Onboarding
8 24 (1.52%) Greenfield Project
8 24 (1.52%) Hybrid Cloud
9 20 (1.26%) Reference Data
10 16 (1.01%) Distributed Systems
10 16 (1.01%) IoT
11 15 (0.95%) Client/Server
11 15 (0.95%) Public Cloud
11 15 (0.95%) Taxonomies
12 14 (0.88%) NHS
13 10 (0.63%) Mainframe
14 9 (0.57%) Data Protection Act
14 9 (0.57%) Online Games
15 8 (0.51%) Renewable Energy
Operating Systems
1 40 (2.53%) Linux
2 10 (0.63%) Windows
3 5 (0.32%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 638 (40.28%) ETL
2 619 (39.08%) Agile
3 609 (38.45%) Problem-Solving
4 601 (37.94%) Data Modelling
5 549 (34.66%) Analytics
6 510 (32.20%) Data Pipeline
7 492 (31.06%) Data Science
8 455 (28.72%) Mentoring
9 448 (28.28%) DevOps
10 399 (25.19%) Platform Engineering
11 337 (21.28%) Business Intelligence
12 309 (19.51%) CI/CD
13 308 (19.44%) Data Governance
14 296 (18.69%) Machine Learning
15 268 (16.92%) Data Architecture
16 253 (15.97%) Visualisation
17 252 (15.91%) Data Integration
18 200 (12.63%) DataOps
19 190 (11.99%) Change Management
20 179 (11.30%) Artificial Intelligence
Programming Languages
1 677 (42.74%) SQL
2 634 (40.03%) Python
3 178 (11.24%) Java
4 79 (4.99%) Scala
5 64 (4.04%) T-SQL
6 48 (3.03%) R
7 33 (2.08%) C#
8 27 (1.70%) MATLAB
9 24 (1.52%) Bash
9 24 (1.52%) Go
10 23 (1.45%) Shell Script
11 19 (1.20%) Data Analysis Expressions
11 19 (1.20%) PowerShell
12 12 (0.76%) TypeScript
13 11 (0.69%) C
14 10 (0.63%) Kusto Query Language
14 10 (0.63%) VBA
15 9 (0.57%) Ruby
16 8 (0.51%) JavaScript
16 8 (0.51%) PL/SQL
Qualifications
1 167 (10.54%) Degree
2 70 (4.42%) Security Cleared
3 65 (4.10%) Computer Science Degree
4 42 (2.65%) DV Cleared
5 40 (2.53%) DBS Check
6 35 (2.21%) Master's Degree
7 33 (2.08%) Azure Certification
8 30 (1.89%) SC Cleared
9 23 (1.45%) Microsoft Certification
10 16 (1.01%) PhD
11 8 (0.51%) PMI Certification
12 6 (0.38%) MBA
12 6 (0.38%) OCP
12 6 (0.38%) Oracle Certification
13 4 (0.25%) AWS Certification
13 4 (0.25%) ISTQB
14 3 (0.19%) AWS Certified Solutions Architect
14 3 (0.19%) PMP
15 2 (0.13%) MCP
16 1 (0.063%) MCSE
Quality Assurance & Compliance
1 367 (23.17%) Data Quality
2 298 (18.81%) GDPR
3 109 (6.88%) QA
4 23 (1.45%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 4 (0.25%) ISO/IEC 27001
6 4 (0.25%) Solvency II
7 3 (0.19%) SLA
8 2 (0.13%) Actionable Recommendations
8 2 (0.13%) COBIT
8 2 (0.13%) Cyber Essentials
8 2 (0.13%) PCI DSS
9 1 (0.063%) NCSC
9 1 (0.063%) SNOMED CT
System Software
1 73 (4.61%) Docker
2 11 (0.69%) IAG
3 9 (0.57%) HDFS
4 2 (0.13%) Active Directory
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
4 2 (0.13%) Virtual Machines
Systems Management
1 107 (6.76%) Kubernetes
2 95 (6.00%) Terraform
3 34 (2.15%) Ansible
4 17 (1.07%) Grafana
4 17 (1.07%) HAProxy
4 17 (1.07%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.32%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
9 1 (0.063%) Rancher
Vendors
1 439 (27.71%) Google
2 232 (14.65%) Databricks
3 175 (11.05%) Microsoft
4 69 (4.36%) Oracle
5 31 (1.96%) Informatica
6 24 (1.52%) Teradata
7 19 (1.20%) Cloudera
8 13 (0.82%) SAP
9 9 (0.57%) Alteryx
10 8 (0.51%) Samsung
11 7 (0.44%) Dataiku
11 7 (0.44%) ServiceNow
11 7 (0.44%) SnapLogic
11 7 (0.44%) Snow
12 6 (0.38%) F5
13 5 (0.32%) Dell
13 5 (0.32%) OpenAI
14 4 (0.25%) Ab Initio
14 4 (0.25%) IBM
14 4 (0.25%) Talend