Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 3 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
3 May 2024
Same period 2023 Same period 2022
Rank 184 126 172
Rank change year-on-year -58 +46 +85
Permanent jobs citing Data Engineering 1,586 2,846 3,694
As % of all permanent jobs advertised in the UK 1.61% 2.74% 2.36%
As % of the Processes & Methodologies category 1.87% 2.87% 2.47%
Number of salaries quoted 903 1,234 1,507
10th Percentile £41,492 £47,063 £47,500
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,500 £97,500 £90,000
90th Percentile £106,965 £130,000 £108,000
UK excluding London median annual salary £65,000 £61,180 £65,000
% change year-on-year +6.24% -5.88% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 84,746 99,225 149,638
As % of all permanent jobs advertised in the UK 85.94% 95.61% 95.61%
Number of salaries quoted 59,834 58,281 83,297
10th Percentile £29,000 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,500 £60,000
Median % change year-on-year -10.57% +2.50% +9.09%
75th Percentile £72,500 £81,750 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 3 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 3 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -54 1,396 £70,000 -8.36% 314
UK excluding London -41 1,048 £65,000 +6.24% 140
Work from Home -83 568 £70,000 - 171
London -62 471 £82,500 -8.33% 172
North of England -38 323 £60,000 -0.97% 36
South East +33 203 £67,500 -3.57% 30
North West -33 178 £55,000 - 23
Midlands -38 167 £57,500 +4.55% 30
South West -18 156 £75,000 +20.00% 21
Scotland -36 121 £70,000 +3.70% 10
West Midlands -57 105 £60,733 +8.45% 20
Yorkshire -40 91 £65,066 -0.44% 7
East Midlands +6 61 £41,996 -23.64% 10
North East +20 54 £75,000 +11.11% 6
East of England -35 49 £70,000 +21.74% 11
Wales -4 20 £97,500 +118.29% 5
Northern Ireland +30 9 £55,000 - 2

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 178 (11.22%) Apache Spark
2 110 (6.94%) Apache
3 88 (5.55%) Apache Airflow
4 27 (1.70%) Confluence
5 21 (1.32%) SAS
6 20 (1.26%) Jupyter
7 17 (1.07%) nginx
8 2 (0.13%) Apache Pulsar
8 2 (0.13%) Luigi
8 2 (0.13%) SharePoint
Applications
1 28 (1.77%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 3 (0.19%) Microsoft Office
3 3 (0.19%) MS Visio
3 3 (0.19%) SPSS
Business Applications
1 4 (0.25%) Dynamics CRM
2 1 (0.063%) NetSuite
Cloud Services
1 713 (44.96%) Azure
2 571 (36.00%) GCP
3 568 (35.81%) AWS
4 256 (16.14%) Power Platform
5 177 (11.16%) Azure Data Factory
6 146 (9.21%) Azure DevOps
7 138 (8.70%) Snowflake
8 127 (8.01%) Azure Synapse Analytics
9 99 (6.24%) Amazon S3
10 81 (5.11%) dbt
11 59 (3.72%) Serverless
12 55 (3.47%) Azure Cosmos DB
13 52 (3.28%) GitHub
14 43 (2.71%) AWS Lambda
15 35 (2.21%) SaaS
16 32 (2.02%) Matillion
17 31 (1.95%) Amazon Kinesis
18 26 (1.64%) Amazon EC2
19 22 (1.39%) GitHub Actions
20 19 (1.20%) Cloud Computing
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.32%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) SMS
5 1 (0.063%) VPN
Database & Business Intelligence
1 560 (35.31%) Data Warehouse
2 426 (26.86%) BigQuery
3 378 (23.83%) Looker
4 254 (16.02%) Power BI
5 240 (15.13%) Data Lake
6 150 (9.46%) SQL Server
7 126 (7.94%) Big Data
8 112 (7.06%) Tableau
9 84 (5.30%) Amazon Redshift
10 80 (5.04%) Hadoop
11 71 (4.48%) Relational Database
12 68 (4.29%) SQL Server Integration Services
13 62 (3.91%) NoSQL
14 49 (3.09%) Azure SQL Database
15 48 (3.03%) Metadata
16 44 (2.77%) PostgreSQL
17 43 (2.71%) Star Schema
18 42 (2.65%) SQL Server Reporting Services
19 38 (2.40%) Elasticsearch
19 38 (2.40%) MySQL
Development Applications
1 74 (4.67%) Git
2 68 (4.29%) Jenkins
3 50 (3.15%) GitLab
4 35 (2.21%) JIRA
5 17 (1.07%) Atlassian Bamboo
6 14 (0.88%) CircleCI
7 12 (0.76%) MLflow
7 12 (0.76%) Spinnaker
8 10 (0.63%) ERwin
9 6 (0.38%) Oracle Forms
10 5 (0.32%) ER Studio
11 4 (0.25%) Bitbucket
11 4 (0.25%) Snakemake
12 3 (0.19%) Deequ
12 3 (0.19%) Octopus Deploy
12 3 (0.19%) Visual Studio
13 2 (0.13%) SQL Server Management Studio (SSMS)
14 1 (0.063%) Artifactory
14 1 (0.063%) Mockito
14 1 (0.063%) SoapUI
General
1 499 (31.46%) Analytical Skills
2 297 (18.73%) Finance
3 271 (17.09%) Social Skills
4 136 (8.58%) Inclusion and Diversity
5 93 (5.86%) Law
6 86 (5.42%) Banking
7 76 (4.79%) Marketing
8 72 (4.54%) Billing
9 67 (4.22%) Retail
10 43 (2.71%) Legal
11 42 (2.65%) Presentation Skills
12 39 (2.46%) Games
13 38 (2.40%) Public Sector
14 22 (1.39%) Influencing Skills
15 13 (0.82%) Front Office
15 13 (0.82%) Telecoms
16 12 (0.76%) Investment Banking
16 12 (0.76%) Retail Banking
17 10 (0.63%) Electronics
17 10 (0.63%) Manufacturing
Job Titles
1 727 (45.84%) Data Engineer
2 261 (16.46%) Senior
3 199 (12.55%) Data Manager
4 193 (12.17%) Principal Engineer
5 183 (11.54%) Lead
6 181 (11.41%) Principal Data Engineer
7 175 (11.03%) Platform Engineer
8 173 (10.91%) Architect
9 156 (9.84%) Data Architect
10 154 (9.71%) Engineering Manager
11 138 (8.70%) Senior Data Engineer
12 83 (5.23%) Lead Data Engineer
13 78 (4.92%) Software Engineer
14 75 (4.73%) Azure Engineer
15 58 (3.66%) Azure Data Engineer
16 57 (3.59%) Developer
17 48 (3.03%) Analyst
18 45 (2.84%) Python Engineer
19 40 (2.52%) Head of Engineering
19 40 (2.52%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 128 (8.07%) PySpark
2 69 (4.35%) Kafka
3 41 (2.59%) React
4 35 (2.21%) AngularJS
4 35 (2.21%) Pandas
5 34 (2.14%) Apache Beam
6 29 (1.83%) NumPy
7 27 (1.70%) TensorFlow
8 25 (1.58%) Spring
9 23 (1.45%) RESTful
10 21 (1.32%) YAML
11 20 (1.26%) Apache NiFi
12 19 (1.20%) ActiveMQ
12 19 (1.20%) PyTorch
12 19 (1.20%) RabbitMQ
13 18 (1.13%) Elastic Stack
14 17 (1.07%) .NET
14 17 (1.07%) Web Services
15 14 (0.88%) Keras
15 14 (0.88%) REST
Miscellaneous
1 316 (19.92%) Self-Motivation
2 117 (7.38%) Product Ownership
3 80 (5.04%) Data Structures
4 78 (4.92%) Algorithms
5 76 (4.79%) Cloud Native
6 44 (2.77%) Management Information System
7 29 (1.83%) Onboarding
8 24 (1.51%) Greenfield Project
8 24 (1.51%) Hybrid Cloud
9 19 (1.20%) Reference Data
10 18 (1.13%) Distributed Systems
11 17 (1.07%) Public Cloud
12 16 (1.01%) IoT
12 16 (1.01%) Taxonomies
13 15 (0.95%) Client/Server
14 13 (0.82%) NHS
15 10 (0.63%) Data Protection Act
15 10 (0.63%) Mainframe
16 9 (0.57%) Online Games
17 8 (0.50%) Distributed Applications
Operating Systems
1 38 (2.40%) Linux
2 11 (0.69%) Windows
3 5 (0.32%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 644 (40.61%) ETL
2 625 (39.41%) Agile
3 607 (38.27%) Problem-Solving
4 593 (37.39%) Data Modelling
5 548 (34.55%) Analytics
6 519 (32.72%) Data Pipeline
7 496 (31.27%) Data Science
8 455 (28.69%) Mentoring
9 451 (28.44%) DevOps
10 400 (25.22%) Platform Engineering
11 331 (20.87%) Business Intelligence
12 309 (19.48%) CI/CD
13 301 (18.98%) Data Governance
14 300 (18.92%) Machine Learning
15 270 (17.02%) Data Architecture
16 254 (16.02%) Data Integration
16 254 (16.02%) Visualisation
17 200 (12.61%) DataOps
18 190 (11.98%) Change Management
19 184 (11.60%) Artificial Intelligence
Programming Languages
1 671 (42.31%) SQL
2 632 (39.85%) Python
3 175 (11.03%) Java
4 83 (5.23%) Scala
5 63 (3.97%) T-SQL
6 45 (2.84%) R
7 33 (2.08%) C#
8 26 (1.64%) MATLAB
9 25 (1.58%) Bash
10 23 (1.45%) Go
10 23 (1.45%) Shell Script
11 19 (1.20%) PowerShell
12 18 (1.13%) Data Analysis Expressions
13 12 (0.76%) TypeScript
14 11 (0.69%) C
15 10 (0.63%) Kusto Query Language
15 10 (0.63%) VBA
16 9 (0.57%) Perl
16 9 (0.57%) Ruby
17 8 (0.50%) JavaScript
Qualifications
1 169 (10.66%) Degree
2 72 (4.54%) Security Cleared
3 69 (4.35%) Computer Science Degree
4 43 (2.71%) DV Cleared
5 38 (2.40%) Master's Degree
6 37 (2.33%) DBS Check
7 32 (2.02%) Azure Certification
8 31 (1.95%) SC Cleared
9 22 (1.39%) Microsoft Certification
10 16 (1.01%) PhD
11 8 (0.50%) PMI Certification
12 6 (0.38%) MBA
12 6 (0.38%) OCP
12 6 (0.38%) Oracle Certification
13 4 (0.25%) AWS Certification
13 4 (0.25%) ISTQB
14 3 (0.19%) AWS Certified Solutions Architect
14 3 (0.19%) PMP
15 2 (0.13%) MCP
16 1 (0.063%) MCSE
Quality Assurance & Compliance
1 358 (22.57%) Data Quality
2 297 (18.73%) GDPR
3 109 (6.87%) QA
4 21 (1.32%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 5 (0.32%) ISO/IEC 27001
7 4 (0.25%) Solvency II
8 3 (0.19%) SLA
9 2 (0.13%) COBIT
9 2 (0.13%) Cyber Essentials
9 2 (0.13%) PCI DSS
10 1 (0.063%) Actionable Recommendations
10 1 (0.063%) HIPAA
10 1 (0.063%) NCSC
10 1 (0.063%) SNOMED CT
System Software
1 73 (4.60%) Docker
2 11 (0.69%) IAG
3 9 (0.57%) HDFS
4 2 (0.13%) Active Directory
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
4 2 (0.13%) Virtual Machines
Systems Management
1 104 (6.56%) Kubernetes
2 98 (6.18%) Terraform
3 34 (2.14%) Ansible
4 17 (1.07%) Grafana
4 17 (1.07%) HAProxy
4 17 (1.07%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.32%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
9 1 (0.063%) Rancher
Vendors
1 443 (27.93%) Google
2 229 (14.44%) Databricks
3 172 (10.84%) Microsoft
4 64 (4.04%) Oracle
5 28 (1.77%) Informatica
6 24 (1.51%) Teradata
7 19 (1.20%) Cloudera
8 13 (0.82%) SAP
9 10 (0.63%) Alteryx
10 8 (0.50%) IBM
10 8 (0.50%) Samsung
10 8 (0.50%) ServiceNow
11 7 (0.44%) Dataiku
11 7 (0.44%) Snow
12 6 (0.38%) F5
12 6 (0.38%) SnapLogic
13 5 (0.32%) Dell
13 5 (0.32%) OpenAI
13 5 (0.32%) Talend
14 3 (0.19%) Embarcadero