Data Engineering Contracts

Data Engineering
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 210 210 239
Rank change year-on-year 0 +29 -20
Contract jobs citing Data Engineering 486 703 1,075
As % of all contract jobs advertised in the UK 1.13% 1.25% 1.23%
As % of the Processes & Methodologies category 1.32% 1.40% 1.35%
Number of daily rates quoted 365 467 755
10th Percentile £363 £463 £456
25th Percentile £460 £513 £508
Median daily rate (50th Percentile) £550 £600 £575
Median % change year-on-year -8.33% +4.35% +4.55%
75th Percentile £650 £738 £688
90th Percentile £750 £805 £795
UK excluding London median daily rate £533 £550 £556
% change year-on-year -3.18% -1.12% +11.25%
Number of hourly rates quoted 15 25 4
10th Percentile £30.72 £19.00 £30.89
25th Percentile £31.25 £20.47 £47.35
Median hourly rate £35.00 £73.00 £59.00
Median % change year-on-year -52.05% +23.73% +112.77%
75th Percentile £60.00 £78.00 £71.29
90th Percentile - £90.00 £83.06
UK excluding London median hourly rate £60.00 £73.00 £38.21
% change year-on-year -17.81% +91.07% +44.91%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 36,802 50,277 79,372
As % of all contract IT jobs advertised in the UK 85.47% 89.69% 90.61%
Number of daily rates quoted 23,632 34,811 55,790
10th Percentile £300 £325 £345
25th Percentile £413 £438 £431
Median daily rate (50th Percentile) £525 £550 £538
Median % change year-on-year -4.55% +2.33% +7.50%
75th Percentile £638 £650 £644
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £488
% change year-on-year - +2.56% +9.18%
Number of hourly rates quoted 2,530 1,673 1,868
10th Percentile £12.75 £10.63 £12.50
25th Percentile £16.00 £15.72 £15.63
Median hourly rate £36.50 £36.25 £25.68
Median % change year-on-year +0.69% +41.16% +9.74%
75th Percentile £60.75 £65.00 £50.00
90th Percentile £72.50 £75.00 £65.00
UK excluding London median hourly rate £38.12 £35.00 £20.00
% change year-on-year +8.91% +75.00% -4.76%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineering.

Daily rate trend for Data Engineering in the UK

Data Engineering
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineering over the 6 months to 1 June 2024.

Daily rate histogram for Data Engineering in the UK

Data Engineering
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineering.

Hourly rate trend for Data Engineering in the UK

Data Engineering
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineering over the 6 months to 1 June 2024.

Hourly rate histogram for Data Engineering in the UK

Data Engineering
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the UK over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -14 422 £560 -10.40% 412
London -14 255 £580 -7.20% 241
Work from Home +33 186 £550 -8.33% 186
UK excluding London +27 162 £533 -3.18% 182
North of England +30 52 £515 -14.17% 69
Midlands +46 42 £600 +9.09% 30
South East -18 35 £511 -13.02% 41
North West +25 30 £510 -6.85% 47
West Midlands +28 29 £650 +18.18% 19
Yorkshire +22 21 £600 -4.00% 16
Scotland +36 13 £453 -8.02% 13
East Midlands +21 13 £550 -4.35% 11
East of England +7 10 £613 +25.64% 7
South West -10 9 £450 -35.71% 18
Wales +16 1 £550 - 3
North East +10 1 £431 -28.17% 6

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 60 (12.35%) Apache Spark
2 56 (11.52%) Apache Airflow
3 48 (9.88%) Apache
4 6 (1.23%) Confluence
5 3 (0.62%) ArcGIS
6 1 (0.21%) Apache Pulsar
6 1 (0.21%) BizTalk Server
6 1 (0.21%) SAS
Applications
1 9 (1.85%) Microsoft Excel
2 3 (0.62%) Sketch
3 2 (0.41%) Microsoft PowerPoint
4 1 (0.21%) AutoCAD
4 1 (0.21%) Spreadsheet
Business Applications
1 2 (0.41%) Markit EDM
2 1 (0.21%) Oracle ERP
2 1 (0.21%) Oracle General Ledger
2 1 (0.21%) SAP ERP
2 1 (0.21%) SAP GRC
2 1 (0.21%) Shopify
Cloud Services
1 203 (41.77%) Azure
2 165 (33.95%) AWS
3 77 (15.84%) GCP
4 61 (12.55%) Power Platform
5 60 (12.35%) Azure Data Factory
6 56 (11.52%) Snowflake
7 52 (10.70%) Serverless
8 42 (8.64%) Azure Synapse Analytics
9 38 (7.82%) Amazon S3
10 33 (6.79%) dbt
11 30 (6.17%) AWS Lambda
12 24 (4.94%) Amazon EMR
13 23 (4.73%) GitHub
14 22 (4.53%) Azure DevOps
15 19 (3.91%) Azure Functions
16 16 (3.29%) Amazon EC2
17 13 (2.67%) GitHub Actions
18 12 (2.47%) Amazon Kinesis
18 12 (2.47%) Azure Logic Apps
18 12 (2.47%) Cloud Computing
Communications & Networking
1 20 (4.12%) Network Security
2 18 (3.70%) Intrusion Detection
3 15 (3.09%) TCP/IP
4 13 (2.67%) SAN
5 5 (1.03%) FTP
6 2 (0.41%) BGP
6 2 (0.41%) Cisco ASA
6 2 (0.41%) Cisco Nexus
6 2 (0.41%) DHCP
6 2 (0.41%) DNS
6 2 (0.41%) HTTP
6 2 (0.41%) OSPF
6 2 (0.41%) SNMP
7 1 (0.21%) AMQP
7 1 (0.21%) DMZ
7 1 (0.21%) Firewall
7 1 (0.21%) Internet
7 1 (0.21%) Modbus
7 1 (0.21%) MQTT
7 1 (0.21%) SSL
Database & Business Intelligence
1 121 (24.90%) Data Warehouse
2 90 (18.52%) Data Lake
3 82 (16.87%) Big Data
4 61 (12.55%) Power BI
5 33 (6.79%) Amazon Redshift
6 32 (6.58%) Azure SQL Database
6 32 (6.58%) SQL Server
7 29 (5.97%) BigQuery
8 26 (5.35%) Amazon Athena
9 23 (4.73%) Tableau
10 22 (4.53%) NoSQL
11 20 (4.12%) Delta Lake
11 20 (4.12%) Hadoop
11 20 (4.12%) Metadata
12 18 (3.70%) Flink
13 16 (3.29%) Spark SQL
14 13 (2.67%) Relational Database
14 13 (2.67%) SQL Server Integration Services
15 11 (2.26%) PostgreSQL
16 8 (1.65%) SQL Server Analysis Services
Development Applications
1 33 (6.79%) JIRA
2 31 (6.38%) Git
3 8 (1.65%) Jenkins
4 3 (0.62%) IntelliJ
4 3 (0.62%) SonarQube
5 2 (0.41%) Bitbucket
5 2 (0.41%) MLflow
5 2 (0.41%) Zephyr
6 1 (0.21%) Atlassian Bamboo
6 1 (0.21%) Deequ
6 1 (0.21%) GitLab
6 1 (0.21%) Maven
6 1 (0.21%) Visual Studio
General
1 94 (19.34%) Social Skills
2 85 (17.49%) Analytical Skills
3 76 (15.64%) Finance
4 38 (7.82%) Public Sector
5 26 (5.35%) Banking
6 21 (4.32%) Pharmaceutical
7 17 (3.50%) Retail
8 14 (2.88%) Marketing
9 10 (2.06%) Manufacturing
10 6 (1.23%) Front Office
10 6 (1.23%) Influencing Skills
10 6 (1.23%) Telecoms
11 4 (0.82%) Inclusion and Diversity
11 4 (0.82%) Investment Banking
11 4 (0.82%) Legal
12 3 (0.62%) Aerospace
12 3 (0.62%) Electronics
12 3 (0.62%) Law
12 3 (0.62%) Presentation Skills
13 2 (0.41%) Health Technology
Job Titles
1 238 (48.97%) Data Engineer
2 63 (12.96%) Developer
3 55 (11.32%) Azure Engineer
4 49 (10.08%) Senior
5 48 (9.88%) Lead
6 44 (9.05%) Azure Data Engineer
7 37 (7.61%) AWS Engineer
8 34 (7.00%) Senior Data Engineer
9 28 (5.76%) Python Developer
10 27 (5.56%) AWS Data Engineer
11 26 (5.35%) Analyst
11 26 (5.35%) Architect
12 21 (4.32%) Snowflake Engineer
13 20 (4.12%) Data Architect
14 19 (3.91%) Consultant
15 18 (3.70%) Lead Data Engineer
15 18 (3.70%) Python Engineer
16 16 (3.29%) Snowflake Data Engineer
17 13 (2.67%) Python Data Engineer
18 12 (2.47%) Data Analyst
Libraries, Frameworks & Software Standards
1 79 (16.26%) PySpark
2 49 (10.08%) Kafka
3 23 (4.73%) Apache NiFi
4 14 (2.88%) .NET
5 13 (2.67%) XML
6 10 (2.06%) PyTorch
6 10 (2.06%) RESTful
7 9 (1.85%) JSON
8 8 (1.65%) FastAPI
8 8 (1.65%) TensorFlow
9 7 (1.44%) Flask
9 7 (1.44%) Pandas
9 7 (1.44%) React
10 5 (1.03%) AngularJS
10 5 (1.03%) Hugging Face
10 5 (1.03%) LangChain
10 5 (1.03%) NumPy
10 5 (1.03%) SciPy
11 4 (0.82%) .NET Core
11 4 (0.82%) Node.js
Miscellaneous
1 18 (3.70%) Cyber Defence
1 18 (3.70%) Distributed Applications
2 16 (3.29%) Management Information System
3 15 (3.09%) Data Structures
4 13 (2.67%) Product Ownership
5 12 (2.47%) Distributed Systems
6 9 (1.85%) Algorithms
6 9 (1.85%) Cloud Native
7 5 (1.03%) Reference Data
7 5 (1.03%) Smart Meter
7 5 (1.03%) Virtual Team
8 4 (0.82%) Biopharmaceutical
8 4 (0.82%) Data Protection Act
8 4 (0.82%) Distributed Computing
8 4 (0.82%) FMCG
8 4 (0.82%) Onboarding
8 4 (0.82%) Team-Oriented Environment
9 3 (0.62%) Fixed Income
9 3 (0.62%) Life Science
9 3 (0.62%) Replication
Operating Systems
1 36 (7.41%) Linux
2 22 (4.53%) Windows
3 21 (4.32%) Unix
4 16 (3.29%) Android
4 16 (3.29%) Apple iOS
5 13 (2.67%) Debian
5 13 (2.67%) Ubuntu
6 1 (0.21%) Windows Server
Processes & Methodologies
1 172 (35.39%) Analytics
1 172 (35.39%) Data Pipeline
2 165 (33.95%) Data Modelling
3 164 (33.74%) ETL
4 137 (28.19%) Agile
5 100 (20.58%) DevOps
6 88 (18.11%) Business Intelligence
7 86 (17.70%) CI/CD
8 72 (14.81%) Data Science
9 70 (14.40%) Problem-Solving
10 59 (12.14%) Data Management
11 56 (11.52%) Data Governance
11 56 (11.52%) Visualisation
12 50 (10.29%) Data Analysis
13 49 (10.08%) Data Integration
14 47 (9.67%) Computer Science
15 43 (8.85%) Machine Learning
16 41 (8.44%) Data Visualisation
16 41 (8.44%) Software Engineering
17 39 (8.02%) Data Architecture
Programming Languages
1 253 (52.06%) Python
2 236 (48.56%) SQL
3 53 (10.91%) Java
4 52 (10.70%) Scala
5 19 (3.91%) C#
6 14 (2.88%) JavaScript
7 13 (2.67%) T-SQL
8 10 (2.06%) R
9 9 (1.85%) PowerShell
10 7 (1.44%) TypeScript
11 5 (1.03%) Data Analysis Expressions
11 5 (1.03%) Perl
12 4 (0.82%) C++
12 4 (0.82%) Kusto Query Language
12 4 (0.82%) PL/SQL
13 3 (0.62%) Go
14 2 (0.41%) Bash
14 2 (0.41%) Groovy
14 2 (0.41%) MATLAB
14 2 (0.41%) XQuery
Qualifications
1 93 (19.14%) Security Cleared
2 69 (14.20%) SC Cleared
3 45 (9.26%) Degree
4 28 (5.76%) DV Cleared
5 25 (5.14%) Computer Science Degree
6 11 (2.26%) Azure Certification
7 10 (2.06%) Master's Degree
8 3 (0.62%) Microsoft Certification
9 2 (0.41%) BPSS Clearance
9 2 (0.41%) CCDP
9 2 (0.41%) CCNP
9 2 (0.41%) Cisco Certification
9 2 (0.41%) IBM Certification
9 2 (0.41%) Numerate Degree
10 1 (0.21%) CTC Cleared
10 1 (0.21%) ITIL Certification
10 1 (0.21%) PhD
10 1 (0.21%) SnowPro
Quality Assurance & Compliance
1 66 (13.58%) Data Quality
2 18 (3.70%) Actionable Recommendations
3 6 (1.23%) Accessibility
3 6 (1.23%) GDPR
3 6 (1.23%) QA
4 2 (0.41%) California Consumer Privacy Act
4 2 (0.41%) IFRS
4 2 (0.41%) IFRS 17
4 2 (0.41%) SLA
4 2 (0.41%) Solvency II
5 1 (0.21%) GRC
System Software
1 36 (7.41%) Docker
2 3 (0.62%) HDFS
3 1 (0.21%) Apache Flume
Systems Management
1 43 (8.85%) Terraform
2 38 (7.82%) Kubernetes
3 3 (0.62%) Ansible
3 3 (0.62%) Grafana
4 1 (0.21%) Control-M
4 1 (0.21%) Kibana
4 1 (0.21%) Kubeflow
4 1 (0.21%) Matomo
4 1 (0.21%) Prometheus
4 1 (0.21%) RSA Archer
Vendors
1 114 (23.46%) Databricks
2 53 (10.91%) Microsoft
3 41 (8.44%) Google
4 27 (5.56%) Red Hat
5 26 (5.35%) Oracle
6 16 (3.29%) SAP
7 15 (3.09%) Informatica
8 13 (2.67%) Ab Initio
8 13 (2.67%) VMware
9 10 (2.06%) Foundry
9 10 (2.06%) Palantir
10 9 (1.85%) Talend
11 4 (0.82%) IBM
12 3 (0.62%) Cloudera
12 3 (0.62%) SnapLogic
13 2 (0.41%) Aruba
13 2 (0.41%) Atlassian
13 2 (0.41%) Cisco
13 2 (0.41%) Sage
13 2 (0.41%) Splunk