Big Data Contracts

Big Data
UK

The table below provides summary statistics for contract job vacancies requiring Big Data skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Big Data over the 6 months leading up to 12 June 2024, comparing them to the same period in the previous two years.

6 months to
12 Jun 2024
Same period 2023 Same period 2022
Rank 226 245 155
Rank change year-on-year +19 -90 -35
Contract jobs citing Big Data 448 606 1,536
As % of all contract jobs advertised in the UK 1.03% 1.09% 1.76%
As % of the Database & Business Intelligence category 6.00% 6.22% 8.98%
Number of daily rates quoted 340 398 996
10th Percentile £362 £461 £450
25th Percentile £456 £501 £513
Median daily rate (50th Percentile) £575 £600 £600
Median % change year-on-year -4.17% - +6.19%
75th Percentile £750 £736 £700
90th Percentile £850 £825 £778
UK excluding London median daily rate £510 £600 £550
% change year-on-year -15.00% +9.09% +4.76%
Number of hourly rates quoted 10 24 3
10th Percentile £18.20 £36.50 £59.40
25th Percentile £19.90 £68.38 £59.63
Median hourly rate £41.25 £78.00 £60.50
Median % change year-on-year -47.12% +28.93% +47.56%
75th Percentile £46.56 £90.00 £76.33
90th Percentile £51.13 - £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,468 9,744 17,110
As % of all contract IT jobs advertised in the UK 17.10% 17.54% 19.63%
Number of daily rates quoted 5,332 6,905 12,217
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £545 £550
Median % change year-on-year -3.67% -0.91% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +11.11%
Number of hourly rates quoted 155 173 179
10th Percentile £14.00 £21.24 £15.38
25th Percentile £20.77 £32.40 £21.25
Median hourly rate £40.00 £58.59 £43.95
Median % change year-on-year -31.73% +33.31% +62.78%
75th Percentile £53.94 £73.75 £63.30
90th Percentile £72.50 £82.00 £75.00
UK excluding London median hourly rate £34.47 £56.95 £35.00
% change year-on-year -39.48% +62.71% +41.02%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 12 June 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 12 June 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 12 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +7 403 £600 - 209
London -6 270 £650 +8.33% 116
Work from Home +32 156 £613 +3.16% 119
UK excluding London +43 143 £510 -15.00% 108
North of England +44 44 £523 -5.00% 22
South East +15 34 £425 -26.09% 29
Midlands +28 31 £642 +27.10% 19
Yorkshire +36 29 £550 - 3
West Midlands +24 21 £650 +23.81% 16
Scotland +55 20 £481 -23.00% 12
North West +20 15 £510 +7.37% 14
East Midlands +12 10 £450 -10.89% 3
South West -23 10 £623 +11.41% 11
East of England -2 3 £500 -14.89% 9
Northern Ireland - 1 £425 - 7

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 141 (31.47%) Apache Spark
2 53 (11.83%) Apache
3 47 (10.49%) Apache Airflow
4 10 (2.23%) Confluence
5 4 (0.89%) IIS
5 4 (0.89%) Microsoft Exchange
5 4 (0.89%) SAS
6 2 (0.45%) Apache Solr
6 2 (0.45%) ArcGIS
6 2 (0.45%) Jupyter
6 2 (0.45%) nginx
7 1 (0.22%) Adobe Experience Manager
7 1 (0.22%) Apache Pulsar
7 1 (0.22%) SharePoint
Applications
1 12 (2.68%) Microsoft Excel
2 3 (0.67%) Spreadsheet
Business Applications
1 1 (0.22%) Adobe Campaign
1 1 (0.22%) Oracle Financials
1 1 (0.22%) Oracle Payables
Cloud Services
1 173 (38.62%) AWS
2 169 (37.72%) Azure
3 76 (16.96%) GCP
4 71 (15.85%) Power Platform
5 51 (11.38%) Snowflake
6 46 (10.27%) Serverless
7 33 (7.37%) Amazon S3
8 31 (6.92%) Azure Data Factory
8 31 (6.92%) dbt
9 25 (5.58%) Azure Synapse Analytics
10 22 (4.91%) AWS Lambda
11 20 (4.46%) Cloud Computing
12 17 (3.79%) Amazon EMR
12 17 (3.79%) Azure Logic Apps
13 16 (3.57%) Azure DevOps
14 12 (2.68%) PaaS
15 11 (2.46%) Entra ID
16 10 (2.23%) Azure Cosmos DB
16 10 (2.23%) Power Automate
16 10 (2.23%) SaaS
Communications & Networking
1 18 (4.02%) Intrusion Detection
1 18 (4.02%) Network Security
2 5 (1.12%) FTP
3 4 (0.89%) SAN
4 2 (0.45%) Internet
5 1 (0.22%) 5G
5 1 (0.22%) Broadband
5 1 (0.22%) Firewall
5 1 (0.22%) HTTPS
5 1 (0.22%) Wireless
Database & Business Intelligence
1 125 (27.90%) Data Lake
2 111 (24.78%) Data Warehouse
3 88 (19.64%) Hadoop
4 65 (14.51%) Power BI
5 42 (9.38%) Tableau
6 39 (8.71%) Amazon Athena
7 36 (8.04%) Apache Hive
8 34 (7.59%) Amazon Redshift
9 30 (6.70%) BigQuery
10 27 (6.03%) Apache Arrow
11 26 (5.80%) Dremio
11 26 (5.80%) SQL Server
12 23 (5.13%) Impala
13 22 (4.91%) NoSQL
14 20 (4.46%) Spark SQL
15 19 (4.24%) Relational Database
16 18 (4.02%) Delta Lake
17 13 (2.90%) Azure SQL Database
17 13 (2.90%) Metadata
18 12 (2.68%) OLTP
Development Applications
1 49 (10.94%) Git
2 27 (6.03%) JIRA
3 17 (3.79%) Jenkins
4 8 (1.79%) Maven
5 7 (1.56%) Cypress.io
5 7 (1.56%) Subversion
6 6 (1.34%) Visual Studio Team System
7 5 (1.12%) Bitbucket
7 5 (1.12%) ERwin
7 5 (1.12%) TeamCity
8 4 (0.89%) Team Foundation Server
8 4 (0.89%) Visual Studio Code
9 3 (0.67%) GitLab
9 3 (0.67%) JMeter
9 3 (0.67%) LoadRunner
9 3 (0.67%) Selenium
9 3 (0.67%) Visual Studio
10 2 (0.45%) Apache Continuum
10 2 (0.45%) CircleCI
10 2 (0.45%) RStudio
General
1 108 (24.11%) Social Skills
2 106 (23.66%) Finance
3 103 (22.99%) Analytical Skills
4 47 (10.49%) Banking
5 31 (6.92%) Public Sector
6 25 (5.58%) Investment Banking
7 10 (2.23%) Marketing
7 10 (2.23%) Pharmaceutical
8 9 (2.01%) Presentation Skills
9 8 (1.79%) Front Office
9 8 (1.79%) Retail
10 7 (1.56%) Financial Institution
11 6 (1.34%) Health Technology
11 6 (1.34%) Manufacturing
12 5 (1.12%) Telecoms
13 4 (0.89%) Legal
13 4 (0.89%) Publishing
14 3 (0.67%) Documentation Skills
14 3 (0.67%) Police
15 2 (0.45%) Corporate Banking
Job Titles
1 98 (21.88%) Architect
2 97 (21.65%) Data Engineer
3 59 (13.17%) Developer
4 45 (10.04%) Data Architect
4 45 (10.04%) Solutions Architect
5 43 (9.60%) Senior
6 37 (8.26%) Analyst
7 31 (6.92%) Big Data Engineer
8 30 (6.70%) AWS Engineer
9 22 (4.91%) Lead
10 21 (4.69%) Consultant
10 21 (4.69%) Data Analyst
11 18 (4.02%) Site Engineer
11 18 (4.02%) Site Reliability Engineer
12 17 (3.79%) Senior Data Engineer
13 16 (3.57%) Cloud Architect
14 14 (3.13%) Azure Architect
14 14 (3.13%) Cloud Solutions Architect
14 14 (3.13%) Python Engineer
15 13 (2.90%) Azure Engineer
Libraries, Frameworks & Software Standards
1 67 (14.96%) PySpark
2 54 (12.05%) Kafka
3 24 (5.36%) Apache NiFi
4 18 (4.02%) gRPC
4 18 (4.02%) Protocol Buffers
5 17 (3.79%) JSON
6 16 (3.57%) XML
7 11 (2.46%) .NET
7 11 (2.46%) React
8 9 (2.01%) Web Services
9 8 (1.79%) Elastic Stack
9 8 (1.79%) Pandas
9 8 (1.79%) SAML
9 8 (1.79%) Spring
9 8 (1.79%) TensorFlow
10 7 (1.56%) Apache Avro
10 7 (1.56%) REST
11 6 (1.34%) ARM Templates
12 5 (1.12%) Node.js
12 5 (1.12%) Oracle Fusion
Miscellaneous
1 36 (8.04%) Hedge funds
2 25 (5.58%) Algorithms
2 25 (5.58%) Management Information System
3 23 (5.13%) Clustering
4 18 (4.02%) Cyber Defence
4 18 (4.02%) Distributed Applications
5 15 (3.35%) Data Centre
5 15 (3.35%) Greenfield Project
5 15 (3.35%) Product Ownership
6 14 (3.13%) Data Structures
7 13 (2.90%) Data Protection Act
8 11 (2.46%) Distributed Computing
9 10 (2.23%) Virtual Team
10 9 (2.01%) Cloud Native
11 8 (1.79%) Derivative
11 8 (1.79%) Equities
11 8 (1.79%) Fixed Income
11 8 (1.79%) Foreign Exchange (FX)
11 8 (1.79%) Freedom of Information
11 8 (1.79%) Freedom of Information Act
Operating Systems
1 47 (10.49%) Linux
2 30 (6.70%) Unix
3 20 (4.46%) Windows
4 18 (4.02%) Android
4 18 (4.02%) Apple iOS
5 8 (1.79%) VMS
6 4 (0.89%) Windows Server
6 4 (0.89%) Windows Server 2016
6 4 (0.89%) Windows Server 2019
Processes & Methodologies
1 158 (35.27%) Analytics
2 137 (30.58%) Data Modelling
3 124 (27.68%) ETL
4 117 (26.12%) Agile
5 110 (24.55%) Data Pipeline
6 97 (21.65%) Business Intelligence
7 91 (20.31%) Data Engineering
8 81 (18.08%) DevOps
9 77 (17.19%) Problem-Solving
10 73 (16.29%) Machine Learning
11 70 (15.63%) Data Science
12 69 (15.40%) Data Analysis
13 62 (13.84%) Data Governance
14 61 (13.62%) CI/CD
14 61 (13.62%) Computer Science
15 52 (11.61%) Data Management
16 46 (10.27%) Migration
17 43 (9.60%) Data Analytics
18 42 (9.38%) Data Architecture
18 42 (9.38%) Data Integration
Programming Languages
1 229 (51.12%) Python
2 200 (44.64%) SQL
3 97 (21.65%) Java
4 63 (14.06%) Scala
5 31 (6.92%) JavaScript
6 20 (4.46%) Go
7 18 (4.02%) PowerShell
8 16 (3.57%) C#
9 15 (3.35%) R
10 11 (2.46%) Shell Script
11 10 (2.23%) Bash
11 10 (2.23%) PL/SQL
12 7 (1.56%) Perl
13 5 (1.12%) TypeScript
14 4 (0.89%) Ruby
15 3 (0.67%) C++
15 3 (0.67%) Data Analysis Expressions
15 3 (0.67%) Rust
15 3 (0.67%) T-SQL
16 2 (0.45%) Gremlin
Qualifications
1 64 (14.29%) Security Cleared
2 63 (14.06%) Degree
3 39 (8.71%) DV Cleared
4 31 (6.92%) SC Cleared
5 27 (6.03%) Computer Science Degree
6 16 (3.57%) AWS Certification
7 13 (2.90%) Master's Degree
8 12 (2.68%) Azure Certification
9 6 (1.34%) Microsoft Certification
10 4 (0.89%) CISSP
11 3 (0.67%) AWS Certified Solutions Architect
11 3 (0.67%) BPSS Clearance
12 2 (0.45%) Numerate Degree
13 1 (0.22%) AWS Certified Developer
13 1 (0.22%) AWS Certified DevOps Engineer
Quality Assurance & Compliance
1 66 (14.73%) Data Quality
2 18 (4.02%) Actionable Recommendations
3 8 (1.79%) QA
4 7 (1.56%) Accessibility
5 3 (0.67%) ISO/IEC 27001
5 3 (0.67%) NIST
6 2 (0.45%) GDPR
6 2 (0.45%) MiFID
6 2 (0.45%) NCSC
6 2 (0.45%) PMO
6 2 (0.45%) SLA
7 1 (0.22%) EMIR
7 1 (0.22%) FATCA
7 1 (0.22%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 1 (0.22%) PCI DSS
System Software
1 23 (5.13%) Docker
2 13 (2.90%) HDFS
3 4 (0.89%) Active Directory
4 1 (0.22%) Apache Flume
4 1 (0.22%) KVM
4 1 (0.22%) VMware ESXi
4 1 (0.22%) VMware Infrastructure
Systems Management
1 57 (12.72%) Terraform
2 49 (10.94%) Kubernetes
3 19 (4.24%) Prometheus
4 16 (3.57%) Ansible
5 11 (2.46%) Puppet
6 6 (1.34%) Hadoop YARN
7 5 (1.12%) Kibana
8 4 (0.89%) Argo
8 4 (0.89%) logstash
8 4 (0.89%) Rancher
9 2 (0.45%) Control-M
9 2 (0.45%) Ganglia
10 1 (0.22%) Ambari
10 1 (0.22%) Nagios
10 1 (0.22%) Oozie
10 1 (0.22%) vCenter Server
10 1 (0.22%) vRealize
Vendors
1 75 (16.74%) Databricks
2 55 (12.28%) Microsoft
3 38 (8.48%) Google
4 26 (5.80%) Oracle
5 20 (4.46%) Talend
6 19 (4.24%) Informatica
7 14 (3.13%) Red Hat
8 12 (2.68%) Cloudera
9 7 (1.56%) Salesforce
9 7 (1.56%) ServiceNow
9 7 (1.56%) Teradata
10 6 (1.34%) Foundry
10 6 (1.34%) Palantir
10 6 (1.34%) SAP
11 4 (0.89%) Atlassian
11 4 (0.89%) Brio
12 3 (0.67%) IBM
12 3 (0.67%) Splunk
12 3 (0.67%) Symantec
12 3 (0.67%) Varonis