Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 239 229 155
Rank change year-on-year -10 -74 -39
Contract jobs citing Big Data 418 655 1,612
As % of all contract jobs advertised in the UK 0.98% 1.14% 1.83%
As % of the Database & Business Intelligence category 5.74% 6.41% 9.16%
Number of daily rates quoted 312 448 1,027
10th Percentile £391 £463 £450
25th Percentile £473 £505 £513
Median daily rate (50th Percentile) £600 £588 £600
Median % change year-on-year +2.09% -2.08% +6.67%
75th Percentile £750 £723 £694
90th Percentile £850 £813 £782
UK excluding London median daily rate £525 £550 £550
% change year-on-year -4.55% - +2.09%
Number of hourly rates quoted 12 19 3
10th Percentile £18.20 £35.00 £59.40
25th Percentile £23.30 £62.00 £59.63
Median hourly rate £35.25 £78.00 £60.50
Median % change year-on-year -54.81% +28.93% +61.33%
75th Percentile £44.69 £86.25 £76.33
90th Percentile £48.63 £90.00 £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,287 10,222 17,599
As % of all contract IT jobs advertised in the UK 17.13% 17.85% 19.93%
Number of daily rates quoted 5,225 7,278 12,532
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £545 £549
Median % change year-on-year -3.67% -0.73% +9.80%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.00%
Number of hourly rates quoted 148 175 184
10th Percentile £14.00 £21.24 £15.00
25th Percentile £20.93 £32.30 £22.40
Median hourly rate £40.00 £57.50 £45.00
Median % change year-on-year -30.43% +27.78% +69.81%
75th Percentile £61.53 £73.73 £65.00
90th Percentile £73.25 £79.38 £75.00
UK excluding London median hourly rate £39.25 £55.00 £35.00
% change year-on-year -28.64% +57.14% +45.83%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 20 May 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 20 May 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 20 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -13 370 £600 +2.13% 238
London -20 249 £650 +8.33% 138
Work from Home +25 151 £625 +8.23% 117
UK excluding London +57 127 £525 -4.55% 142
North of England +54 41 £525 -4.55% 28
Midlands +31 33 £642 +25.86% 21
South East +13 27 £425 -20.93% 34
Yorkshire +37 24 £550 - 7
West Midlands +29 23 £675 +22.73% 18
Scotland +50 18 £550 -24.14% 20
North West +22 17 £510 +7.37% 13
East Midlands +22 10 £463 -8.42% 3
South West -19 5 £450 -21.74% 20
East of England +2 2 £400 -31.91% 8
Northern Ireland - 1 £425 - 9

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (28.23%) Apache Spark
2 45 (10.77%) Apache Airflow
3 39 (9.33%) Apache
4 6 (1.44%) Confluence
5 4 (0.96%) IIS
5 4 (0.96%) Microsoft Exchange
6 2 (0.48%) Apache Solr
6 2 (0.48%) ArcGIS
6 2 (0.48%) Jupyter
6 2 (0.48%) nginx
7 1 (0.24%) Apache Pulsar
7 1 (0.24%) SAS
7 1 (0.24%) SharePoint
Applications
1 13 (3.11%) Microsoft Excel
2 3 (0.72%) Spreadsheet
3 1 (0.24%) Microsoft PowerPoint
Business Applications
1 1 (0.24%) Oracle Financials
1 1 (0.24%) Oracle Payables
Cloud Services
1 156 (37.32%) AWS
2 152 (36.36%) Azure
3 73 (17.46%) GCP
4 55 (13.16%) Power Platform
5 48 (11.48%) Serverless
6 40 (9.57%) Snowflake
7 32 (7.66%) Azure Data Factory
8 30 (7.18%) Amazon S3
9 27 (6.46%) AWS Lambda
10 25 (5.98%) dbt
11 24 (5.74%) Azure Synapse Analytics
12 19 (4.55%) Azure DevOps
13 17 (4.07%) Amazon EMR
13 17 (4.07%) Cloud Computing
14 16 (3.83%) Azure Logic Apps
15 12 (2.87%) Entra ID
15 12 (2.87%) GitHub
16 10 (2.39%) Azure Key Vault
16 10 (2.39%) Power Automate
17 9 (2.15%) PowerApps
Communications & Networking
1 15 (3.59%) Intrusion Detection
1 15 (3.59%) Network Security
2 5 (1.20%) FTP
3 4 (0.96%) SAN
4 2 (0.48%) Internet
5 1 (0.24%) Broadband
5 1 (0.24%) Firewall
5 1 (0.24%) HTTPS
5 1 (0.24%) Wireless
Database & Business Intelligence
1 110 (26.32%) Data Lake
2 102 (24.40%) Data Warehouse
3 74 (17.70%) Hadoop
4 49 (11.72%) Power BI
5 39 (9.33%) Amazon Athena
6 35 (8.37%) Amazon Redshift
7 33 (7.89%) Tableau
8 32 (7.66%) BigQuery
9 30 (7.18%) Apache Hive
10 23 (5.50%) SQL Server
11 22 (5.26%) NoSQL
12 20 (4.78%) Apache Arrow
12 20 (4.78%) Delta Lake
12 20 (4.78%) Dremio
13 18 (4.31%) Relational Database
14 17 (4.07%) Impala
15 16 (3.83%) Spark SQL
16 15 (3.59%) Metadata
17 12 (2.87%) OLTP
18 11 (2.63%) Azure SQL Database
Development Applications
1 44 (10.53%) Git
2 22 (5.26%) JIRA
3 12 (2.87%) Jenkins
4 6 (1.44%) Cypress.io
4 6 (1.44%) Maven
4 6 (1.44%) Subversion
4 6 (1.44%) Visual Studio Team System
5 5 (1.20%) ERwin
5 5 (1.20%) TeamCity
6 4 (0.96%) Team Foundation Server
7 3 (0.72%) Bitbucket
7 3 (0.72%) GitLab
7 3 (0.72%) JMeter
7 3 (0.72%) LoadRunner
7 3 (0.72%) RStudio
7 3 (0.72%) Selenium
7 3 (0.72%) Visual Studio
8 2 (0.48%) CircleCI
8 2 (0.48%) kappa
8 2 (0.48%) Liquibase
General
1 100 (23.92%) Social Skills
2 98 (23.44%) Analytical Skills
3 95 (22.73%) Finance
4 35 (8.37%) Banking
5 30 (7.18%) Public Sector
6 14 (3.35%) Investment Banking
7 9 (2.15%) Marketing
7 9 (2.15%) Pharmaceutical
8 8 (1.91%) Presentation Skills
9 7 (1.67%) Financial Institution
9 7 (1.67%) Health Technology
9 7 (1.67%) Manufacturing
10 6 (1.44%) Retail
11 5 (1.20%) Legal
11 5 (1.20%) Telecoms
12 4 (0.96%) Publishing
13 3 (0.72%) Back Office
13 3 (0.72%) Documentation Skills
13 3 (0.72%) Police
14 2 (0.48%) Front Office
Job Titles
1 101 (24.16%) Architect
2 90 (21.53%) Data Engineer
3 49 (11.72%) Developer
4 46 (11.00%) Data Architect
5 41 (9.81%) Solutions Architect
6 36 (8.61%) Senior
7 35 (8.37%) Analyst
8 27 (6.46%) Big Data Engineer
9 25 (5.98%) AWS Engineer
10 23 (5.50%) Lead
11 22 (5.26%) Data Analyst
12 20 (4.78%) Cloud Architect
12 20 (4.78%) Consultant
13 18 (4.31%) Site Engineer
13 18 (4.31%) Site Reliability Engineer
14 17 (4.07%) Data Scientist
15 16 (3.83%) Azure Architect
15 16 (3.83%) Cloud Solutions Architect
16 15 (3.59%) Azure Engineer
16 15 (3.59%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 67 (16.03%) PySpark
2 46 (11.00%) Kafka
3 22 (5.26%) Apache NiFi
4 18 (4.31%) gRPC
4 18 (4.31%) Protocol Buffers
5 16 (3.83%) JSON
5 16 (3.83%) XML
6 12 (2.87%) .NET
7 11 (2.63%) Pandas
8 10 (2.39%) TensorFlow
8 10 (2.39%) Web Services
9 8 (1.91%) Apache Avro
9 8 (1.91%) SAML
10 6 (1.44%) ARM Templates
10 6 (1.44%) React
10 6 (1.44%) scikit-learn
11 5 (1.20%) NumPy
11 5 (1.20%) Oracle Fusion
11 5 (1.20%) REST
11 5 (1.20%) Spring
Miscellaneous
1 30 (7.18%) Algorithms
2 29 (6.94%) Hedge funds
3 23 (5.50%) Clustering
3 23 (5.50%) Management Information System
4 15 (3.59%) Cyber Defence
4 15 (3.59%) Distributed Applications
5 14 (3.35%) Data Centre
5 14 (3.35%) Data Protection Act
6 13 (3.11%) Data Structures
6 13 (3.11%) Greenfield Project
7 11 (2.63%) Distributed Computing
8 10 (2.39%) Cloud Native
9 9 (2.15%) Freedom of Information
9 9 (2.15%) Freedom of Information Act
9 9 (2.15%) Virtual Team
10 8 (1.91%) Product Ownership
11 7 (1.67%) Onboarding
12 6 (1.44%) Analytical Mindset
12 6 (1.44%) Distributed Systems
13 5 (1.20%) Self-Motivation
Operating Systems
1 40 (9.57%) Linux
2 22 (5.26%) Unix
3 17 (4.07%) Windows
4 13 (3.11%) Android
4 13 (3.11%) Apple iOS
5 8 (1.91%) VMS
6 4 (0.96%) Windows Server
6 4 (0.96%) Windows Server 2016
6 4 (0.96%) Windows Server 2019
Processes & Methodologies
1 134 (32.06%) Analytics
1 134 (32.06%) Data Modelling
2 117 (27.99%) ETL
3 108 (25.84%) Data Pipeline
4 104 (24.88%) Agile
5 89 (21.29%) Business Intelligence
6 81 (19.38%) Data Engineering
7 78 (18.66%) DevOps
8 75 (17.94%) Machine Learning
9 66 (15.79%) Problem-Solving
10 65 (15.55%) Data Analysis
11 64 (15.31%) Data Science
12 63 (15.07%) CI/CD
13 50 (11.96%) Data Governance
14 49 (11.72%) Computer Science
15 48 (11.48%) Data Management
16 47 (11.24%) Migration
17 41 (9.81%) Data Integration
18 39 (9.33%) Visualisation
19 36 (8.61%) Data Architecture
Programming Languages
1 225 (53.83%) Python
2 184 (44.02%) SQL
3 88 (21.05%) Java
4 55 (13.16%) Scala
5 27 (6.46%) JavaScript
6 22 (5.26%) Go
7 20 (4.78%) R
8 17 (4.07%) C#
8 17 (4.07%) PowerShell
9 9 (2.15%) Shell Script
10 7 (1.67%) Perl
11 5 (1.20%) Bash
12 3 (0.72%) Data Analysis Expressions
12 3 (0.72%) PL/SQL
12 3 (0.72%) Rust
13 2 (0.48%) T-SQL
13 2 (0.48%) U-SQL
13 2 (0.48%) VBA
14 1 (0.24%) Gremlin
14 1 (0.24%) Kotlin
Qualifications
1 55 (13.16%) Degree
2 53 (12.68%) Security Cleared
3 31 (7.42%) DV Cleared
4 30 (7.18%) SC Cleared
5 23 (5.50%) Computer Science Degree
6 19 (4.55%) AWS Certification
7 10 (2.39%) Master's Degree
8 9 (2.15%) Azure Certification
9 6 (1.44%) Microsoft Certification
10 5 (1.20%) AWS Certified Solutions Architect
11 4 (0.96%) CISSP
12 3 (0.72%) AWS Certified Developer
12 3 (0.72%) AWS Certified DevOps Engineer
12 3 (0.72%) BPSS Clearance
13 2 (0.48%) Numerate Degree
Quality Assurance & Compliance
1 63 (15.07%) Data Quality
2 15 (3.59%) Actionable Recommendations
3 8 (1.91%) QA
4 5 (1.20%) Accessibility
5 4 (0.96%) ISO/IEC 27001
5 4 (0.96%) NIST
6 3 (0.72%) GDPR
7 2 (0.48%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.48%) MiFID
7 2 (0.48%) NCSC
7 2 (0.48%) PCI DSS
7 2 (0.48%) PMO
7 2 (0.48%) SLA
8 1 (0.24%) EMIR
8 1 (0.24%) FATCA
System Software
1 17 (4.07%) Docker
2 12 (2.87%) HDFS
3 4 (0.96%) Active Directory
4 1 (0.24%) Apache Flume
4 1 (0.24%) KVM
4 1 (0.24%) VMware ESXi
4 1 (0.24%) VMware Infrastructure
Systems Management
1 61 (14.59%) Terraform
2 42 (10.05%) Kubernetes
3 20 (4.78%) Ansible
4 19 (4.55%) Prometheus
5 14 (3.35%) Puppet
6 6 (1.44%) Hadoop YARN
7 4 (0.96%) Argo
8 2 (0.48%) Ambari
8 2 (0.48%) Consul
8 2 (0.48%) Oozie
8 2 (0.48%) Packer
8 2 (0.48%) Progress Chef
9 1 (0.24%) Ganglia
9 1 (0.24%) Kibana
9 1 (0.24%) Nagios
9 1 (0.24%) vCenter Server
9 1 (0.24%) vRealize
Vendors
1 77 (18.42%) Databricks
2 53 (12.68%) Microsoft
3 32 (7.66%) Google
4 22 (5.26%) Oracle
5 21 (5.02%) Talend
6 19 (4.55%) Informatica
7 10 (2.39%) Red Hat
8 8 (1.91%) Teradata
9 7 (1.67%) Salesforce
10 5 (1.20%) Cloudera
10 5 (1.20%) SAP
11 4 (0.96%) Brio
11 4 (0.96%) Foundry
11 4 (0.96%) IBM
11 4 (0.96%) Okta
11 4 (0.96%) Palantir
11 4 (0.96%) Sage
11 4 (0.96%) Symantec
11 4 (0.96%) Varonis
12 3 (0.72%) Phenom