Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 3 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
3 Jun 2024
Same period 2023 Same period 2022
Rank 239 236 154
Rank change year-on-year -3 -82 -39
Contract jobs citing Big Data 436 628 1,579
As % of all contract jobs advertised in the UK 1.02% 1.11% 1.79%
As % of the Database & Business Intelligence category 6.00% 6.30% 9.08%
Number of daily rates quoted 331 420 1,022
10th Percentile £363 £450 £450
25th Percentile £463 £506 £513
Median daily rate (50th Percentile) £575 £594 £600
Median % change year-on-year -3.16% -1.04% +6.19%
75th Percentile £750 £725 £700
90th Percentile £850 £825 £775
UK excluding London median daily rate £520 £575 £550
% change year-on-year -9.57% +4.55% +2.09%
Number of hourly rates quoted 11 24 3
10th Percentile £18.20 £36.50 £59.40
25th Percentile £21.60 £68.38 £59.63
Median hourly rate £40.00 £78.00 £60.50
Median % change year-on-year -48.72% +28.93% +54.14%
75th Percentile £45.63 £90.00 £76.33
90th Percentile £48.75 - £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,261 9,963 17,383
As % of all contract IT jobs advertised in the UK 16.94% 17.68% 19.69%
Number of daily rates quoted 5,208 7,078 12,398
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £550 £550
Median % change year-on-year -4.50% -0.05% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £755 £750
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +11.11%
Number of hourly rates quoted 150 177 182
10th Percentile £14.00 £21.24 £15.05
25th Percentile £20.77 £32.40 £21.25
Median hourly rate £40.00 £60.00 £43.68
Median % change year-on-year -33.33% +37.35% +63.42%
75th Percentile £56.88 £73.75 £62.88
90th Percentile £72.75 £81.00 £75.00
UK excluding London median hourly rate £35.00 £58.59 £35.00
% change year-on-year -40.26% +67.40% +42.45%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 3 June 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 3 June 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 3 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -5 391 £600 - 253
London -12 261 £650 +8.33% 150
Work from Home +34 148 £613 +4.93% 125
UK excluding London +59 137 £520 -9.57% 125
North of England +52 43 £525 -4.55% 23
South East +11 33 £425 -22.73% 27
Midlands +33 30 £650 +28.71% 19
Yorkshire +34 26 £550 - 4
West Midlands +21 21 £650 +23.81% 16
Scotland +51 18 £488 -22.00% 20
North West +16 17 £510 +7.37% 15
East Midlands +14 9 £463 -8.42% 3
South West -13 9 £615 -5.38% 17
East of England -1 3 £500 -14.89% 11
Northern Ireland - 1 £425 - 8

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 131 (30.05%) Apache Spark
2 47 (10.78%) Apache
3 46 (10.55%) Apache Airflow
4 9 (2.06%) Confluence
5 4 (0.92%) IIS
5 4 (0.92%) Microsoft Exchange
5 4 (0.92%) SAS
6 2 (0.46%) Apache Solr
6 2 (0.46%) ArcGIS
6 2 (0.46%) Jupyter
6 2 (0.46%) nginx
7 1 (0.23%) Apache Pulsar
7 1 (0.23%) SharePoint
Applications
1 13 (2.98%) Microsoft Excel
2 3 (0.69%) Spreadsheet
3 1 (0.23%) Microsoft PowerPoint
Business Applications
1 1 (0.23%) Oracle Financials
1 1 (0.23%) Oracle Payables
Cloud Services
1 159 (36.47%) AWS
2 157 (36.01%) Azure
3 70 (16.06%) GCP
4 65 (14.91%) Power Platform
5 48 (11.01%) Snowflake
6 45 (10.32%) Serverless
7 33 (7.57%) Amazon S3
8 30 (6.88%) Azure Data Factory
9 28 (6.42%) dbt
10 23 (5.28%) AWS Lambda
10 23 (5.28%) Azure Synapse Analytics
11 19 (4.36%) Amazon EMR
12 18 (4.13%) Azure DevOps
12 18 (4.13%) Cloud Computing
13 16 (3.67%) Azure Logic Apps
14 11 (2.52%) Entra ID
14 11 (2.52%) PaaS
15 10 (2.29%) Azure Key Vault
15 10 (2.29%) GitHub
15 10 (2.29%) Power Automate
Communications & Networking
1 18 (4.13%) Intrusion Detection
1 18 (4.13%) Network Security
2 5 (1.15%) FTP
3 4 (0.92%) SAN
4 2 (0.46%) Internet
5 1 (0.23%) 5G
5 1 (0.23%) Broadband
5 1 (0.23%) Firewall
5 1 (0.23%) HTTPS
5 1 (0.23%) Wireless
Database & Business Intelligence
1 116 (26.61%) Data Lake
2 108 (24.77%) Data Warehouse
3 79 (18.12%) Hadoop
4 59 (13.53%) Power BI
5 40 (9.17%) Amazon Athena
6 38 (8.72%) Tableau
7 35 (8.03%) Amazon Redshift
8 34 (7.80%) Apache Hive
9 29 (6.65%) BigQuery
10 24 (5.50%) Apache Arrow
10 24 (5.50%) Dremio
11 23 (5.28%) SQL Server
12 21 (4.82%) Impala
13 20 (4.59%) NoSQL
14 19 (4.36%) Spark SQL
15 17 (3.90%) Delta Lake
15 17 (3.90%) Relational Database
16 14 (3.21%) Metadata
17 12 (2.75%) Azure SQL Database
17 12 (2.75%) OLTP
Development Applications
1 45 (10.32%) Git
2 25 (5.73%) JIRA
3 15 (3.44%) Jenkins
4 7 (1.61%) Cypress.io
4 7 (1.61%) Maven
5 6 (1.38%) Subversion
5 6 (1.38%) Visual Studio Team System
6 5 (1.15%) Bitbucket
6 5 (1.15%) ERwin
6 5 (1.15%) TeamCity
7 4 (0.92%) Team Foundation Server
8 3 (0.69%) GitLab
8 3 (0.69%) JMeter
8 3 (0.69%) LoadRunner
8 3 (0.69%) RStudio
8 3 (0.69%) Selenium
8 3 (0.69%) Visual Studio
8 3 (0.69%) Visual Studio Code
9 2 (0.46%) CircleCI
9 2 (0.46%) kappa
General
1 101 (23.17%) Analytical Skills
1 101 (23.17%) Social Skills
2 98 (22.48%) Finance
3 42 (9.63%) Banking
4 32 (7.34%) Public Sector
5 21 (4.82%) Investment Banking
6 11 (2.52%) Marketing
7 10 (2.29%) Pharmaceutical
8 8 (1.83%) Presentation Skills
9 7 (1.61%) Financial Institution
9 7 (1.61%) Health Technology
9 7 (1.61%) Retail
10 6 (1.38%) Front Office
10 6 (1.38%) Manufacturing
10 6 (1.38%) Telecoms
11 5 (1.15%) Legal
12 4 (0.92%) Publishing
13 3 (0.69%) Back Office
13 3 (0.69%) Documentation Skills
13 3 (0.69%) Police
Job Titles
1 96 (22.02%) Architect
1 96 (22.02%) Data Engineer
2 56 (12.84%) Developer
3 46 (10.55%) Data Architect
4 42 (9.63%) Solutions Architect
5 41 (9.40%) Senior
6 37 (8.49%) Analyst
7 31 (7.11%) Big Data Engineer
8 29 (6.65%) AWS Engineer
9 22 (5.05%) Consultant
9 22 (5.05%) Data Analyst
10 20 (4.59%) Lead
11 18 (4.13%) Site Engineer
11 18 (4.13%) Site Reliability Engineer
12 17 (3.90%) Cloud Architect
13 16 (3.67%) Senior Data Engineer
14 15 (3.44%) Azure Architect
15 14 (3.21%) Azure Engineer
15 14 (3.21%) Cloud Solutions Architect
15 14 (3.21%) Python Engineer
Libraries, Frameworks & Software Standards
1 66 (15.14%) PySpark
2 52 (11.93%) Kafka
3 25 (5.73%) Apache NiFi
4 18 (4.13%) gRPC
4 18 (4.13%) Protocol Buffers
5 16 (3.67%) JSON
5 16 (3.67%) XML
6 12 (2.75%) .NET
7 10 (2.29%) Web Services
8 9 (2.06%) React
9 8 (1.83%) Apache Avro
9 8 (1.83%) Elastic Stack
9 8 (1.83%) Pandas
9 8 (1.83%) SAML
9 8 (1.83%) TensorFlow
10 7 (1.61%) REST
11 6 (1.38%) ARM Templates
11 6 (1.38%) Spring
12 5 (1.15%) .NET Core
12 5 (1.15%) Node.js
Miscellaneous
1 34 (7.80%) Hedge funds
2 26 (5.96%) Management Information System
3 24 (5.50%) Algorithms
4 23 (5.28%) Clustering
5 18 (4.13%) Cyber Defence
5 18 (4.13%) Distributed Applications
6 15 (3.44%) Data Centre
7 14 (3.21%) Data Protection Act
7 14 (3.21%) Greenfield Project
8 13 (2.98%) Data Structures
9 12 (2.75%) Product Ownership
10 11 (2.52%) Cloud Native
10 11 (2.52%) Distributed Computing
10 11 (2.52%) Virtual Team
11 9 (2.06%) Freedom of Information
11 9 (2.06%) Freedom of Information Act
12 7 (1.61%) Onboarding
13 6 (1.38%) Distributed Systems
13 6 (1.38%) Equities
13 6 (1.38%) Fixed Income
Operating Systems
1 46 (10.55%) Linux
2 28 (6.42%) Unix
3 20 (4.59%) Windows
4 16 (3.67%) Android
4 16 (3.67%) Apple iOS
5 8 (1.83%) VMS
6 4 (0.92%) Windows Server
6 4 (0.92%) Windows Server 2016
6 4 (0.92%) Windows Server 2019
Processes & Methodologies
1 151 (34.63%) Analytics
2 131 (30.05%) Data Modelling
3 117 (26.83%) ETL
4 112 (25.69%) Agile
5 108 (24.77%) Data Pipeline
6 93 (21.33%) Business Intelligence
7 82 (18.81%) Data Engineering
8 81 (18.58%) DevOps
9 70 (16.06%) Machine Learning
9 70 (16.06%) Problem-Solving
10 67 (15.37%) Data Analysis
11 65 (14.91%) Data Science
12 59 (13.53%) CI/CD
13 55 (12.61%) Computer Science
13 55 (12.61%) Data Governance
14 51 (11.70%) Data Management
15 47 (10.78%) Migration
16 40 (9.17%) Data Analytics
16 40 (9.17%) Data Integration
17 38 (8.72%) Scrum
Programming Languages
1 223 (51.15%) Python
2 188 (43.12%) SQL
3 89 (20.41%) Java
4 55 (12.61%) Scala
5 30 (6.88%) JavaScript
6 20 (4.59%) Go
7 18 (4.13%) PowerShell
8 17 (3.90%) C#
8 17 (3.90%) R
9 10 (2.29%) Bash
9 10 (2.29%) Shell Script
10 9 (2.06%) PL/SQL
11 8 (1.83%) Perl
12 3 (0.69%) C++
12 3 (0.69%) Data Analysis Expressions
12 3 (0.69%) Ruby
12 3 (0.69%) Rust
12 3 (0.69%) TypeScript
13 2 (0.46%) T-SQL
13 2 (0.46%) VBA
Qualifications
1 61 (13.99%) Degree
1 61 (13.99%) Security Cleared
2 39 (8.94%) DV Cleared
3 29 (6.65%) SC Cleared
4 23 (5.28%) Computer Science Degree
5 17 (3.90%) AWS Certification
6 11 (2.52%) Master's Degree
7 10 (2.29%) Azure Certification
8 6 (1.38%) Microsoft Certification
9 4 (0.92%) AWS Certified Solutions Architect
9 4 (0.92%) CISSP
10 3 (0.69%) BPSS Clearance
11 2 (0.46%) AWS Certified Developer
11 2 (0.46%) AWS Certified DevOps Engineer
11 2 (0.46%) Numerate Degree
Quality Assurance & Compliance
1 63 (14.45%) Data Quality
2 18 (4.13%) Actionable Recommendations
3 8 (1.83%) QA
4 6 (1.38%) Accessibility
5 4 (0.92%) ISO/IEC 27001
5 4 (0.92%) NIST
6 3 (0.69%) GDPR
7 2 (0.46%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.46%) MiFID
7 2 (0.46%) NCSC
7 2 (0.46%) PCI DSS
7 2 (0.46%) PMO
7 2 (0.46%) SLA
8 1 (0.23%) EMIR
8 1 (0.23%) FATCA
System Software
1 21 (4.82%) Docker
2 12 (2.75%) HDFS
3 4 (0.92%) Active Directory
4 1 (0.23%) Apache Flume
4 1 (0.23%) KVM
4 1 (0.23%) VMware ESXi
4 1 (0.23%) VMware Infrastructure
Systems Management
1 56 (12.84%) Terraform
2 46 (10.55%) Kubernetes
3 19 (4.36%) Prometheus
4 17 (3.90%) Ansible
5 11 (2.52%) Puppet
6 6 (1.38%) Hadoop YARN
7 4 (0.92%) Argo
7 4 (0.92%) Kibana
8 3 (0.69%) logstash
8 3 (0.69%) Rancher
9 2 (0.46%) Ambari
9 2 (0.46%) Oozie
10 1 (0.23%) Control-M
10 1 (0.23%) Ganglia
10 1 (0.23%) Nagios
10 1 (0.23%) vCenter Server
10 1 (0.23%) vRealize
Vendors
1 76 (17.43%) Databricks
2 54 (12.39%) Microsoft
3 35 (8.03%) Google
4 24 (5.50%) Oracle
5 20 (4.59%) Talend
6 18 (4.13%) Informatica
7 14 (3.21%) Red Hat
8 11 (2.52%) Cloudera
9 8 (1.83%) Teradata
10 7 (1.61%) Salesforce
11 6 (1.38%) ServiceNow
12 5 (1.15%) SAP
13 4 (0.92%) Brio
13 4 (0.92%) Foundry
13 4 (0.92%) Palantir
14 3 (0.69%) Atlassian
14 3 (0.69%) IBM
14 3 (0.69%) Sage
14 3 (0.69%) Splunk
14 3 (0.69%) Varonis