Big Data Engineer Contracts

Big Data Engineer
UK

The median Big Data Engineer daily rate in the UK is £800 according to job vacancies posted during the 6 months to 1 June 2024.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 544 661 711
Rank change year-on-year +117 +50 -93
Contract jobs requiring a Big Data Engineer 31 21 127
As % of all contract jobs advertised in the UK 0.072% 0.037% 0.14%
As % of the Job Titles category 0.078% 0.040% 0.15%
Number of daily rates quoted 29 16 80
10th Percentile £625 £479 £506
25th Percentile £650 £499 £550
Median daily rate (50th Percentile) £800 £525 £685
Median % change year-on-year +52.38% -23.36% +19.13%
75th Percentile £850 £606 £750
90th Percentile - £750 £815
UK excluding London median daily rate £563 £475 £700
% change year-on-year +18.42% -32.14% +37.93%

All Contract IT Job Vacancies
UK

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

Contract vacancies in the UK with a recognized job title 39,969 53,015 83,520
% of contract IT jobs with a recognized job title 92.83% 94.58% 95.35%
Number of daily rates quoted 25,870 37,031 58,844
10th Percentile £280 £313 £315
25th Percentile £409 £425 £425
Median daily rate (50th Percentile) £525 £540 £525
Median % change year-on-year -2.78% +2.86% +7.69%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £488 £500 £475
% change year-on-year -2.50% +5.26% +10.21%
Number of hourly rates quoted 2,841 1,476 1,963
10th Percentile £12.86 £14.25 £12.50
25th Percentile £16.30 £19.06 £15.90
Median hourly rate £37.50 £45.00 £24.50
Median % change year-on-year -16.67% +83.67% +12.28%
75th Percentile £61.60 £65.75 £49.33
90th Percentile £73.75 £76.13 £65.00
UK excluding London median hourly rate £40.00 £42.50 £20.00
% change year-on-year -5.88% +112.50% +5.26%

Big Data Engineer
Job Vacancy Trend

Job postings that featured Big Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data Engineer in the UK

Big Data Engineer
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data Engineer.

Daily rate trend for Big Data Engineer in the UK

Big Data Engineer
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data Engineer over the 6 months to 1 June 2024.

Daily rate histogram for Big Data Engineer in the UK

Big Data Engineer
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data Engineer.

Hourly rate trend for Big Data Engineer in the UK

Big Data Engineer
Top 7 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Engineer within the UK over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +100 31 £800 +52.38% 1
London +108 29 £800 +52.38% 1
Work from Home +125 21 £800 +53.11%
UK excluding London +38 2 £563 +18.42%
North of England +22 1 £475 -
North West +20 1 £475 -
South West +5 1 £650 +36.84%

Big Data Engineer Skill Set
Top 30 Co-occurring Skills and Capabilities

For the 6 months to 1 June 2024, Big Data Engineer contract job roles required the following skills and capabilities in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Big Data Engineer in the job title.

1 31 (100.00%) Big Data
2 29 (93.55%) Python
3 24 (77.42%) Finance
4 23 (74.19%) Java
5 22 (70.97%) Kubernetes
6 21 (67.74%) Data Lake
7 20 (64.52%) DevOps
8 19 (61.29%) Terraform
8 19 (61.29%) Apache Airflow
8 19 (61.29%) dbt
8 19 (61.29%) Snowflake
8 19 (61.29%) JavaScript
8 19 (61.29%) Investment Management
8 19 (61.29%) AWS
9 18 (58.06%) Hedge funds
9 18 (58.06%) Protocol Buffers
9 18 (58.06%) Go
9 18 (58.06%) Asset Management
9 18 (58.06%) Clustering
9 18 (58.06%) Site Reliability Engineering
9 18 (58.06%) Dremio
9 18 (58.06%) Apache Arrow
9 18 (58.06%) Prometheus
9 18 (58.06%) Amazon Athena
9 18 (58.06%) gRPC
10 9 (29.03%) ETL
11 8 (25.81%) Data Warehouse
12 5 (16.13%) Data Modelling
12 5 (16.13%) Agile
12 5 (16.13%) Azure

Big Data Engineer Skill Set
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (61.29%) Apache Airflow
2 5 (16.13%) Apache Spark
3 3 (9.68%) Apache
4 1 (3.23%) Confluence
Cloud Services
1 19 (61.29%) AWS
1 19 (61.29%) dbt
1 19 (61.29%) Snowflake
2 5 (16.13%) Azure
3 3 (9.68%) Azure Data Factory
3 3 (9.68%) GCP
4 1 (3.23%) Amazon SageMaker
4 1 (3.23%) Azure Cosmos DB
4 1 (3.23%) OpenShift
4 1 (3.23%) WhatsApp
Database & Business Intelligence
1 31 (100.00%) Big Data
2 21 (67.74%) Data Lake
3 18 (58.06%) Amazon Athena
3 18 (58.06%) Apache Arrow
3 18 (58.06%) Dremio
4 8 (25.81%) Data Warehouse
5 3 (9.68%) BigQuery
5 3 (9.68%) Bigtable
5 3 (9.68%) Cloud Spanner
6 2 (6.45%) Hadoop
6 2 (6.45%) Relational Database
7 1 (3.23%) Apache Cassandra
7 1 (3.23%) Apache Hive
7 1 (3.23%) Elasticsearch
7 1 (3.23%) MongoDB
7 1 (3.23%) Neo4j
7 1 (3.23%) NoSQL
7 1 (3.23%) Oracle Reports
7 1 (3.23%) SQL Server
7 1 (3.23%) Sqoop
Development Applications
1 1 (3.23%) Bitbucket
1 1 (3.23%) Git
1 1 (3.23%) JIRA
1 1 (3.23%) Visual Studio Code
General
1 24 (77.42%) Finance
2 4 (12.90%) Analytical Skills
3 3 (9.68%) Banking
3 3 (9.68%) Investment Banking
3 3 (9.68%) Social Skills
4 1 (3.23%) Pharmaceutical
Libraries, Frameworks & Software Standards
1 18 (58.06%) gRPC
1 18 (58.06%) Protocol Buffers
2 5 (16.13%) PySpark
3 1 (3.23%) Elastic Stack
3 1 (3.23%) Node.js
3 1 (3.23%) React
Miscellaneous
1 18 (58.06%) Clustering
1 18 (58.06%) Hedge funds
2 1 (3.23%) Life Science
Operating Systems
1 1 (3.23%) Linux
Processes & Methodologies
1 20 (64.52%) DevOps
2 19 (61.29%) Investment Management
3 18 (58.06%) Asset Management
3 18 (58.06%) Site Reliability Engineering
4 9 (29.03%) ETL
5 5 (16.13%) Agile
5 5 (16.13%) Data Modelling
6 4 (12.90%) CI/CD
6 4 (12.90%) Data Pipeline
7 3 (9.68%) Data Migration
7 3 (9.68%) Design Patterns
7 3 (9.68%) Migration
7 3 (9.68%) Problem-Solving
8 2 (6.45%) Analytics
8 2 (6.45%) Data Analytics
8 2 (6.45%) Data Engineering
9 1 (3.23%) Data Acquisition
9 1 (3.23%) Data Science
9 1 (3.23%) ETL Development
9 1 (3.23%) Event-Driven
Programming Languages
1 29 (93.55%) Python
2 23 (74.19%) Java
3 19 (61.29%) JavaScript
4 18 (58.06%) Go
5 2 (6.45%) Scala
5 2 (6.45%) SQL
6 1 (3.23%) Bash
6 1 (3.23%) Gremlin
6 1 (3.23%) Ruby
6 1 (3.23%) TypeScript
Qualifications
1 1 (3.23%) AWS Certification
1 1 (3.23%) DV Cleared
1 1 (3.23%) Security Cleared
Quality Assurance & Compliance
1 3 (9.68%) Data Quality
System Software
1 4 (12.90%) Docker
2 1 (3.23%) HDFS
Systems Management
1 22 (70.97%) Kubernetes
2 19 (61.29%) Terraform
3 18 (58.06%) Prometheus
4 3 (9.68%) Ansible
5 1 (3.23%) Ganglia
5 1 (3.23%) Kibana
5 1 (3.23%) logstash
5 1 (3.23%) Rancher
Vendors
1 4 (12.90%) Databricks
2 3 (9.68%) Google
3 2 (6.45%) Oracle
4 1 (3.23%) Atlassian
4 1 (3.23%) Informatica
4 1 (3.23%) SnapLogic
4 1 (3.23%) Teradata