Apache Hadoop
UK

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 453 414 337
Rank change year-on-year -39 -77 -139
Contract jobs citing Hadoop 126 296 715
As % of all contract jobs advertised in the UK 0.30% 0.52% 0.81%
As % of the Database & Business Intelligence category 1.73% 2.90% 4.06%
Number of daily rates quoted 94 213 451
10th Percentile £339 £464 £425
25th Percentile £388 £513 £508
Median daily rate (50th Percentile) £500 £575 £600
Median % change year-on-year -13.04% -4.17% +9.09%
75th Percentile £613 £700 £715
90th Percentile £746 £770 £825
UK excluding London median daily rate £478 £540 £540
% change year-on-year -11.57% - +8.00%
Number of hourly rates quoted 5 9 2
10th Percentile - £76.50 £57.68
25th Percentile £41.25 - £57.94
Median hourly rate £45.00 £78.00 £60.25
Median % change year-on-year -42.31% +29.46% +123.15%
75th Percentile £48.75 £90.00 £62.31
90th Percentile £60.75 - £62.43
UK excluding London median hourly rate £67.50 £78.00 -
% change year-on-year -13.46% - -

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,287 10,222 17,599
As % of all contract IT jobs advertised in the UK 17.13% 17.85% 19.93%
Number of daily rates quoted 5,225 7,278 12,532
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £545 £549
Median % change year-on-year -3.67% -0.73% +9.80%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.00%
Number of hourly rates quoted 148 175 184
10th Percentile £14.00 £21.24 £15.00
25th Percentile £20.93 £32.30 £22.40
Median hourly rate £40.00 £57.50 £45.00
Median % change year-on-year -30.43% +27.78% +69.81%
75th Percentile £61.53 £73.73 £65.00
90th Percentile £73.25 £79.38 £75.00
UK excluding London median hourly rate £39.25 £55.00 £35.00
% change year-on-year -28.64% +57.14% +45.83%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 20 May 2024.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Hourly Rate Histogram

Hourly rate distribution of jobs citing Hadoop over the 6 months to 20 May 2024.

Hourly rate histogram for Hadoop in the UK

Hadoop
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 20 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -34 108 £500 -13.04% 99
London -15 59 £550 -5.78% 58
UK excluding London +16 48 £478 -11.57% 63
Work from Home +25 43 £504 -12.81% 57
North of England +37 19 £507 +6.74% 19
Midlands +12 16 £413 -23.61% 8
East Midlands +28 13 £380 -5.00% 1
Yorkshire +27 10 £507 - 4
North West +15 9 £535 +12.63% 8
South East +11 7 £463 -19.57% 14
Scotland +43 3 £608 - 9
West Midlands +4 3 £550 +1.85% 7
East of England +5 1 £350 -36.36% 3
South West -16 1 £533 -18.08% 5
Northern Ireland - 1 £425 - 5

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 65 (51.59%) Apache Spark
2 13 (10.32%) Apache
3 8 (6.35%) Apache Airflow
4 5 (3.97%) Confluence
5 3 (2.38%) SAS
6 2 (1.59%) Apache Solr
7 1 (0.79%) Apache Pulsar
Business Applications
1 1 (0.79%) SAP Hybris
Cloud Services
1 37 (29.37%) AWS
2 30 (23.81%) Azure
3 24 (19.05%) GCP
4 17 (13.49%) PaaS
5 14 (11.11%) Amazon S3
6 12 (9.52%) Serverless
7 11 (8.73%) Cloud Computing
8 7 (5.56%) Azure Data Lake Analytics
9 6 (4.76%) Snowflake
10 5 (3.97%) Amazon EMR
10 5 (3.97%) AWS Lambda
10 5 (3.97%) Azure Synapse Analytics
11 3 (2.38%) Amazon EC2
11 3 (2.38%) Amazon EKS
11 3 (2.38%) Amazon Kinesis
11 3 (2.38%) Google Kubernetes Engine
11 3 (2.38%) OpenShift
11 3 (2.38%) Power Platform
11 3 (2.38%) Virtual Private Cloud
12 2 (1.59%) Akamai
Communications & Networking
1 16 (12.70%) FTP
2 4 (3.17%) Firewall
2 4 (3.17%) Intrusion Detection
2 4 (3.17%) TCP/IP
2 4 (3.17%) tcpdump
2 4 (3.17%) Wireshark
3 2 (1.59%) DHCP
3 2 (1.59%) DNS
3 2 (1.59%) Internet
Database & Business Intelligence
1 74 (58.73%) Big Data
2 29 (23.02%) Apache Hive
3 25 (19.84%) Data Warehouse
4 24 (19.05%) Tableau
5 21 (16.67%) Amazon Redshift
6 18 (14.29%) Impala
7 17 (13.49%) Data Lake
8 13 (10.32%) Amazon Athena
9 12 (9.52%) BigQuery
10 11 (8.73%) HBase
11 8 (6.35%) Amazon RDS
11 8 (6.35%) Apache Cassandra
11 8 (6.35%) MySQL
11 8 (6.35%) Sqoop
12 7 (5.56%) Presto
12 7 (5.56%) SQL Server
13 6 (4.76%) Elasticsearch
13 6 (4.76%) PostgreSQL
13 6 (4.76%) Relational Database
14 5 (3.97%) Spark SQL
Development Applications
1 19 (15.08%) Git
2 15 (11.90%) Jenkins
3 12 (9.52%) JIRA
4 7 (5.56%) Maven
5 6 (4.76%) GitLab
5 6 (4.76%) Subversion
6 5 (3.97%) TeamCity
7 4 (3.17%) IDA Disassembler
8 3 (2.38%) Cypress.io
9 2 (1.59%) Gradle
9 2 (1.59%) Liquibase
10 1 (0.79%) Bitbucket
General
1 46 (36.51%) Analytical Skills
2 38 (30.16%) Social Skills
3 33 (26.19%) Finance
4 15 (11.90%) Banking
5 11 (8.73%) Public Sector
6 8 (6.35%) Manufacturing
7 6 (4.76%) Telecoms
8 5 (3.97%) Investment Banking
9 4 (3.17%) Electronics
9 4 (3.17%) Marketing
10 3 (2.38%) Presentation Skills
11 2 (1.59%) Legal
11 2 (1.59%) Organisational Skills
12 1 (0.79%) Corporate Banking
12 1 (0.79%) Inclusion and Diversity
12 1 (0.79%) Law
12 1 (0.79%) Retail
Job Titles
1 22 (17.46%) Architect
1 22 (17.46%) Developer
2 16 (12.70%) Implementation Specialist
3 14 (11.11%) Data Engineer
3 14 (11.11%) Senior
4 13 (10.32%) Data Scientist
5 12 (9.52%) Analyst
5 12 (9.52%) Data Analyst
6 11 (8.73%) Solutions Architect
7 8 (6.35%) Data Architect
8 5 (3.97%) Hadoop Developer
8 5 (3.97%) Senior Analyst
8 5 (3.97%) Senior Data Analyst
9 4 (3.17%) Business Data Analyst
9 4 (3.17%) Scala Developer
10 3 (2.38%) Banking Analyst
10 3 (2.38%) Consultant
10 3 (2.38%) Senior Developer
10 3 (2.38%) SQL Developer
10 3 (2.38%) Talend Developer
Libraries, Frameworks & Software Standards
1 38 (30.16%) Kafka
2 18 (14.29%) LDAP
3 8 (6.35%) PySpark
4 4 (3.17%) Apache NiFi
4 4 (3.17%) Elastic Stack
4 4 (3.17%) OLE
5 3 (2.38%) .NET
5 3 (2.38%) .NET Core
5 3 (2.38%) JSON
5 3 (2.38%) XML
6 2 (1.59%) Apache Avro
6 2 (1.59%) Java Concurrency
7 1 (0.79%) Anaconda
7 1 (0.79%) SAML
7 1 (0.79%) TensorFlow
Miscellaneous
1 19 (15.08%) Algorithms
2 16 (12.70%) Replication
3 8 (6.35%) Self-Motivation
4 7 (5.56%) Cloud Native
5 4 (3.17%) Cyber Kill Chain
5 4 (3.17%) Data Protection Act
5 4 (3.17%) Public Cloud
5 4 (3.17%) YARA
6 3 (2.38%) Data Structures
6 3 (2.38%) Management Information System
7 2 (1.59%) Cyber Threat
7 2 (1.59%) Data Centre
7 2 (1.59%) Derivative
7 2 (1.59%) Distributed Systems
7 2 (1.59%) Market Risk
7 2 (1.59%) Onboarding
7 2 (1.59%) Social Media
7 2 (1.59%) Virtual Team
8 1 (0.79%) Credit Risk
8 1 (0.79%) Hedge funds
Operating Systems
1 24 (19.05%) Linux
2 22 (17.46%) Unix
3 20 (15.87%) Windows
Processes & Methodologies
1 41 (32.54%) Data Modelling
2 34 (26.98%) ETL
3 32 (25.40%) Analytics
4 29 (23.02%) Problem-Solving
5 28 (22.22%) Agile
6 25 (19.84%) Data Analysis
6 25 (19.84%) Data Science
6 25 (19.84%) Machine Learning
7 24 (19.05%) Business Intelligence
7 24 (19.05%) CI/CD
7 24 (19.05%) Computer Science
8 23 (18.25%) Disaster Recovery
9 22 (17.46%) DevOps
10 20 (15.87%) Mathematics
10 20 (15.87%) Visualisation
11 19 (15.08%) Migration
12 18 (14.29%) Data Integration
12 18 (14.29%) Data Visualisation
13 17 (13.49%) Statistics
14 16 (12.70%) Capacity Management
Programming Languages
1 70 (55.56%) Python
2 53 (42.06%) SQL
3 37 (29.37%) Java
4 23 (18.25%) Scala
5 16 (12.70%) R
6 9 (7.14%) Perl
7 5 (3.97%) JavaScript
7 5 (3.97%) Shell Script
8 4 (3.17%) Bash
8 4 (3.17%) PL/SQL
9 3 (2.38%) C#
10 2 (1.59%) Go
10 2 (1.59%) Groovy
10 2 (1.59%) Haskell
10 2 (1.59%) Ruby
10 2 (1.59%) TypeScript
10 2 (1.59%) U-SQL
11 1 (0.79%) HiveQL
11 1 (0.79%) SPARQL
Qualifications
1 18 (14.29%) Degree
2 12 (9.52%) Computer Science Degree
3 7 (5.56%) Security Cleared
4 4 (3.17%) Numerate Degree
5 3 (2.38%) AWS Certification
5 3 (2.38%) DV Cleared
5 3 (2.38%) SC Cleared
6 1 (0.79%) AWS Certified Solutions Architect
6 1 (0.79%) OCP
6 1 (0.79%) Oracle Certification
Quality Assurance & Compliance
1 16 (12.70%) Data Quality
2 6 (4.76%) GDPR
2 6 (4.76%) NIST
3 2 (1.59%) ISO/IEC 27001
3 2 (1.59%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
3 2 (1.59%) PCI DSS
3 2 (1.59%) QA
4 1 (0.79%) Accessibility
4 1 (0.79%) EMIR
4 1 (0.79%) FATCA
4 1 (0.79%) MiFID
System Software
1 30 (23.81%) HDFS
2 16 (12.70%) Active Directory
2 16 (12.70%) NFS
3 7 (5.56%) Docker
4 4 (3.17%) Snort
5 1 (0.79%) Apache Flume
Systems Management
1 11 (8.73%) Terraform
2 10 (7.94%) Kubernetes
3 6 (4.76%) Ansible
3 6 (4.76%) Hadoop YARN
4 5 (3.97%) Kibana
5 2 (1.59%) Ambari
5 2 (1.59%) Grafana
5 2 (1.59%) Oozie
5 2 (1.59%) Progress Chef
5 2 (1.59%) Puppet
6 1 (0.79%) Prometheus
Vendors
1 16 (12.70%) Isilon
2 15 (11.90%) Google
3 13 (10.32%) Oracle
4 12 (9.52%) Databricks
5 11 (8.73%) Microsoft
5 11 (8.73%) SAP
6 8 (6.35%) Teradata
7 7 (5.56%) Dell
7 7 (5.56%) Informatica
7 7 (5.56%) Splunk
8 6 (4.76%) Talend
9 4 (3.17%) Foundry
9 4 (3.17%) Palantir
10 3 (2.38%) Ab Initio
10 3 (2.38%) Cloudera
11 2 (1.59%) Adobe
11 2 (1.59%) Confluent
11 2 (1.59%) IBM
11 2 (1.59%) Salesforce
11 2 (1.59%) StreamSets