Hadoop Distributed File System (HDFS)
UK

The following table provides summary statistics for contract job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 549 664 717
Rank change year-on-year +115 +53 -178
Contract jobs citing HDFS 30 30 146
As % of all contract jobs advertised in the UK 0.071% 0.052% 0.17%
As % of the System Software category 0.65% 0.40% 1.23%
Number of daily rates quoted 24 14 96
10th Percentile £281 - £424
25th Percentile £300 £500 £477
Median daily rate (50th Percentile) £385 £525 £544
Median % change year-on-year -26.67% -3.51% +0.76%
75th Percentile £500 £575 £638
90th Percentile £681 £600 £750
UK excluding London median daily rate £450 £525 £495
% change year-on-year -14.29% +6.06% -1.00%

All System Software Skills
UK

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

Contract vacancies with a requirement for system software skills 4,589 7,502 11,837
As % of all contract IT jobs advertised in the UK 10.79% 13.10% 13.40%
Number of daily rates quoted 3,175 5,326 8,485
10th Percentile £200 £204 £200
25th Percentile £350 £400 £400
Median daily rate (50th Percentile) £500 £525 £525
Median % change year-on-year -4.76% - +7.14%
75th Percentile £600 £638 £625
90th Percentile £688 £725 £700
UK excluding London median daily rate £463 £480 £450
% change year-on-year -3.65% +6.67% +5.88%
Number of hourly rates quoted 229 260 309
10th Percentile £14.06 £15.24 £13.00
25th Percentile £14.48 £18.25 £15.00
Median hourly rate £22.50 £54.00 £19.00
Median % change year-on-year -58.33% +184.21% -11.63%
75th Percentile £60.75 £66.00 £40.00
90th Percentile £80.00 £75.77 £57.75
UK excluding London median hourly rate £19.18 £43.75 £17.50
% change year-on-year -56.16% +150.00% -4.21%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a proportion of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing HDFS.

Daily rate trend for HDFS in the UK

HDFS
Daily Rate Histogram

Daily rate distribution for jobs citing HDFS over the 6 months to 20 May 2024.

Daily rate histogram for HDFS in the UK

HDFS
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing HDFS.

Hourly rate trend for HDFS in the UK

HDFS
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 6 months to 20 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +113 27 £385 -26.67% 2
London +97 20 £385 -26.67% 2
Work from Home +102 8 £300 -47.83% 1
UK excluding London +54 7 £450 -14.29%
South East +20 2 - -
Midlands +18 2 £500 -4.76%
Yorkshire - 2 £425 -
North of England - 2 £425 -
West Midlands +20 1 £550 +4.76%
East Midlands - 1 £450 -
East of England - 1 £350 -

HDFS
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 13 (43.33%) Apache Spark
2 5 (16.67%) Apache
3 2 (6.67%) Apache Airflow
4 1 (3.33%) Confluence
4 1 (3.33%) SAS
Cloud Services
1 16 (53.33%) PaaS
2 5 (16.67%) AWS
3 3 (10.00%) Azure
3 3 (10.00%) GCP
3 3 (10.00%) Snowflake
4 2 (6.67%) Amazon EMR
4 2 (6.67%) AWS Data Pipeline
4 2 (6.67%) Cloud Computing
5 1 (3.33%) Amazon S3
5 1 (3.33%) Power Platform
Communications & Networking
1 16 (53.33%) FTP
Database & Business Intelligence
1 30 (100.00%) Hadoop
2 13 (43.33%) Apache Hive
3 12 (40.00%) Big Data
4 6 (20.00%) Data Warehouse
4 6 (20.00%) Impala
5 5 (16.67%) HBase
5 5 (16.67%) Spark SQL
5 5 (16.67%) Sqoop
6 3 (10.00%) Amazon Redshift
6 3 (10.00%) Oracle Reports
6 3 (10.00%) Relational Database
7 2 (6.67%) BigQuery
7 2 (6.67%) Data Lake
8 1 (3.33%) Amazon Athena
8 1 (3.33%) Amazon RDS
8 1 (3.33%) BusinessObjects
8 1 (3.33%) MySQL
8 1 (3.33%) Pentaho
8 1 (3.33%) PostgreSQL
8 1 (3.33%) Power BI
Development Applications
1 7 (23.33%) Git
2 6 (20.00%) JIRA
3 5 (16.67%) Maven
3 5 (16.67%) Subversion
3 5 (16.67%) TeamCity
4 1 (3.33%) Bitbucket
4 1 (3.33%) GitLab
4 1 (3.33%) Jenkins
General
1 10 (33.33%) Analytical Skills
2 9 (30.00%) Social Skills
3 8 (26.67%) Public Sector
4 6 (20.00%) Finance
5 4 (13.33%) Electronics
5 4 (13.33%) Manufacturing
5 4 (13.33%) Marketing
5 4 (13.33%) Telecoms
6 3 (10.00%) Banking
7 2 (6.67%) Organisational Skills
7 2 (6.67%) Presentation Skills
8 1 (3.33%) Investment Banking
Job Titles
1 16 (53.33%) Implementation Specialist
2 3 (10.00%) Architect
2 3 (10.00%) Data Engineer
3 2 (6.67%) Business Analyst
3 2 (6.67%) Data Business Analyst
3 2 (6.67%) Developer
3 2 (6.67%) Programmer
4 1 (3.33%) Big Data Engineer
4 1 (3.33%) Data Architect
4 1 (3.33%) Hadoop Developer
4 1 (3.33%) Hadoop Engineer
4 1 (3.33%) Scala Developer
4 1 (3.33%) Scala Engineer
4 1 (3.33%) Solutions Architect
4 1 (3.33%) Technical Business Analyst
Libraries, Frameworks & Software Standards
1 16 (53.33%) LDAP
2 9 (30.00%) Kafka
Miscellaneous
1 16 (53.33%) Replication
2 5 (16.67%) Algorithms
3 1 (3.33%) Management Information System
Operating Systems
1 22 (73.33%) Unix
2 16 (53.33%) Linux
2 16 (53.33%) Windows
Processes & Methodologies
1 17 (56.67%) Migration
2 16 (53.33%) Capacity Management
2 16 (53.33%) Disaster Recovery
3 10 (33.33%) Problem-Solving
4 9 (30.00%) CI/CD
5 7 (23.33%) Data Pipeline
5 7 (23.33%) Machine Learning
6 6 (20.00%) Agile
6 6 (20.00%) ETL
6 6 (20.00%) MapReduce
7 5 (16.67%) Business Intelligence
7 5 (16.67%) Design Patterns
7 5 (16.67%) Unit Testing
8 4 (13.33%) Data Modelling
8 4 (13.33%) Digital Marketing
8 4 (13.33%) Programme Management
9 3 (10.00%) Analytics
9 3 (10.00%) Data Analysis
9 3 (10.00%) Data Engineering
10 2 (6.67%) DevOps
Programming Languages
1 8 (26.67%) Java
1 8 (26.67%) Python
1 8 (26.67%) Scala
2 6 (20.00%) SQL
3 5 (16.67%) Shell Script
4 1 (3.33%) HiveQL
4 1 (3.33%) PL/SQL
Quality Assurance & Compliance
1 2 (6.67%) Data Quality
System Software
1 16 (53.33%) Active Directory
1 16 (53.33%) NFS
2 2 (6.67%) Docker
Systems Management
1 6 (20.00%) Hadoop YARN
2 2 (6.67%) Kubernetes
3 1 (3.33%) Ansible
Vendors
1 16 (53.33%) Isilon
2 7 (23.33%) Dell
3 4 (13.33%) Oracle
3 4 (13.33%) SAP
4 3 (10.00%) Informatica
5 1 (3.33%) Cloudera
5 1 (3.33%) Denodo
5 1 (3.33%) Talend