Apache Spark Contracts

Apache Spark
UK

The following table provides summary statistics for contract job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 353 354 235
Rank change year-on-year +1 -119 -47
Contract jobs citing Apache Spark 234 373 1,098
As % of all contract jobs advertised in the UK 0.54% 0.67% 1.25%
As % of the Application Platforms category 5.50% 6.12% 10.03%
Number of daily rates quoted 172 246 738
10th Percentile £376 £475 £444
25th Percentile £447 £513 £513
Median daily rate (50th Percentile) £525 £600 £600
Median % change year-on-year -12.50% - +6.67%
75th Percentile £650 £738 £711
90th Percentile £775 £806 £825
UK excluding London median daily rate £475 £625 £550
% change year-on-year -24.00% +13.64% +9.18%
Number of hourly rates quoted 2 11 3
10th Percentile £26.18 £70.50 £62.35
25th Percentile £32.86 - £68.50
Median hourly rate £44.62 £78.00 £78.75
Median % change year-on-year -42.80% -0.95% +205.83%
75th Percentile £57.00 £90.00 £84.83
90th Percentile £64.05 - £88.47
UK excluding London median hourly rate £44.62 £78.00 -
% change year-on-year -42.80% - -

All Application Platform Skills
UK

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 4,252 6,095 10,952
As % of all contract IT jobs advertised in the UK 9.88% 10.87% 12.50%
Number of daily rates quoted 2,959 4,271 7,550
10th Percentile £258 £263 £275
25th Percentile £363 £400 £408
Median daily rate (50th Percentile) £500 £513 £513
Median % change year-on-year -2.44% - +7.89%
75th Percentile £613 £638 £625
90th Percentile £750 £750 £713
UK excluding London median daily rate £450 £475 £450
% change year-on-year -5.26% +5.56% +5.88%
Number of hourly rates quoted 162 148 208
10th Percentile £13.28 £16.25 £13.41
25th Percentile £15.50 £21.00 £16.00
Median hourly rate £30.08 £51.25 £22.75
Median % change year-on-year -41.31% +125.27% +10.98%
75th Percentile £50.47 £66.00 £54.00
90th Percentile £70.00 £78.00 £75.00
UK excluding London median hourly rate £30.00 £40.00 £18.50
% change year-on-year -25.00% +116.22% -2.63%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Apache Spark.

Daily rate trend for Apache Spark in the UK

Apache Spark
Daily Rate Histogram

Daily rate distribution for jobs citing Apache Spark over the 6 months to 1 June 2024.

Daily rate histogram for Apache Spark in the UK

Apache Spark
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Apache Spark.

Hourly rate trend for Apache Spark in the UK

Apache Spark
Hourly Rate Histogram

Hourly rate distribution of jobs citing Apache Spark over the 6 months to 1 June 2024.

Hourly rate histogram for Apache Spark in the UK

Apache Spark
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the UK over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -27 204 £535 -10.83% 132
London -16 147 £575 -4.17% 90
UK excluding London +59 73 £475 -24.00% 56
Work from Home +24 67 £507 -22.00% 66
North of England +50 32 £510 +7.37% 16
Scotland - 17 £400 - 10
Yorkshire +32 16 £507 - 3
North West +33 15 £510 +7.37% 12
Midlands +27 11 £438 -35.19% 6
East Midlands +18 8 £438 -35.19% 3
South East +6 8 £375 -44.44% 7
West Midlands +12 3 £535 -14.40% 3
South West -13 3 £630 -3.08% 14
Northern Ireland +2 1 £425 - 1
East of England 0 1 £410 -28.70% 4
North East - 1 - - 1

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 62 (26.50%) Apache
2 29 (12.39%) Apache Airflow
3 1 (0.43%) Apache Pulsar
3 1 (0.43%) Confluence
3 1 (0.43%) SharePoint
Applications
1 5 (2.14%) Microsoft Excel
2 2 (0.85%) Microsoft Office
2 2 (0.85%) Microsoft PowerPoint
Business Applications
1 2 (0.85%) Dynamics CRM
2 1 (0.43%) SAP GRC
2 1 (0.43%) Shopify
Cloud Services
1 116 (49.57%) Azure
2 106 (45.30%) AWS
3 46 (19.66%) GCP
4 32 (13.68%) Azure Data Factory
5 31 (13.25%) Amazon S3
5 31 (13.25%) Serverless
6 30 (12.82%) Amazon EMR
7 27 (11.54%) Azure Synapse Analytics
8 23 (9.83%) Power Platform
8 23 (9.83%) Snowflake
9 18 (7.69%) AWS Lambda
10 12 (5.13%) Amazon EC2
10 12 (5.13%) Amazon Kinesis
10 12 (5.13%) Cloud Computing
11 11 (4.70%) Azure Logic Apps
12 10 (4.27%) Entra ID
13 9 (3.85%) GitHub
14 8 (3.42%) Azure Data Lake Analytics
14 8 (3.42%) Azure DevOps
14 8 (3.42%) OpenShift
Communications & Networking
1 5 (2.14%) FTP
Database & Business Intelligence
1 132 (56.41%) Big Data
2 75 (32.05%) Hadoop
3 63 (26.92%) Data Warehouse
4 58 (24.79%) Data Lake
5 36 (15.38%) Apache Hive
6 35 (14.96%) NoSQL
7 32 (13.68%) Amazon Redshift
8 23 (9.83%) Impala
8 23 (9.83%) Power BI
9 22 (9.40%) Relational Database
10 21 (8.97%) Spark SQL
11 20 (8.55%) Delta Lake
12 17 (7.26%) SQL Server
13 16 (6.84%) BigQuery
14 15 (6.41%) Amazon Athena
15 14 (5.98%) Tableau
16 13 (5.56%) Azure SQL Database
17 12 (5.13%) Flink
18 11 (4.70%) HBase
19 10 (4.27%) MySQL
Development Applications
1 38 (16.24%) Git
2 24 (10.26%) Jenkins
3 19 (8.12%) JIRA
4 10 (4.27%) Maven
5 8 (3.42%) Subversion
6 6 (2.56%) GitLab
6 6 (2.56%) TeamCity
7 4 (1.71%) Cypress.io
7 4 (1.71%) Deequ
7 4 (1.71%) Gradle
7 4 (1.71%) JUnit
8 3 (1.28%) Mockito
9 2 (0.85%) Android Studio
9 2 (0.85%) Ant
9 2 (0.85%) Jaeger
9 2 (0.85%) Liquibase
9 2 (0.85%) ScalaTest
9 2 (0.85%) Visual Studio Code
10 1 (0.43%) CircleCI
10 1 (0.43%) GoCD
General
1 66 (28.21%) Social Skills
2 58 (24.79%) Finance
3 55 (23.50%) Analytical Skills
4 28 (11.97%) Banking
5 12 (5.13%) Investment Banking
6 11 (4.70%) Public Sector
7 7 (2.99%) Marketing
8 6 (2.56%) Pharmaceutical
8 6 (2.56%) Presentation Skills
9 5 (2.14%) Manufacturing
10 4 (1.71%) Inclusion and Diversity
11 3 (1.28%) Legal
12 2 (0.85%) Czech Language
12 2 (0.85%) Retail
12 2 (0.85%) Telecoms
13 1 (0.43%) Back Office
13 1 (0.43%) Corporate Banking
13 1 (0.43%) Financial Institution
13 1 (0.43%) Law
13 1 (0.43%) Publishing
Job Titles
1 88 (37.61%) Data Engineer
2 57 (24.36%) Developer
3 39 (16.67%) Architect
4 32 (13.68%) Senior
5 25 (10.68%) Solutions Architect
6 22 (9.40%) Java Developer
7 20 (8.55%) Azure Engineer
8 19 (8.12%) Senior Data Engineer
9 17 (7.26%) Azure Data Engineer
10 15 (6.41%) Scala Developer
11 13 (5.56%) Data Architect
11 13 (5.56%) Lead
12 12 (5.13%) AWS Engineer
13 10 (4.27%) AWS Architect
14 9 (3.85%) AWS Solution Architect
15 8 (3.42%) Analyst
15 8 (3.42%) Cloud Engineer
15 8 (3.42%) Data Analyst
15 8 (3.42%) Lead Data Engineer
15 8 (3.42%) Software Engineer
Libraries, Frameworks & Software Standards
1 97 (41.45%) Kafka
2 50 (21.37%) PySpark
3 13 (5.56%) Elastic Stack
3 13 (5.56%) JSON
4 12 (5.13%) Spring
4 12 (5.13%) Spring Boot
5 11 (4.70%) Spark Streaming
6 10 (4.27%) RESTful
7 9 (3.85%) Apache Avro
8 8 (3.42%) OpenTracing
8 8 (3.42%) SAML
8 8 (3.42%) XML
9 7 (2.99%) Apache NiFi
10 5 (2.14%) .NET
10 5 (2.14%) JSON Schema
10 5 (2.14%) Pandas
10 5 (2.14%) Web Services
11 4 (1.71%) .NET Core
11 4 (1.71%) ARM Templates
11 4 (1.71%) TensorFlow
Miscellaneous
1 16 (6.84%) Algorithms
2 15 (6.41%) Data Structures
3 12 (5.13%) Distributed Systems
4 9 (3.85%) Hedge funds
5 8 (3.42%) Cloud Native
6 4 (1.71%) Virtual Team
7 3 (1.28%) Multi-touch
7 3 (1.28%) Onboarding
7 3 (1.28%) Self-Motivation
8 2 (0.85%) Cyber Threat
8 2 (0.85%) Data Protection Act
8 2 (0.85%) Derivative
8 2 (0.85%) Distributed Computing
8 2 (0.85%) Greenfield Project
8 2 (0.85%) Life Science
8 2 (0.85%) Market Risk
9 1 (0.43%) Enterprise Software
9 1 (0.43%) Mobile App
9 1 (0.43%) NHS
9 1 (0.43%) Public Cloud
Operating Systems
1 15 (6.41%) Linux
2 13 (5.56%) Unix
3 2 (0.85%) Android
3 2 (0.85%) Red Hat Enterprise Linux
4 1 (0.43%) VMS
Processes & Methodologies
1 102 (43.59%) ETL
2 85 (36.32%) Data Pipeline
3 74 (31.62%) CI/CD
4 70 (29.91%) Analytics
5 69 (29.49%) Agile
6 60 (25.64%) Data Engineering
7 58 (24.79%) Data Modelling
8 52 (22.22%) DevOps
9 44 (18.80%) Problem-Solving
10 38 (16.24%) Business Intelligence
11 37 (15.81%) Continuous Integration
12 35 (14.96%) Data Science
12 35 (14.96%) Machine Learning
13 31 (13.25%) Test Automation
14 30 (12.82%) Software Engineering
15 27 (11.54%) Data Integration
16 26 (11.11%) Microservices
17 24 (10.26%) Containerisation
18 23 (9.83%) SDLC
19 22 (9.40%) Computer Science
Programming Languages
1 147 (62.82%) Python
2 129 (55.13%) SQL
3 94 (40.17%) Java
4 79 (33.76%) Scala
5 15 (6.41%) C#
6 12 (5.13%) Shell Script
7 9 (3.85%) C++
7 9 (3.85%) Kotlin
7 9 (3.85%) Perl
8 7 (2.99%) Bash
8 7 (2.99%) R
8 7 (2.99%) T-SQL
9 6 (2.56%) JavaScript
10 3 (1.28%) C
10 3 (1.28%) PL/SQL
11 2 (0.85%) Go
11 2 (0.85%) Groovy
11 2 (0.85%) Haskell
11 2 (0.85%) U-SQL
12 1 (0.43%) Gremlin
Qualifications
1 21 (8.97%) Security Cleared
2 20 (8.55%) Degree
3 13 (5.56%) SC Cleared
4 11 (4.70%) Computer Science Degree
5 6 (2.56%) Azure Certification
6 4 (1.71%) AWS Certification
6 4 (1.71%) BPSS Clearance
6 4 (1.71%) DV Cleared
6 4 (1.71%) Numerate Degree
7 3 (1.28%) Master's Degree
7 3 (1.28%) Microsoft Certification
8 2 (0.85%) AWS Certified Solutions Architect
8 2 (0.85%) PhD
9 1 (0.43%) OCP
9 1 (0.43%) Oracle Certification
Quality Assurance & Compliance
1 34 (14.53%) Data Quality
2 4 (1.71%) GDPR
3 3 (1.28%) Accessibility
3 3 (1.28%) QA
4 2 (0.85%) California Consumer Privacy Act
5 1 (0.43%) GRC
System Software
1 28 (11.97%) Docker
2 13 (5.56%) HDFS
3 1 (0.43%) Apache Flume
3 1 (0.43%) Ceph
3 1 (0.43%) NFS
Systems Management
1 37 (15.81%) Kubernetes
2 24 (10.26%) Terraform
3 10 (4.27%) Prometheus
4 8 (3.42%) Zipkin
5 7 (2.99%) Hadoop YARN
6 4 (1.71%) Ansible
6 4 (1.71%) Grafana
7 2 (0.85%) Ambari
7 2 (0.85%) Oozie
7 2 (0.85%) Puppet
8 1 (0.43%) Control-M
8 1 (0.43%) Docker Swarm
8 1 (0.43%) Ganglia
8 1 (0.43%) Kibana
8 1 (0.43%) Mesos
8 1 (0.43%) Progress Chef
8 1 (0.43%) RSA Archer
Vendors
1 59 (25.21%) Databricks
2 39 (16.67%) Microsoft
3 24 (10.26%) Google
4 19 (8.12%) Talend
5 16 (6.84%) Oracle
6 14 (5.98%) Informatica
7 9 (3.85%) Cloudera
8 6 (2.56%) Teradata
9 5 (2.14%) Splunk
10 3 (1.28%) Ab Initio
10 3 (1.28%) SAP
11 2 (0.85%) AppDynamics
11 2 (0.85%) CyberArk
12 1 (0.43%) Ariba
12 1 (0.43%) Confluent
12 1 (0.43%) IBM
12 1 (0.43%) Okta
12 1 (0.43%) OneTrust
12 1 (0.43%) Sage
12 1 (0.43%) Varonis