Apache Spark Contracts in London

Apache Spark
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 9 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 Jun 2024
Same period 2023 Same period 2022
Rank 254 225 182
Rank change year-on-year -29 -43 -47
Contract jobs citing Apache Spark 149 281 600
As % of all contract jobs advertised in London 0.85% 1.12% 1.55%
As % of the Application Platforms category 7.09% 10.40% 12.21%
Number of daily rates quoted 116 197 395
10th Percentile £383 £475 £445
25th Percentile £463 £513 £525
Median daily rate (50th Percentile) £575 £600 £625
Median % change year-on-year -4.17% -4.00% +8.70%
75th Percentile £738 £740 £750
90th Percentile £850 £805 £850
England median daily rate £533 £600 £600
% change year-on-year -11.25% - +6.67%
Number of hourly rates quoted 0 2 3
10th Percentile - - £62.35
25th Percentile - - £68.50
Median hourly rate - £90.00 £78.75
Median % change year-on-year - +14.29% +110.00%
75th Percentile - - £84.83
90th Percentile - - £88.47
England median hourly rate £44.62 £78.00 £78.75
% change year-on-year -42.80% -0.95% +202.88%

All Application Platform Skills
London

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 2,102 2,702 4,914
As % of all contract IT jobs advertised in London 11.97% 10.74% 12.69%
Number of daily rates quoted 1,576 1,968 3,505
10th Percentile £275 £313 £350
25th Percentile £406 £450 £440
Median daily rate (50th Percentile) £530 £550 £550
Median % change year-on-year -3.64% - +6.80%
75th Percentile £688 £700 £675
90th Percentile £850 £800 £775
England median daily rate £500 £525 £513
% change year-on-year -4.76% +2.44% +7.89%
Number of hourly rates quoted 30 27 44
10th Percentile £15.50 £17.10 £14.83
25th Percentile £23.75 £22.56 £26.00
Median hourly rate £30.16 £35.00 £36.25
Median % change year-on-year -13.83% -3.45% -3.33%
75th Percentile £33.58 £74.88 £65.94
90th Percentile £58.25 £85.80 £77.88
England median hourly rate £30.16 £48.50 £22.00
% change year-on-year -37.81% +120.45% +11.42%

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Apache Spark in London.

Daily rate trend for Apache Spark in London

Apache Spark
Daily Rate Histogram in London

Daily rate distribution for jobs citing Apache Spark in London over the 6 months to 9 June 2024.

Daily rate histogram for Apache Spark in London

Apache Spark
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Apache Spark in London.

Hourly rate trend for Apache Spark in London

Apache Spark
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the London region over the 6 months to 9 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +24 17 £713 +7.55% 5
West London +25 2 - - 6
Apache Spark
England

Apache Spark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 44 (29.53%) Apache
2 19 (12.75%) Apache Airflow
3 1 (0.67%) Apache Pulsar
3 1 (0.67%) Confluence
3 1 (0.67%) SharePoint
Applications
1 5 (3.36%) Microsoft Excel
2 2 (1.34%) Microsoft Office
2 2 (1.34%) Microsoft PowerPoint
Business Applications
1 2 (1.34%) Dynamics CRM
2 1 (0.67%) SAP GRC
2 1 (0.67%) Shopify
Cloud Services
1 68 (45.64%) Azure
2 59 (39.60%) AWS
3 23 (15.44%) Azure Data Factory
4 22 (14.77%) Azure Synapse Analytics
5 20 (13.42%) Amazon EMR
5 20 (13.42%) Power Platform
6 17 (11.41%) GCP
7 14 (9.40%) Amazon S3
7 14 (9.40%) Serverless
8 13 (8.72%) Snowflake
9 11 (7.38%) Amazon Kinesis
9 11 (7.38%) Azure Logic Apps
10 10 (6.71%) Entra ID
11 9 (6.04%) AWS Lambda
12 8 (5.37%) Azure Cosmos DB
12 8 (5.37%) GitHub
13 7 (4.70%) Amazon EC2
14 6 (4.03%) Azure Monitor
15 5 (3.36%) AWS CloudFormation
15 5 (3.36%) Azure DevOps
Database & Business Intelligence
1 77 (51.68%) Big Data
2 49 (32.89%) Data Warehouse
3 39 (26.17%) Data Lake
4 35 (23.49%) Hadoop
5 30 (20.13%) NoSQL
6 22 (14.77%) Apache Hive
7 20 (13.42%) Power BI
8 18 (12.08%) Delta Lake
9 16 (10.74%) Amazon Redshift
10 14 (9.40%) Azure SQL Database
10 14 (9.40%) Relational Database
11 13 (8.72%) Impala
12 12 (8.05%) Tableau
13 11 (7.38%) Spark SQL
13 11 (7.38%) SQL Server
14 10 (6.71%) Parquet
15 8 (5.37%) Flink
15 8 (5.37%) HBase
15 8 (5.37%) MongoDB
16 6 (4.03%) Sqoop
Development Applications
1 15 (10.07%) Git
2 14 (9.40%) Jenkins
3 8 (5.37%) JIRA
4 7 (4.70%) Subversion
5 6 (4.03%) Maven
5 6 (4.03%) TeamCity
6 4 (2.68%) Deequ
7 3 (2.01%) GitLab
7 3 (2.01%) JUnit
8 2 (1.34%) Android Studio
8 2 (1.34%) Jaeger
8 2 (1.34%) Liquibase
8 2 (1.34%) Mockito
8 2 (1.34%) ScalaTest
8 2 (1.34%) Visual Studio Code
9 1 (0.67%) CircleCI
9 1 (0.67%) git-flow
9 1 (0.67%) GoCD
9 1 (0.67%) IBM UrbanCode
9 1 (0.67%) Terragrunt
General
1 45 (30.20%) Social Skills
2 40 (26.85%) Finance
3 37 (24.83%) Analytical Skills
4 16 (10.74%) Banking
5 7 (4.70%) Investment Banking
6 5 (3.36%) Marketing
6 5 (3.36%) Presentation Skills
7 4 (2.68%) Public Sector
8 3 (2.01%) Inclusion and Diversity
9 2 (1.34%) Czech Language
9 2 (1.34%) Legal
9 2 (1.34%) Telecoms
10 1 (0.67%) Financial Institution
10 1 (0.67%) Games
10 1 (0.67%) Pharmaceutical
10 1 (0.67%) Retail
Job Titles
1 61 (40.94%) Data Engineer
2 29 (19.46%) Developer
3 24 (16.11%) Senior
4 20 (13.42%) Architect
5 15 (10.07%) Azure Data Engineer
5 15 (10.07%) Azure Engineer
6 14 (9.40%) Senior Data Engineer
7 13 (8.72%) Java Developer
7 13 (8.72%) Lead
7 13 (8.72%) Scala Developer
7 13 (8.72%) Solutions Architect
8 11 (7.38%) AWS Engineer
9 8 (5.37%) AWS Architect
9 8 (5.37%) AWS Data Engineer
9 8 (5.37%) AWS Solution Architect
10 7 (4.70%) Data Architect
10 7 (4.70%) Lead Data Engineer
11 5 (3.36%) Analyst
11 5 (3.36%) Data Analyst
11 5 (3.36%) Software Engineer
Libraries, Frameworks & Software Standards
1 54 (36.24%) Kafka
2 42 (28.19%) PySpark
3 10 (6.71%) Spark Streaming
4 9 (6.04%) Apache Avro
5 8 (5.37%) SAML
6 5 (3.36%) Apache NiFi
6 5 (3.36%) JSON
6 5 (3.36%) JSON Schema
7 4 (2.68%) ARM Templates
7 4 (2.68%) Great Expectations
7 4 (2.68%) TensorFlow
8 3 (2.01%) ADO
8 3 (2.01%) PyTorch
8 3 (2.01%) Web Services
9 2 (1.34%) .NET
9 2 (1.34%) Java Concurrency
9 2 (1.34%) Middleware
9 2 (1.34%) Pandas
9 2 (1.34%) scikit-learn
9 2 (1.34%) Spring Boot
Miscellaneous
1 13 (8.72%) Algorithms
2 9 (6.04%) Hedge funds
3 6 (4.03%) Data Structures
4 4 (2.68%) Cloud Native
4 4 (2.68%) Distributed Systems
5 2 (1.34%) Cyber Threat
5 2 (1.34%) Data Protection Act
5 2 (1.34%) Derivative
5 2 (1.34%) Distributed Computing
5 2 (1.34%) Life Science
5 2 (1.34%) Market Risk
5 2 (1.34%) Onboarding
5 2 (1.34%) Team-Oriented Environment
6 1 (0.67%) Enterprise Software
6 1 (0.67%) Greenfield Project
6 1 (0.67%) Mobile App
6 1 (0.67%) NHS
6 1 (0.67%) Public Cloud
6 1 (0.67%) Reference Data
6 1 (0.67%) Self-Motivation
Operating Systems
1 9 (6.04%) Linux
2 6 (4.03%) Unix
3 2 (1.34%) Android
3 2 (1.34%) Red Hat Enterprise Linux
4 1 (0.67%) VMS
Processes & Methodologies
1 67 (44.97%) ETL
2 61 (40.94%) Data Pipeline
3 52 (34.90%) CI/CD
4 47 (31.54%) Agile
5 45 (30.20%) Analytics
6 41 (27.52%) Data Engineering
7 34 (22.82%) DevOps
8 33 (22.15%) Problem-Solving
9 31 (20.81%) Business Intelligence
10 27 (18.12%) Continuous Integration
11 26 (17.45%) Data Modelling
12 25 (16.78%) Machine Learning
13 23 (15.44%) Data Science
14 16 (10.74%) Unit Testing
15 15 (10.07%) SDLC
15 15 (10.07%) Software Engineering
16 14 (9.40%) Test Automation
17 13 (8.72%) Scrum
18 12 (8.05%) Computer Science
19 11 (7.38%) Visualisation
Programming Languages
1 97 (65.10%) Python
2 84 (56.38%) SQL
3 58 (38.93%) Scala
4 51 (34.23%) Java
5 8 (5.37%) C++
6 7 (4.70%) C#
6 7 (4.70%) Shell Script
6 7 (4.70%) T-SQL
7 3 (2.01%) Bash
7 3 (2.01%) Haskell
7 3 (2.01%) JavaScript
8 2 (1.34%) C
8 2 (1.34%) Go
8 2 (1.34%) Gremlin
8 2 (1.34%) Groovy
8 2 (1.34%) R
8 2 (1.34%) U-SQL
9 1 (0.67%) Bicep
9 1 (0.67%) Julia
9 1 (0.67%) TypeScript
Qualifications
1 14 (9.40%) Degree
2 11 (7.38%) Security Cleared
3 10 (6.71%) SC Cleared
4 7 (4.70%) Computer Science Degree
5 6 (4.03%) Azure Certification
6 4 (2.68%) Numerate Degree
7 3 (2.01%) Master's Degree
7 3 (2.01%) Microsoft Certification
8 2 (1.34%) AWS Certification
8 2 (1.34%) AWS Certified Solutions Architect
8 2 (1.34%) BPSS Clearance
9 1 (0.67%) DV Cleared
Quality Assurance & Compliance
1 23 (15.44%) Data Quality
2 3 (2.01%) GDPR
3 1 (0.67%) Accessibility
3 1 (0.67%) California Consumer Privacy Act
3 1 (0.67%) GRC
System Software
1 13 (8.72%) Docker
2 8 (5.37%) HDFS
3 1 (0.67%) Apache Flume
3 1 (0.67%) Ceph
3 1 (0.67%) NFS
Systems Management
1 19 (12.75%) Kubernetes
2 12 (8.05%) Terraform
3 6 (4.03%) Hadoop YARN
4 4 (2.68%) Ansible
5 2 (1.34%) Ambari
5 2 (1.34%) Ganglia
5 2 (1.34%) Grafana
5 2 (1.34%) Oozie
5 2 (1.34%) Prometheus
5 2 (1.34%) Puppet
6 1 (0.67%) Docker Swarm
6 1 (0.67%) Mesos
6 1 (0.67%) Progress Chef
6 1 (0.67%) RSA Archer
Vendors
1 47 (31.54%) Databricks
2 19 (12.75%) Microsoft
3 11 (7.38%) Talend
4 10 (6.71%) Oracle
5 9 (6.04%) Google
6 7 (4.70%) Informatica
7 5 (3.36%) Cloudera
8 3 (2.01%) Splunk
9 2 (1.34%) AppDynamics
9 2 (1.34%) CyberArk
9 2 (1.34%) SAP
10 1 (0.67%) Ab Initio
10 1 (0.67%) Adobe
10 1 (0.67%) IBM
10 1 (0.67%) Okta
10 1 (0.67%) Salesforce
10 1 (0.67%) Sitecore
10 1 (0.67%) Symantec
10 1 (0.67%) Teradata
10 1 (0.67%) Varonis