Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 433 269 306
Rank change year-on-year -164 +37 -3
Permanent jobs citing Apache Spark 162 469 911
As % of all permanent jobs with a WFH option 0.47% 1.22% 1.23%
As % of the Application Platforms category 3.99% 10.35% 8.96%
Number of salaries quoted 130 287 483
10th Percentile £49,900 £60,000 £50,000
25th Percentile £62,500 £66,250 £60,625
Median annual salary (50th Percentile) £82,500 £100,000 £80,000
Median % change year-on-year -17.50% +25.00% -
75th Percentile £110,000 £130,000 £95,000
90th Percentile £115,000 £160,000 £108,750
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +3.33%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 4,056 4,532 10,168
As % of all permanent jobs with a WFH option 11.68% 11.78% 13.69%
Number of salaries quoted 2,906 3,483 5,301
10th Percentile £31,250 £32,400 £31,250
25th Percentile £41,250 £43,750 £41,250
Median annual salary (50th Percentile) £57,500 £60,000 £55,000
Median % change year-on-year -4.17% +9.09% +4.76%
75th Percentile £80,000 £80,000 £75,040
90th Percentile £122,500 £100,000 £92,500
UK median annual salary £50,000 £55,000 £55,000
% change year-on-year -9.09% - +4.76%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 1 June 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 49 (30.25%) Apache
2 23 (14.20%) Apache Airflow
3 7 (4.32%) Confluence
4 2 (1.23%) Jupyter
5 1 (0.62%) Apache Solr
Applications
1 7 (4.32%) Microsoft Excel
Business Applications
1 4 (2.47%) Primavera
Cloud Services
1 78 (48.15%) AWS
2 65 (40.12%) Azure
3 43 (26.54%) GCP
4 28 (17.28%) Amazon S3
5 23 (14.20%) Snowflake
6 20 (12.35%) Power Platform
6 20 (12.35%) SaaS
7 18 (11.11%) Azure Data Factory
8 16 (9.88%) dbt
9 15 (9.26%) Amazon SQS
10 14 (8.64%) Google Docs
10 14 (8.64%) Lucidchart
10 14 (8.64%) Miro
10 14 (8.64%) Slack
11 12 (7.41%) Azure Synapse Analytics
12 11 (6.79%) Azure DevOps
13 10 (6.17%) GitHub
13 10 (6.17%) Serverless
14 8 (4.94%) Amazon EMR
15 7 (4.32%) Power Automate
Communications & Networking
1 14 (8.64%) Wireless
2 4 (2.47%) Firewall
3 2 (1.23%) HTTP
3 2 (1.23%) Network Security
Database & Business Intelligence
1 88 (54.32%) Big Data
2 48 (29.63%) Hadoop
3 44 (27.16%) Data Warehouse
4 43 (26.54%) Data Lake
5 25 (15.43%) NoSQL
6 21 (12.96%) SQL Server
7 20 (12.35%) Power BI
8 18 (11.11%) Elasticsearch
9 15 (9.26%) Amazon Redshift
9 15 (9.26%) Flink
9 15 (9.26%) Relational Database
10 14 (8.64%) BigQuery
10 14 (8.64%) Redis
10 14 (8.64%) Scylla
11 12 (7.41%) Data Mining
12 10 (6.17%) PostgreSQL
13 9 (5.56%) MySQL
14 8 (4.94%) Delta Lake
14 8 (4.94%) Spark SQL
15 7 (4.32%) Amazon Athena
Development Applications
1 12 (7.41%) Git
2 11 (6.79%) Jenkins
3 7 (4.32%) JIRA
4 6 (3.70%) Oracle Forms
4 6 (3.70%) Spinnaker
5 4 (2.47%) Bitbucket
6 3 (1.85%) Deequ
6 3 (1.85%) Octopus Deploy
7 2 (1.23%) MLflow
General
1 45 (27.78%) Social Skills
2 31 (19.14%) Finance
3 23 (14.20%) Analytical Skills
4 17 (10.49%) Games
5 15 (9.26%) Inclusion and Diversity
6 11 (6.79%) Banking
7 4 (2.47%) Influencing Skills
7 4 (2.47%) Music Industry
8 3 (1.85%) Legal
8 3 (1.85%) Manufacturing
9 2 (1.23%) Advertising
9 2 (1.23%) French Language
9 2 (1.23%) Marketing
9 2 (1.23%) Retail
9 2 (1.23%) Spanish Language
10 1 (0.62%) Automotive
10 1 (0.62%) Presentation Skills
10 1 (0.62%) Telecoms
Job Titles
1 60 (37.04%) Data Engineer
2 52 (32.10%) Senior
3 33 (20.37%) Software Engineer
4 25 (15.43%) Senior Data Engineer
5 19 (11.73%) Principal Engineer
6 17 (10.49%) Lead
7 16 (9.88%) Data Manager
7 16 (9.88%) Principal Software Engineer
8 14 (8.64%) Python Data Engineer
8 14 (8.64%) Python Engineer
9 13 (8.02%) Architect
9 13 (8.02%) Cloud Engineer
10 12 (7.41%) Senior Software Engineer
11 11 (6.79%) Data Architect
11 11 (6.79%) Developer
12 9 (5.56%) Engineering Manager
12 9 (5.56%) Lead Data Engineer
13 8 (4.94%) Big Data Manager
14 7 (4.32%) Big Data Architect
14 7 (4.32%) Technical Leader
Libraries, Frameworks & Software Standards
1 68 (41.98%) Kafka
2 21 (12.96%) PySpark
3 14 (8.64%) Apache Beam
3 14 (8.64%) GraphQL
4 10 (6.17%) React
5 6 (3.70%) Pandas
6 5 (3.09%) Spring
6 5 (3.09%) Spring Boot
7 3 (1.85%) .NET
7 3 (1.85%) Apache NiFi
7 3 (1.85%) Great Expectations
8 2 (1.23%) FastAPI
8 2 (1.23%) Flask
8 2 (1.23%) JSON
8 2 (1.23%) NumPy
8 2 (1.23%) Spark Streaming
9 1 (0.62%) Apache Camel
9 1 (0.62%) Regular Expression
9 1 (0.62%) REST
9 1 (0.62%) Unreal Engine
Miscellaneous
1 36 (22.22%) Data Structures
2 27 (16.67%) Algorithms
3 13 (8.02%) Cloud Native
4 9 (5.56%) Product Ownership
5 8 (4.94%) Greenfield Project
6 5 (3.09%) Mainframe
7 4 (2.47%) Distributed Systems
7 4 (2.47%) Renewable Energy
8 2 (1.23%) Cyberattack
8 2 (1.23%) Data Centre
8 2 (1.23%) Distributed Computing
8 2 (1.23%) Social Media
8 2 (1.23%) Taxonomies
8 2 (1.23%) Virtual Team
9 1 (0.62%) IoT
9 1 (0.62%) Mobile Payment
9 1 (0.62%) Virtual Reality
Operating Systems
1 4 (2.47%) Linux
Processes & Methodologies
1 67 (41.36%) Data Pipeline
2 61 (37.65%) Data Engineering
3 45 (27.78%) Data Modelling
3 45 (27.78%) Software Engineering
4 43 (26.54%) Agile
5 42 (25.93%) Data Science
6 38 (23.46%) CI/CD
7 37 (22.84%) Analytics
8 35 (21.60%) ETL
9 34 (20.99%) Machine Learning
10 33 (20.37%) Problem-Solving
11 26 (16.05%) Business Intelligence
12 25 (15.43%) Stakeholder Management
13 24 (14.81%) Data Management
13 24 (14.81%) DevOps
14 23 (14.20%) High Availability
15 22 (13.58%) Artificial Intelligence
16 21 (12.96%) Data Governance
17 20 (12.35%) Technical Leadership
18 18 (11.11%) Data Integration
Programming Languages
1 106 (65.43%) Python
2 83 (51.23%) SQL
3 55 (33.95%) Java
4 47 (29.01%) Scala
5 27 (16.67%) Go
6 14 (8.64%) Bash
7 13 (8.02%) Kotlin
8 12 (7.41%) TypeScript
9 9 (5.56%) C#
10 8 (4.94%) Clojure
11 7 (4.32%) Data Analysis Expressions
12 5 (3.09%) C
13 4 (2.47%) R
14 2 (1.23%) JavaScript
14 2 (1.23%) PHP
15 1 (0.62%) PL/SQL
15 1 (0.62%) XPath
Qualifications
1 19 (11.73%) Degree
2 6 (3.70%) Security Cleared
3 5 (3.09%) DV Cleared
4 4 (2.47%) CIMA
4 4 (2.47%) DBS Check
4 4 (2.47%) SC Cleared
5 3 (1.85%) ISTQB
6 2 (1.23%) Master's Degree
6 2 (1.23%) Microsoft Certification
7 1 (0.62%) Computer Science Degree
Quality Assurance & Compliance
1 18 (11.11%) Data Quality
2 4 (2.47%) QA
2 4 (2.47%) Solvency II
3 2 (1.23%) GDPR
4 1 (0.62%) Accessibility
System Software
1 15 (9.26%) Docker
2 1 (0.62%) HDFS
Systems Management
1 53 (32.72%) Kubernetes
2 15 (9.26%) Terraform
3 3 (1.85%) Kibana
4 2 (1.23%) Ansible
4 2 (1.23%) Argo
4 2 (1.23%) Progress Chef
Vendors
1 60 (37.04%) Databricks
2 28 (17.28%) Google
3 17 (10.49%) Microsoft
4 14 (8.64%) Dell
5 13 (8.02%) Teradata
6 10 (6.17%) Oracle
7 6 (3.70%) YouTube
8 4 (2.47%) Confluent
8 4 (2.47%) Informatica
8 4 (2.47%) SAP
9 3 (1.85%) Cloudera
9 3 (1.85%) SnapLogic
10 2 (1.23%) Apple
10 2 (1.23%) CrowdStrike
10 2 (1.23%) Hootsuite
10 2 (1.23%) Hortonworks
11 1 (0.62%) Talend