Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 9 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 Jun 2024
Same period 2023 Same period 2022
Rank 425 287 304
Rank change year-on-year -138 +17 -13
Permanent jobs citing Apache Spark 162 438 914
As % of all permanent jobs with a WFH option 0.46% 1.16% 1.21%
As % of the Application Platforms category 3.95% 9.92% 8.87%
Number of salaries quoted 131 276 480
10th Percentile £49,000 £60,000 £50,000
25th Percentile £62,375 £67,188 £60,625
Median annual salary (50th Percentile) £85,000 £100,000 £80,000
Median % change year-on-year -15.00% +25.00% -
75th Percentile £107,500 £140,000 £95,000
90th Percentile £115,000 £160,000 £108,750
UK median annual salary £80,000 £87,500 £75,000
% change year-on-year -8.57% +16.67% -

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 4,098 4,415 10,299
As % of all permanent jobs with a WFH option 11.62% 11.70% 13.64%
Number of salaries quoted 2,937 3,420 5,313
10th Percentile £31,250 £32,500 £31,250
25th Percentile £41,250 £44,000 £41,250
Median annual salary (50th Percentile) £57,500 £60,000 £55,000
Median % change year-on-year -4.17% +9.09% +4.76%
75th Percentile £82,500 £78,750 £75,500
90th Percentile £122,500 £100,000 £92,500
UK median annual salary £50,000 £55,000 £55,000
% change year-on-year -9.09% - +4.76%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 9 June 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 49 (30.25%) Apache
2 23 (14.20%) Apache Airflow
3 9 (5.56%) Confluence
4 2 (1.23%) Jupyter
Applications
1 7 (4.32%) Microsoft Excel
Business Applications
1 4 (2.47%) Primavera
Cloud Services
1 79 (48.77%) AWS
2 65 (40.12%) Azure
3 41 (25.31%) GCP
4 27 (16.67%) Amazon S3
5 23 (14.20%) Power Platform
5 23 (14.20%) Snowflake
6 20 (12.35%) Azure Data Factory
7 19 (11.73%) SaaS
8 15 (9.26%) dbt
9 14 (8.64%) Amazon SQS
9 14 (8.64%) Azure DevOps
10 13 (8.02%) Azure Synapse Analytics
10 13 (8.02%) Google Docs
10 13 (8.02%) Lucidchart
10 13 (8.02%) Miro
10 13 (8.02%) Slack
11 11 (6.79%) GitHub
12 10 (6.17%) Serverless
13 8 (4.94%) Amazon EMR
14 7 (4.32%) Amazon Kinesis
Communications & Networking
1 12 (7.41%) Wireless
2 3 (1.85%) Firewall
3 2 (1.23%) HTTP
3 2 (1.23%) Network Security
Database & Business Intelligence
1 86 (53.09%) Big Data
2 47 (29.01%) Hadoop
3 44 (27.16%) Data Warehouse
4 43 (26.54%) Data Lake
5 26 (16.05%) NoSQL
6 23 (14.20%) Power BI
7 21 (12.96%) SQL Server
8 16 (9.88%) Amazon Redshift
8 16 (9.88%) Elasticsearch
9 15 (9.26%) BigQuery
9 15 (9.26%) Data Mining
9 15 (9.26%) Flink
9 15 (9.26%) Relational Database
10 13 (8.02%) Redis
10 13 (8.02%) Scylla
11 10 (6.17%) PostgreSQL
12 9 (5.56%) MySQL
13 8 (4.94%) Delta Lake
13 8 (4.94%) Spark SQL
14 7 (4.32%) Amazon Athena
Development Applications
1 12 (7.41%) Git
2 11 (6.79%) Jenkins
3 9 (5.56%) JIRA
4 6 (3.70%) Oracle Forms
5 5 (3.09%) Spinnaker
6 4 (2.47%) Bitbucket
7 3 (1.85%) Deequ
7 3 (1.85%) Octopus Deploy
8 2 (1.23%) MLflow
General
1 44 (27.16%) Social Skills
2 32 (19.75%) Finance
3 24 (14.81%) Analytical Skills
4 17 (10.49%) Games
5 14 (8.64%) Inclusion and Diversity
6 10 (6.17%) Banking
7 4 (2.47%) Influencing Skills
7 4 (2.47%) Music Industry
8 3 (1.85%) Legal
8 3 (1.85%) Manufacturing
9 2 (1.23%) Advertising
9 2 (1.23%) French Language
9 2 (1.23%) Marketing
9 2 (1.23%) Retail
9 2 (1.23%) Spanish Language
10 1 (0.62%) Automotive
10 1 (0.62%) Presentation Skills
10 1 (0.62%) Telecoms
Job Titles
1 62 (38.27%) Data Engineer
2 56 (34.57%) Senior
3 33 (20.37%) Software Engineer
4 27 (16.67%) Senior Data Engineer
5 18 (11.11%) Principal Engineer
6 17 (10.49%) Lead
7 15 (9.26%) Data Manager
7 15 (9.26%) Principal Software Engineer
8 14 (8.64%) Senior Software Engineer
9 13 (8.02%) Architect
9 13 (8.02%) Python Data Engineer
9 13 (8.02%) Python Engineer
10 12 (7.41%) Cloud Engineer
11 11 (6.79%) Data Architect
12 10 (6.17%) Developer
13 9 (5.56%) Engineering Manager
13 9 (5.56%) Lead Data Engineer
14 7 (4.32%) Big Data Manager
14 7 (4.32%) Technical Leader
15 6 (3.70%) Big Data Architect
Libraries, Frameworks & Software Standards
1 69 (42.59%) Kafka
2 23 (14.20%) PySpark
3 15 (9.26%) Apache Beam
4 13 (8.02%) GraphQL
5 12 (7.41%) React
6 6 (3.70%) Pandas
7 5 (3.09%) Spring
7 5 (3.09%) Spring Boot
8 3 (1.85%) .NET
8 3 (1.85%) Apache NiFi
8 3 (1.85%) Great Expectations
9 2 (1.23%) FastAPI
9 2 (1.23%) Flask
9 2 (1.23%) NumPy
9 2 (1.23%) Spark Streaming
10 1 (0.62%) JSON
10 1 (0.62%) Lambda Expressions
10 1 (0.62%) scikit-learn
10 1 (0.62%) TensorFlow
10 1 (0.62%) Unreal Engine
Miscellaneous
1 36 (22.22%) Data Structures
2 26 (16.05%) Algorithms
3 13 (8.02%) Cloud Native
4 9 (5.56%) Product Ownership
5 8 (4.94%) Greenfield Project
6 5 (3.09%) Mainframe
7 4 (2.47%) Distributed Systems
7 4 (2.47%) Renewable Energy
8 2 (1.23%) Cyberattack
8 2 (1.23%) Data Centre
8 2 (1.23%) Distributed Computing
8 2 (1.23%) Social Media
8 2 (1.23%) Taxonomies
8 2 (1.23%) Virtual Team
9 1 (0.62%) IoT
9 1 (0.62%) Legacy Systems
9 1 (0.62%) Mobile Payment
9 1 (0.62%) Virtual Reality
Operating Systems
1 4 (2.47%) Linux
Processes & Methodologies
1 70 (43.21%) Data Pipeline
2 63 (38.89%) Data Engineering
3 45 (27.78%) Agile
3 45 (27.78%) Data Modelling
3 45 (27.78%) Software Engineering
4 40 (24.69%) CI/CD
4 40 (24.69%) Data Science
5 39 (24.07%) Analytics
6 37 (22.84%) ETL
7 35 (21.60%) Machine Learning
8 32 (19.75%) Problem-Solving
9 28 (17.28%) DevOps
10 27 (16.67%) Business Intelligence
11 26 (16.05%) Data Management
12 23 (14.20%) Artificial Intelligence
12 23 (14.20%) Data Governance
12 23 (14.20%) Stakeholder Management
13 22 (13.58%) High Availability
14 19 (11.73%) Data Strategy
15 18 (11.11%) Technical Leadership
Programming Languages
1 107 (66.05%) Python
2 85 (52.47%) SQL
3 54 (33.33%) Java
4 48 (29.63%) Scala
5 26 (16.05%) Go
6 15 (9.26%) Kotlin
7 14 (8.64%) TypeScript
8 13 (8.02%) Bash
9 10 (6.17%) Clojure
10 9 (5.56%) C#
11 7 (4.32%) Data Analysis Expressions
12 5 (3.09%) C
13 4 (2.47%) R
14 2 (1.23%) JavaScript
14 2 (1.23%) PHP
15 1 (0.62%) PL/SQL
Qualifications
1 19 (11.73%) Degree
2 6 (3.70%) Security Cleared
3 5 (3.09%) DV Cleared
4 4 (2.47%) CIMA
4 4 (2.47%) DBS Check
4 4 (2.47%) SC Cleared
5 3 (1.85%) ISTQB
6 2 (1.23%) Master's Degree
6 2 (1.23%) Microsoft Certification
7 1 (0.62%) Computer Science Degree
Quality Assurance & Compliance
1 19 (11.73%) Data Quality
2 4 (2.47%) QA
2 4 (2.47%) Solvency II
3 2 (1.23%) GDPR
4 1 (0.62%) Accessibility
System Software
1 15 (9.26%) Docker
2 1 (0.62%) HDFS
Systems Management
1 53 (32.72%) Kubernetes
2 15 (9.26%) Terraform
3 3 (1.85%) Kibana
4 2 (1.23%) Ansible
4 2 (1.23%) Argo
4 2 (1.23%) Progress Chef
Vendors
1 61 (37.65%) Databricks
2 27 (16.67%) Google
3 17 (10.49%) Microsoft
4 13 (8.02%) Dell
4 13 (8.02%) Teradata
5 10 (6.17%) Oracle
6 6 (3.70%) Informatica
6 6 (3.70%) YouTube
7 4 (2.47%) SAP
8 3 (1.85%) Cloudera
8 3 (1.85%) Confluent
8 3 (1.85%) SnapLogic
9 2 (1.23%) Apple
9 2 (1.23%) CrowdStrike
9 2 (1.23%) Hootsuite
9 2 (1.23%) Hortonworks