PySpark Contracts with Work from Home Options

PySpark - Spark Python API
UK > Work from Home

The table below provides summary statistics for remote or hybrid contract work requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 12 June 2024, comparing them to the same period in the previous two years.

6 months to
12 Jun 2024
Same period 2023 Same period 2022
Rank 240 339 373
Rank change year-on-year +99 +34 -2
Contract jobs citing PySpark 102 118 261
As % of all contract jobs with a WFH option 0.69% 0.49% 0.60%
As % of the Libraries, Frameworks & Software Standards category 2.74% 1.97% 2.00%
Number of daily rates quoted 90 89 178
10th Percentile £413 £448 £463
25th Percentile £475 £513 £513
Median daily rate (50th Percentile) £500 £613 £575
Median % change year-on-year -18.37% +6.52% +9.52%
75th Percentile £600 £750 £725
90th Percentile £825 £887 £800
UK median daily rate £525 £600 £600
% change year-on-year -12.50% - +14.29%
Number of hourly rates quoted 1 0 1
10th Percentile - - -
25th Percentile £20.50 - -
Median hourly rate £21.00 - £78.75
75th Percentile £21.50 - -
90th Percentile - - -
UK median hourly rate £20.74 - £78.75
% change year-on-year - - +202.88%

All Software Libraries and Frameworks
Work from Home

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies with remote or hybrid options requiring technical specification, industry standards, software libraries and framework skills.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,723 5,975 13,044
As % of all contract jobs with a WFH option 25.23% 25.03% 29.74%
Number of daily rates quoted 2,616 4,481 9,688
10th Percentile £350 £388 £400
25th Percentile £431 £450 £456
Median daily rate (50th Percentile) £538 £538 £550
Median % change year-on-year - -2.27% +10.00%
75th Percentile £650 £650 £650
90th Percentile £825 £750 £750
UK median daily rate £535 £550 £550
% change year-on-year -2.73% - +10.00%
Number of hourly rates quoted 90 79 111
10th Percentile £23.88 £25.10 £22.50
25th Percentile - £48.13 £35.00
Median hourly rate £43.00 £64.00 £52.50
Median % change year-on-year -32.81% +21.90% +16.67%
75th Percentile £61.50 £73.75 £67.25
90th Percentile £72.50 £79.05 £76.64
UK median hourly rate £50.00 £65.00 £52.50
% change year-on-year -23.08% +23.81% +16.67%

PySpark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing PySpark as a proportion of all IT jobs advertised.

PySpark trend for jobs with a WFH option

PySpark
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing PySpark.

PySpark daily rate for jobs with a WFH option

PySpark
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing PySpark over the 6 months to 12 June 2024.

PySpark daily rate histogram for jobs with a WFH option

PySpark
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing PySpark.

PySpark hourly rate for jobs with a WFH option

PySpark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 27 (26.47%) Apache Airflow
2 17 (16.67%) Apache Spark
3 14 (13.73%) Apache
Business Applications
1 1 (0.98%) Dynamics CRM
Cloud Services
1 53 (51.96%) Azure
2 36 (35.29%) AWS
3 19 (18.63%) Azure Data Factory
3 19 (18.63%) dbt
4 17 (16.67%) GCP
5 14 (13.73%) Snowflake
6 12 (11.76%) Serverless
7 11 (10.78%) Azure Synapse Analytics
8 10 (9.80%) AWS Lambda
9 9 (8.82%) Amazon S3
9 9 (8.82%) Azure DevOps
10 8 (7.84%) Amazon EMR
10 8 (7.84%) Azure Logic Apps
11 7 (6.86%) GitHub
12 6 (5.88%) Amazon EC2
12 6 (5.88%) Amazon ECS
12 6 (5.88%) Amazon EKS
12 6 (5.88%) Azure Cosmos DB
13 5 (4.90%) Azure Monitor
13 5 (4.90%) Power Platform
Communications & Networking
1 3 (2.94%) DAB
Database & Business Intelligence
1 35 (34.31%) Data Lake
2 31 (30.39%) Data Warehouse
3 28 (27.45%) Big Data
4 17 (16.67%) Amazon Athena
5 14 (13.73%) Amazon Redshift
5 14 (13.73%) Delta Lake
6 10 (9.80%) Dremio
7 8 (7.84%) Spark SQL
8 6 (5.88%) Apache Arrow
8 6 (5.88%) Apache Ignite
8 6 (5.88%) Azure SQL Database
8 6 (5.88%) Parquet
9 5 (4.90%) Power BI
10 4 (3.92%) BigQuery
10 4 (3.92%) Snowflake Schema
11 3 (2.94%) NoSQL
11 3 (2.94%) SQL Server
12 2 (1.96%) Apache Hive
12 2 (1.96%) Hadoop
12 2 (1.96%) Star Schema
Development Applications
1 10 (9.80%) Git
2 7 (6.86%) JIRA
3 1 (0.98%) Deequ
3 1 (0.98%) MLflow
3 1 (0.98%) RStudio
General
1 24 (23.53%) Finance
2 18 (17.65%) Social Skills
3 11 (10.78%) Analytical Skills
3 11 (10.78%) Banking
4 10 (9.80%) Front Office
4 10 (9.80%) Public Sector
5 6 (5.88%) Investment Banking
6 4 (3.92%) Financial Institution
6 4 (3.92%) Marketing
6 4 (3.92%) Presentation Skills
7 3 (2.94%) Retail
8 2 (1.96%) Czech Language
9 1 (0.98%) Health Technology
9 1 (0.98%) Law
9 1 (0.98%) Legal
9 1 (0.98%) Pharmaceutical
Job Titles
1 62 (60.78%) Data Engineer
2 17 (16.67%) Azure Data Engineer
2 17 (16.67%) Azure Engineer
3 15 (14.71%) Developer
3 15 (14.71%) Python Engineer
4 13 (12.75%) Lead
4 13 (12.75%) Senior
5 11 (10.78%) AWS Engineer
5 11 (10.78%) Python Data Engineer
6 10 (9.80%) Senior Data Engineer
7 9 (8.82%) Data Scientist
8 7 (6.86%) Python Developer
9 6 (5.88%) Architect
10 5 (4.90%) AWS Data Engineer
11 4 (3.92%) AWS Developer
11 4 (3.92%) AWS Software Engineer
11 4 (3.92%) Developer/Software Engineer
11 4 (3.92%) Lead Software Developer
11 4 (3.92%) Software Engineer
11 4 (3.92%) Software Team Leader
Libraries, Frameworks & Software Standards
1 12 (11.76%) NumPy
1 12 (11.76%) Pandas
2 10 (9.80%) SciPy
3 8 (7.84%) Kafka
4 6 (5.88%) Apache Avro
4 6 (5.88%) gRPC
4 6 (5.88%) Protocol Buffers
5 3 (2.94%) PyTorch
5 3 (2.94%) Spark Streaming
5 3 (2.94%) TensorFlow
6 2 (1.96%) JSON
6 2 (1.96%) JSON Schema
6 2 (1.96%) pytest
7 1 (0.98%) ARM Templates
7 1 (0.98%) Great Expectations
7 1 (0.98%) Middleware
7 1 (0.98%) Web Services
Miscellaneous
1 6 (5.88%) Derivative
1 6 (5.88%) Equities
1 6 (5.88%) Fixed Income
1 6 (5.88%) Foreign Exchange (FX)
1 6 (5.88%) Hedge funds
2 5 (4.90%) Distributed Computing
3 3 (2.94%) Team-Oriented Environment
4 2 (1.96%) Algorithms
4 2 (1.96%) Greenfield Project
4 2 (1.96%) Self-Motivation
4 2 (1.96%) Smart Meter
5 1 (0.98%) Data Protection Act
5 1 (0.98%) Data Structures
5 1 (0.98%) Marketing Technology
5 1 (0.98%) NHS
5 1 (0.98%) Product Ownership
Operating Systems
1 2 (1.96%) Linux
Processes & Methodologies
1 43 (42.16%) Agile
2 39 (38.24%) Data Engineering
3 38 (37.25%) Analytics
4 37 (36.27%) Data Pipeline
5 35 (34.31%) ETL
6 29 (28.43%) Data Modelling
7 22 (21.57%) Software Engineering
8 21 (20.59%) CI/CD
9 20 (19.61%) DevOps
10 16 (15.69%) Business Intelligence
11 13 (12.75%) Data Science
11 13 (12.75%) Problem-Solving
12 11 (10.78%) Data Transformation
13 10 (9.80%) Asset Management
13 10 (9.80%) Migration
13 10 (9.80%) SDLC
13 10 (9.80%) Stakeholder Management
14 9 (8.82%) Continuous Integration
15 8 (7.84%) Machine Learning
16 7 (6.86%) Visualisation
Programming Languages
1 91 (89.22%) Python
2 53 (51.96%) SQL
3 15 (14.71%) Java
4 14 (13.73%) Scala
5 6 (5.88%) JavaScript
5 6 (5.88%) TypeScript
6 3 (2.94%) Bash
7 2 (1.96%) R
8 1 (0.98%) C++
8 1 (0.98%) PowerShell
8 1 (0.98%) T-SQL
Qualifications
1 8 (7.84%) SC Cleared
1 8 (7.84%) Security Cleared
2 3 (2.94%) Azure Certification
2 3 (2.94%) Microsoft Certification
Quality Assurance & Compliance
1 17 (16.67%) Data Quality
2 1 (0.98%) QA
System Software
1 1 (0.98%) Docker
Systems Management
1 8 (7.84%) Terraform
2 2 (1.96%) Kubernetes
Vendors
1 48 (47.06%) Databricks
2 8 (7.84%) Microsoft
3 6 (5.88%) Ab Initio
3 6 (5.88%) Bloomberg
3 6 (5.88%) Reuters
4 3 (2.94%) Google
4 3 (2.94%) Oracle
5 1 (0.98%) Foundry
5 1 (0.98%) Palantir
5 1 (0.98%) Salesforce
5 1 (0.98%) SAP