PySpark Jobs in England

PySpark - Spark Python API
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 9 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 Jun 2024
Same period 2023 Same period 2022
Rank 579 646 721
Rank change year-on-year +67 +75 +56
Permanent jobs citing PySpark 285 242 519
As % of all permanent jobs advertised in England 0.30% 0.29% 0.36%
As % of the Libraries, Frameworks & Software Standards category 1.56% 1.01% 0.91%
Number of salaries quoted 199 203 183
10th Percentile £52,300 £50,000 £49,000
25th Percentile £57,500 £62,500 £57,500
Median annual salary (50th Percentile) £80,000 £80,000 £70,000
Median % change year-on-year - +14.29% +7.69%
75th Percentile £92,500 £105,000 £81,875
90th Percentile £110,500 £160,000 £85,000
UK median annual salary £70,000 £80,000 £70,000
% change year-on-year -12.50% +14.29% +7.69%

All Software Libraries and Frameworks
England

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 18,223 23,894 57,296
As % of all permanent jobs advertised in England 19.35% 28.91% 39.85%
Number of salaries quoted 14,460 15,713 26,461
10th Percentile £36,250 £41,250 £38,000
25th Percentile £45,000 £51,250 £47,500
Median annual salary (50th Percentile) £60,000 £67,500 £65,000
Median % change year-on-year -11.11% +3.85% +13.04%
75th Percentile £80,000 £88,750 £85,000
90th Percentile £100,000 £110,000 £100,000
UK median annual salary £60,000 £67,500 £65,000
% change year-on-year -11.11% +3.85% +18.18%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Salary Trend in England

3-month moving average salary quoted in jobs citing PySpark in England.

Salary trend for PySpark in England

PySpark
Salary Histogram in England

Salary distribution for jobs citing PySpark in England over the 6 months to 9 June 2024.

Salary histogram for PySpark in England

PySpark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the England region over the 6 months to 9 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +107 206 £75,000 -18.92% 51
North of England +50 48 £80,000 +23.08% 17
North West +26 42 £85,000 +9.68% 9
Midlands -23 14 £62,500 +13.64% 8
South West -31 12 £65,000 -20.00% 3
West Midlands -2 10 £62,500 +25.00% 2
Yorkshire +59 6 £80,000 +88.24% 6
East Midlands -33 4 - - 6
South East -39 2 £40,000 -40.74% 6
East of England -13 1 £55,000 - 1
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 49 (17.19%) Apache Spark
2 41 (14.39%) Apache Airflow
3 40 (14.04%) Apache
4 4 (1.40%) Confluence
4 4 (1.40%) Luigi
4 4 (1.40%) SAS
5 1 (0.35%) Apache Pig
5 1 (0.35%) SharePoint
Applications
1 7 (2.46%) Microsoft Excel
Business Applications
1 4 (1.40%) Primavera
2 1 (0.35%) SAP ERP
Cloud Services
1 179 (62.81%) Azure
2 77 (27.02%) AWS
3 63 (22.11%) GCP
4 60 (21.05%) Azure Data Factory
5 55 (19.30%) Azure DevOps
6 46 (16.14%) Azure Synapse Analytics
7 45 (15.79%) Power Platform
8 28 (9.82%) Snowflake
9 27 (9.47%) dbt
10 25 (8.77%) GitHub
11 16 (5.61%) Amazon ECS
12 14 (4.91%) Serverless
13 12 (4.21%) Amazon EC2
13 12 (4.21%) Amazon EKS
13 12 (4.21%) Power Automate
13 12 (4.21%) PowerApps
14 11 (3.86%) Amazon S3
14 11 (3.86%) AWS Lambda
15 10 (3.51%) AWS CloudFormation
15 10 (3.51%) Azure Cosmos DB
Database & Business Intelligence
1 89 (31.23%) Data Lake
2 69 (24.21%) Data Warehouse
3 58 (20.35%) SQL Server
4 50 (17.54%) Big Data
5 47 (16.49%) Tableau
6 45 (15.79%) Power BI
7 33 (11.58%) Delta Lake
8 24 (8.42%) Amazon Athena
9 21 (7.37%) Dremio
9 21 (7.37%) NoSQL
10 20 (7.02%) Azure SQL Database
10 20 (7.02%) Data Vault
11 19 (6.67%) Spark SQL
12 14 (4.91%) Hadoop
13 12 (4.21%) Apache Arrow
13 12 (4.21%) Apache Ignite
14 11 (3.86%) Data Mining
15 9 (3.16%) Amazon Redshift
15 9 (3.16%) SQL Server Integration Services
16 8 (2.81%) MySQL
Development Applications
1 70 (24.56%) Git
2 26 (9.12%) JIRA
3 14 (4.91%) Jenkins
4 6 (2.11%) CircleCI
5 4 (1.40%) Octopus Deploy
6 2 (0.70%) JMeter
6 2 (0.70%) Postman
6 2 (0.70%) SpecFlow
7 1 (0.35%) Selenium
7 1 (0.35%) SoapUI
7 1 (0.35%) Subversion
7 1 (0.35%) Team Foundation Server
7 1 (0.35%) TeamCity
General
1 97 (34.04%) Social Skills
2 77 (27.02%) Finance
3 31 (10.88%) Banking
4 26 (9.12%) Analytical Skills
5 21 (7.37%) Front Office
6 19 (6.67%) Inclusion and Diversity
7 16 (5.61%) Legal
8 12 (4.21%) Investment Banking
8 12 (4.21%) Retail
9 8 (2.81%) Law
10 6 (2.11%) Retail Banking
11 5 (1.75%) Influencing Skills
11 5 (1.75%) Publishing
12 2 (0.70%) Manufacturing
12 2 (0.70%) Presentation Skills
13 1 (0.35%) Automotive
13 1 (0.35%) Marketing
13 1 (0.35%) Organisational Skills
13 1 (0.35%) Pharmaceutical
13 1 (0.35%) Public Sector
Job Titles
1 162 (56.84%) Data Engineer
2 134 (47.02%) Senior
3 64 (22.46%) Senior Data Engineer
4 57 (20.00%) Data Scientist
5 50 (17.54%) Senior Data Scientist
6 37 (12.98%) Azure Engineer
7 33 (11.58%) Lead
8 29 (10.18%) Azure Data Engineer
9 26 (9.12%) Python Engineer
10 23 (8.07%) Python Data Engineer
11 17 (5.96%) Lead Data Engineer
12 14 (4.91%) Architect
13 11 (3.86%) Software Engineer
14 9 (3.16%) AWS Engineer
14 9 (3.16%) Developer
14 9 (3.16%) Team Leader
15 7 (2.46%) Consultant
15 7 (2.46%) Data Consultant
15 7 (2.46%) Solutions Architect
15 7 (2.46%) Technical Leader
Libraries, Frameworks & Software Standards
1 82 (28.77%) Pandas
2 47 (16.49%) scikit-learn
3 45 (15.79%) TensorFlow
4 23 (8.07%) NumPy
4 23 (8.07%) SciPy
5 12 (4.21%) gRPC
5 12 (4.21%) Protocol Buffers
6 9 (3.16%) AWS CDK
7 8 (2.81%) Kafka
8 6 (2.11%) Apache Avro
8 6 (2.11%) Apache Beam
8 6 (2.11%) Spark Streaming
9 4 (1.40%) SQLAlchemy
10 3 (1.05%) SOAP
11 2 (0.70%) MDX
11 2 (0.70%) Plotly
11 2 (0.70%) PyTorch
12 1 (0.35%) ARM Templates
12 1 (0.35%) pytest
12 1 (0.35%) Swagger
Miscellaneous
1 51 (17.89%) Algorithms
2 37 (12.98%) Reinsurance
3 30 (10.53%) Data Structures
4 27 (9.47%) Public Cloud
5 15 (5.26%) Greenfield Project
6 12 (4.21%) Derivative
6 12 (4.21%) Equities
6 12 (4.21%) Fixed Income
6 12 (4.21%) Foreign Exchange (FX)
6 12 (4.21%) Hedge funds
7 10 (3.51%) Product Ownership
8 6 (2.11%) Distributed Applications
8 6 (2.11%) Distributed Systems
9 5 (1.75%) Low-Code
10 4 (1.40%) Self-Motivation
10 4 (1.40%) Team-Oriented Environment
11 2 (0.70%) Cloud Native
11 2 (0.70%) Hybrid Cloud
11 2 (0.70%) Management Information System
11 2 (0.70%) PropTech
Operating Systems
1 2 (0.70%) Linux
2 1 (0.35%) Ubuntu
Processes & Methodologies
1 112 (39.30%) Agile
2 111 (38.95%) ETL
3 103 (36.14%) Data Engineering
4 95 (33.33%) Data Science
5 89 (31.23%) Machine Learning
6 81 (28.42%) Data Modelling
7 79 (27.72%) Data Pipeline
8 71 (24.91%) Analytics
9 67 (23.51%) CI/CD
10 63 (22.11%) Artificial Intelligence
11 61 (21.40%) Visualisation
12 60 (21.05%) Decision-Making
13 58 (20.35%) DevOps
14 57 (20.00%) MLOps
15 55 (19.30%) Statistics
16 54 (18.95%) Mathematics
16 54 (18.95%) Migration
17 53 (18.60%) Data Integration
18 51 (17.89%) Natural Language Processing
19 50 (17.54%) Predictive Modelling
Programming Languages
1 246 (86.32%) SQL
2 241 (84.56%) Python
3 28 (9.82%) Java
4 14 (4.91%) R
5 12 (4.21%) JavaScript
5 12 (4.21%) Scala
5 12 (4.21%) T-SQL
5 12 (4.21%) TypeScript
6 7 (2.46%) Data Analysis Expressions
7 5 (1.75%) C#
8 2 (0.70%) PL/SQL
9 1 (0.35%) Julia
9 1 (0.35%) Shell Script
Qualifications
1 73 (25.61%) Degree
2 49 (17.19%) Master's Degree
3 47 (16.49%) DBS Check
4 16 (5.61%) Computer Science Degree
5 13 (4.56%) Microsoft Certification
6 9 (3.16%) Azure Certification
7 4 (1.40%) CIMA
7 4 (1.40%) PhD
8 2 (0.70%) SC Cleared
8 2 (0.70%) Security Cleared
9 1 (0.35%) Postgraduate
Quality Assurance & Compliance
1 49 (17.19%) Data Quality
2 4 (1.40%) QA
System Software
1 6 (2.11%) HDFS
2 5 (1.75%) Docker
3 1 (0.35%) Apache Flume
Systems Management
1 19 (6.67%) Terraform
2 4 (1.40%) Kubernetes
Vendors
1 188 (65.96%) Databricks
2 36 (12.63%) Informatica
3 33 (11.58%) Microsoft
3 33 (11.58%) Oracle
4 12 (4.21%) Bloomberg
4 12 (4.21%) Reuters
5 9 (3.16%) Google
6 8 (2.81%) Cloudera
7 5 (1.75%) OpenAI
7 5 (1.75%) SAP
7 5 (1.75%) SnapLogic
8 4 (1.40%) Splunk
9 2 (0.70%) ServiceNow
9 2 (0.70%) Teradata
10 1 (0.35%) Facebook
10 1 (0.35%) Foundry
10 1 (0.35%) Marketo
10 1 (0.35%) Palantir
10 1 (0.35%) Salesforce
10 1 (0.35%) Twitter