PySpark Jobs in England

PySpark - Spark Python API
UK > England

The table below provides summary statistics for permanent job vacancies advertised in England requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 13 June 2024, comparing them to the same period in the previous two years.

6 months to
13 Jun 2024
Same period 2023 Same period 2022
Rank 572 659 722
Rank change year-on-year +87 +63 +64
Permanent jobs citing PySpark 305 239 519
As % of all permanent jobs advertised in England 0.32% 0.29% 0.36%
As % of the Libraries, Frameworks & Software Standards category 1.65% 1.01% 0.90%
Number of salaries quoted 219 201 183
10th Percentile £52,500 £50,000 £49,000
25th Percentile £58,750 £62,500 £57,500
Median annual salary (50th Percentile) £80,000 £80,000 £70,000
Median % change year-on-year - +14.29% +7.69%
75th Percentile £95,000 £105,000 £81,875
90th Percentile £115,000 £160,000 £85,000
UK median annual salary £75,000 £80,000 £70,000
% change year-on-year -6.25% +14.29% +7.69%

All Software Libraries and Frameworks
England

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in England.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 18,501 23,761 57,486
As % of all permanent jobs advertised in England 19.36% 28.95% 39.79%
Number of salaries quoted 14,592 15,693 26,430
10th Percentile £36,250 £41,250 £38,000
25th Percentile £45,000 £51,250 £47,500
Median annual salary (50th Percentile) £60,000 £67,500 £65,000
Median % change year-on-year -11.11% +3.85% +13.04%
75th Percentile £80,000 £88,750 £85,000
90th Percentile £100,000 £110,000 £100,000
UK median annual salary £60,000 £67,500 £65,000
% change year-on-year -11.11% +3.85% +18.18%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Salary Trend in England

3-month moving average salary quoted in jobs citing PySpark in England.

Salary trend for PySpark in England

PySpark
Salary Histogram in England

Salary distribution for jobs citing PySpark in England over the 6 months to 13 June 2024.

Salary histogram for PySpark in England

PySpark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the England region over the 6 months to 13 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +149 223 £80,000 -13.51% 47
North of England +37 49 £80,000 +23.08% 20
North West +11 42 £85,000 +9.68% 8
Midlands -29 14 £62,500 +13.64% 8
South West -40 14 £55,000 -32.31% 2
West Midlands -2 10 £62,500 +25.00% 2
Yorkshire +62 7 £80,000 +88.24% 10
East Midlands -29 4 - - 6
South East -60 2 £40,000 -40.74% 5
East of England -12 1 £55,000 - 1
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 55 (18.03%) Apache Airflow
2 52 (17.05%) Apache
3 49 (16.07%) Apache Spark
4 5 (1.64%) SAS
5 4 (1.31%) Confluence
5 4 (1.31%) Luigi
6 1 (0.33%) Apache Pig
6 1 (0.33%) SharePoint
Applications
1 7 (2.30%) Microsoft Excel
Business Applications
1 4 (1.31%) Primavera
2 1 (0.33%) SAP ERP
Cloud Services
1 184 (60.33%) Azure
2 91 (29.84%) AWS
3 77 (25.25%) GCP
4 62 (20.33%) Azure Data Factory
5 54 (17.70%) Azure DevOps
6 49 (16.07%) Azure Synapse Analytics
7 47 (15.41%) Power Platform
8 42 (13.77%) dbt
9 40 (13.11%) Snowflake
10 28 (9.18%) Amazon ECS
11 24 (7.87%) Amazon EC2
11 24 (7.87%) Amazon EKS
12 23 (7.54%) GitHub
13 14 (4.59%) Serverless
14 12 (3.93%) Dagster
14 12 (3.93%) Power Automate
14 12 (3.93%) PowerApps
15 11 (3.61%) Amazon S3
15 11 (3.61%) AWS Lambda
16 10 (3.28%) Azure Cosmos DB
Database & Business Intelligence
1 105 (34.43%) Data Lake
2 68 (22.30%) Data Warehouse
3 58 (19.02%) SQL Server
4 49 (16.07%) Big Data
5 47 (15.41%) Power BI
5 47 (15.41%) Tableau
6 39 (12.79%) Amazon Athena
7 36 (11.80%) Dremio
8 33 (10.82%) Delta Lake
9 24 (7.87%) Apache Arrow
9 24 (7.87%) Apache Ignite
10 20 (6.56%) Azure SQL Database
10 20 (6.56%) Data Vault
11 19 (6.23%) NoSQL
11 19 (6.23%) Spark SQL
12 14 (4.59%) Hadoop
13 11 (3.61%) Data Mining
14 9 (2.95%) Amazon Redshift
14 9 (2.95%) SQL Server Integration Services
15 8 (2.62%) PostgreSQL
Development Applications
1 72 (23.61%) Git
2 26 (8.52%) JIRA
3 12 (3.93%) Jenkins
4 5 (1.64%) CircleCI
5 4 (1.31%) Octopus Deploy
6 2 (0.66%) JMeter
6 2 (0.66%) Postman
6 2 (0.66%) SpecFlow
6 2 (0.66%) Subversion
7 1 (0.33%) Selenium
7 1 (0.33%) SoapUI
7 1 (0.33%) Team Foundation Server
7 1 (0.33%) TeamCity
General
1 99 (32.46%) Social Skills
2 91 (29.84%) Finance
3 45 (14.75%) Banking
4 36 (11.80%) Front Office
5 26 (8.52%) Analytical Skills
6 24 (7.87%) Investment Banking
7 19 (6.23%) Inclusion and Diversity
8 17 (5.57%) Legal
9 12 (3.93%) Retail
10 8 (2.62%) Law
11 6 (1.97%) Publishing
12 5 (1.64%) Influencing Skills
12 5 (1.64%) Retail Banking
13 2 (0.66%) Manufacturing
13 2 (0.66%) Presentation Skills
14 1 (0.33%) Automotive
14 1 (0.33%) Dutch Language
14 1 (0.33%) Marketing
14 1 (0.33%) Organisational Skills
14 1 (0.33%) Pharmaceutical
Job Titles
1 170 (55.74%) Data Engineer
2 134 (43.93%) Senior
3 64 (20.98%) Senior Data Engineer
4 59 (19.34%) Data Scientist
5 50 (16.39%) Senior Data Scientist
6 40 (13.11%) Lead
7 39 (12.79%) Azure Engineer
8 33 (10.82%) Python Engineer
9 31 (10.16%) Azure Data Engineer
10 27 (8.85%) Python Data Engineer
11 20 (6.56%) Architect
12 19 (6.23%) Lead Data Engineer
13 17 (5.57%) Software Engineer
14 15 (4.92%) AWS Engineer
14 15 (4.92%) Developer
15 14 (4.59%) Team Leader
16 13 (4.26%) Solutions Architect
17 12 (3.93%) Lead Developer
17 12 (3.93%) Lead Software Engineer
17 12 (3.93%) Software Developer
Libraries, Frameworks & Software Standards
1 97 (31.80%) Pandas
2 47 (15.41%) scikit-learn
3 45 (14.75%) TensorFlow
4 38 (12.46%) NumPy
4 38 (12.46%) SciPy
5 24 (7.87%) gRPC
5 24 (7.87%) Protocol Buffers
6 8 (2.62%) AWS CDK
7 7 (2.30%) Kafka
8 5 (1.64%) Apache Avro
8 5 (1.64%) Apache Beam
8 5 (1.64%) Spark Streaming
9 4 (1.31%) SQLAlchemy
10 3 (0.98%) SOAP
11 2 (0.66%) MDX
11 2 (0.66%) Plotly
11 2 (0.66%) PyTorch
11 2 (0.66%) RESTful
12 1 (0.33%) ARM Templates
12 1 (0.33%) Swagger
Miscellaneous
1 51 (16.72%) Algorithms
2 39 (12.79%) Reinsurance
3 30 (9.84%) Data Structures
4 27 (8.85%) Public Cloud
5 24 (7.87%) Derivative
5 24 (7.87%) Equities
5 24 (7.87%) Fixed Income
5 24 (7.87%) Foreign Exchange (FX)
5 24 (7.87%) Hedge funds
6 14 (4.59%) Greenfield Project
7 11 (3.61%) Product Ownership
8 5 (1.64%) Distributed Applications
8 5 (1.64%) Distributed Systems
8 5 (1.64%) Low-Code
9 4 (1.31%) Self-Motivation
9 4 (1.31%) Team-Oriented Environment
10 2 (0.66%) Cloud Native
10 2 (0.66%) Hybrid Cloud
10 2 (0.66%) Management Information System
10 2 (0.66%) PropTech
Operating Systems
1 2 (0.66%) Linux
2 1 (0.33%) Ubuntu
Processes & Methodologies
1 129 (42.30%) Agile
2 112 (36.72%) ETL
3 107 (35.08%) Data Engineering
4 96 (31.48%) Data Science
5 89 (29.18%) Machine Learning
6 81 (26.56%) Data Modelling
6 81 (26.56%) Data Pipeline
7 74 (24.26%) Analytics
8 67 (21.97%) CI/CD
8 67 (21.97%) Migration
9 62 (20.33%) Artificial Intelligence
10 61 (20.00%) Visualisation
11 60 (19.67%) Decision-Making
12 56 (18.36%) DevOps
12 56 (18.36%) MLOps
13 55 (18.03%) Statistics
14 54 (17.70%) Mathematics
15 53 (17.38%) Data Integration
15 53 (17.38%) Natural Language Processing
16 51 (16.72%) Business Intelligence
Programming Languages
1 263 (86.23%) SQL
2 260 (85.25%) Python
3 42 (13.77%) Java
4 25 (8.20%) JavaScript
5 24 (7.87%) TypeScript
6 13 (4.26%) R
7 12 (3.93%) T-SQL
8 11 (3.61%) Scala
9 7 (2.30%) Data Analysis Expressions
10 5 (1.64%) C#
11 2 (0.66%) PL/SQL
12 1 (0.33%) Julia
12 1 (0.33%) Shell Script
Qualifications
1 76 (24.92%) Degree
2 50 (16.39%) Master's Degree
3 47 (15.41%) DBS Check
4 18 (5.90%) Computer Science Degree
5 13 (4.26%) Microsoft Certification
6 9 (2.95%) Azure Certification
7 4 (1.31%) CIMA
7 4 (1.31%) PhD
8 2 (0.66%) SC Cleared
8 2 (0.66%) Security Cleared
9 1 (0.33%) Postgraduate
Quality Assurance & Compliance
1 51 (16.72%) Data Quality
2 4 (1.31%) QA
System Software
1 5 (1.64%) Docker
1 5 (1.64%) HDFS
2 1 (0.33%) Apache Flume
Systems Management
1 18 (5.90%) Terraform
2 4 (1.31%) Kubernetes
Vendors
1 192 (62.95%) Databricks
2 36 (11.80%) Informatica
3 34 (11.15%) Microsoft
4 33 (10.82%) Oracle
5 24 (7.87%) Bloomberg
5 24 (7.87%) Reuters
6 9 (2.95%) Google
7 7 (2.30%) Cloudera
8 6 (1.97%) SAP
9 5 (1.64%) OpenAI
9 5 (1.64%) SnapLogic
10 4 (1.31%) Splunk
11 2 (0.66%) ServiceNow
11 2 (0.66%) Teradata
12 1 (0.33%) Alteryx
12 1 (0.33%) Facebook
12 1 (0.33%) Marketo
12 1 (0.33%) Palantir
12 1 (0.33%) Salesforce
12 1 (0.33%) Twitter