Big Data Jobs

Big Data
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 256 134 115
Rank change year-on-year -122 -19 +17
Permanent jobs citing Big Data 1,162 2,483 5,484
As % of all permanent jobs advertised in the UK 1.11% 2.62% 3.25%
As % of the Database & Business Intelligence category 6.31% 12.28% 11.49%
Number of salaries quoted 488 987 1,892
10th Percentile £43,750 £52,000 £46,250
25th Percentile £57,313 £63,750 £60,000
Median annual salary (50th Percentile) £80,000 £70,000 £77,500
Median % change year-on-year +14.29% -9.68% +19.23%
75th Percentile £110,000 £92,500 £95,000
90th Percentile £122,500 £110,000 £110,000
UK excluding London median annual salary £62,750 £70,000 £69,925
% change year-on-year -10.36% +0.11% +27.14%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,414 20,218 47,744
As % of all permanent jobs advertised in the UK 17.54% 21.36% 28.29%
Number of salaries quoted 12,548 12,894 20,996
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £77,500 £82,500 £80,000
90th Percentile £97,500 £103,675 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +10.53%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 1 June 2024.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -90 812 £62,750 -10.36% 121
England -253 603 £80,000 +14.29% 233
Scotland +62 518 £70,576 +0.82% 20
London -133 321 £93,475 +16.42% 133
Work from Home -189 288 £87,500 +25.00% 117
South West -46 109 £80,000 +14.29% 16
North of England -221 63 £55,000 -21.43% 23
North West -145 46 £55,000 -21.43% 15
South East -184 45 £55,000 -21.43% 27
East of England -43 35 £60,000 -9.09% 10
Midlands -130 28 £58,750 -9.62% 19
West Midlands -99 18 £57,500 -4.17% 15
North East -9 11 £42,500 -37.04% 4
Wales -16 11 £46,131 -34.10% 2
East Midlands -52 10 £60,000 -20.00% 4
Yorkshire -114 6 £90,139 +28.77% 4
Northern Ireland +8 3 £115,000 +31.43% 6

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 686 (59.04%) Apache Spark
2 233 (20.05%) Apache
3 178 (15.32%) Apache Airflow
4 41 (3.53%) SAS
5 18 (1.55%) Jupyter
6 17 (1.46%) nginx
7 7 (0.60%) Apache Pig
8 6 (0.52%) Luigi
8 6 (0.52%) OpenStack
9 5 (0.43%) Kinematics
10 3 (0.26%) Confluence
10 3 (0.26%) Exchange Server 2013
10 3 (0.26%) Microsoft Exchange
11 1 (0.086%) Apache Solr
11 1 (0.086%) CMS
Applications
1 32 (2.75%) Microsoft Excel
2 27 (2.32%) Microsoft Office
3 15 (1.29%) SPSS
4 6 (0.52%) Trello
5 5 (0.43%) Microsoft PowerPoint
6 4 (0.34%) MS Visio
7 1 (0.086%) Microsoft Project
7 1 (0.086%) Spreadsheet
Business Applications
1 7 (0.60%) Dynamics CRM
2 6 (0.52%) Payment Gateway
3 5 (0.43%) Sparx Enterprise Architect
4 4 (0.34%) Primavera
4 4 (0.34%) Relativity
5 3 (0.26%) SAP Business One
6 2 (0.17%) Veritas eDiscovery
7 1 (0.086%) NEC Housing
7 1 (0.086%) Ringtail
Cloud Services
1 629 (54.13%) AWS
2 263 (22.63%) Azure
3 148 (12.74%) GCP
4 126 (10.84%) Serverless
5 94 (8.09%) AWS Lambda
5 94 (8.09%) Power Platform
6 93 (8.00%) Snowflake
7 82 (7.06%) Amazon EKS
8 73 (6.28%) dbt
9 71 (6.11%) Amazon SQS
10 67 (5.77%) Amazon EMR
11 63 (5.42%) SaaS
12 53 (4.56%) OpenShift
13 50 (4.30%) Amazon EC2
14 49 (4.22%) Amazon ECS
15 47 (4.04%) Amazon S3
16 45 (3.87%) Azure Synapse Analytics
17 39 (3.36%) Azure Data Factory
18 38 (3.27%) Cloud Computing
19 34 (2.93%) AWS CloudFormation
Communications & Networking
1 29 (2.50%) AMQP
2 20 (1.72%) Firewall
3 17 (1.46%) Wireless
4 16 (1.38%) DSL
5 13 (1.12%) Internet
6 5 (0.43%) Network Security
6 5 (0.43%) RFID
7 4 (0.34%) RS-232
7 4 (0.34%) SD-WAN
8 3 (0.26%) DNS
8 3 (0.26%) Fibre Channel
8 3 (0.26%) iSCSI
8 3 (0.26%) LAN
8 3 (0.26%) MQTT
8 3 (0.26%) SAN
8 3 (0.26%) VoIP
8 3 (0.26%) WAN
8 3 (0.26%) WebEx
9 2 (0.17%) 4G
9 2 (0.17%) Intrusion Detection
Database & Business Intelligence
1 365 (31.41%) NoSQL
2 314 (27.02%) Hadoop
3 189 (16.27%) Data Lake
4 124 (10.67%) Data Warehouse
5 85 (7.31%) Apache Hive
6 83 (7.14%) Power BI
7 73 (6.28%) Tableau
8 70 (6.02%) Amazon Athena
9 67 (5.77%) Dremio
10 66 (5.68%) Apache Arrow
11 59 (5.08%) SQL Server
12 52 (4.48%) Electronic Patient Records
12 52 (4.48%) Relational Database
13 41 (3.53%) MongoDB
14 40 (3.44%) Data Mining
15 38 (3.27%) HBase
16 32 (2.75%) Flink
17 31 (2.67%) Amazon Redshift
18 29 (2.50%) BigQuery
18 29 (2.50%) Cloudera CDH
Development Applications
1 101 (8.69%) Git
2 81 (6.97%) Jenkins
3 35 (3.01%) Bitbucket Server
4 16 (1.38%) Atlassian Bamboo
4 16 (1.38%) JIRA
5 9 (0.77%) CircleCI
6 8 (0.69%) JUnit
6 8 (0.69%) Oracle Forms
6 8 (0.69%) SonarQube
7 6 (0.52%) Checkstyle
7 6 (0.52%) GitLab
7 6 (0.52%) Jasmine
7 6 (0.52%) Karma Test Runner
7 6 (0.52%) MLflow
7 6 (0.52%) Visual Studio Code
8 4 (0.34%) Cucumber
8 4 (0.34%) Octopus Deploy
8 4 (0.34%) Spinnaker
8 4 (0.34%) Subversion
8 4 (0.34%) Visual Studio
General
1 648 (55.77%) Finance
2 525 (45.18%) Inclusion and Diversity
3 486 (41.82%) Law
4 269 (23.15%) Marketing
5 244 (21.00%) Legal
6 178 (15.32%) Social Skills
7 159 (13.68%) Influencing Skills
8 112 (9.64%) Banking
9 105 (9.04%) Analytical Skills
10 74 (6.37%) Financial Institution
11 46 (3.96%) Aerospace
12 34 (2.93%) Investment Banking
13 33 (2.84%) Retail
14 29 (2.50%) Presentation Skills
15 18 (1.55%) Public Sector
16 17 (1.46%) Private Banking
17 13 (1.12%) Pharmaceutical
17 13 (1.12%) Retail Banking
18 12 (1.03%) Electronics
18 12 (1.03%) Front Office
Job Titles
1 461 (39.67%) Software Engineer
2 449 (38.64%) Big Data Engineer
3 372 (32.01%) Big Data Software Engineer
4 337 (29.00%) Data Engineer
5 201 (17.30%) Scala Engineer
5 201 (17.30%) Scala Software Engineer
6 194 (16.70%) AWS Engineer
7 190 (16.35%) Senior
8 186 (16.01%) Lead
9 177 (15.23%) Java Engineer
10 174 (14.97%) Java Software Engineer
11 146 (12.56%) Lead Big Data Engineer
12 144 (12.39%) Lead Software Engineer
13 136 (11.70%) AWS Software Engineer
14 119 (10.24%) Java Scala Software Engineer
15 104 (8.95%) Python Engineer
16 96 (8.26%) Lead Java Engineer
17 92 (7.92%) Architect
18 91 (7.83%) Python Software Engineer
19 65 (5.59%) Developer
Libraries, Frameworks & Software Standards
1 148 (12.74%) Kafka
2 136 (11.70%) PySpark
3 110 (9.47%) Spring
4 102 (8.78%) Spring Boot
5 90 (7.75%) gRPC
6 57 (4.91%) AngularJS
7 54 (4.65%) Protocol Buffers
8 47 (4.04%) RabbitMQ
8 47 (4.04%) React
9 42 (3.61%) Node.js
10 39 (3.36%) REST
11 35 (3.01%) OpenAPI
11 35 (3.01%) Swagger
12 32 (2.75%) .NET
13 29 (2.50%) Material-UI
14 26 (2.24%) Apache Beam
15 24 (2.07%) Apache NiFi
16 20 (1.72%) Pandas
17 19 (1.64%) ActiveMQ
18 18 (1.55%) CSS
Miscellaneous
1 249 (21.43%) Cloud Native
2 207 (17.81%) Algorithms
3 70 (6.02%) Hedge funds
4 61 (5.25%) Data Structures
5 57 (4.91%) Product Ownership
6 56 (4.82%) Management Information System
7 55 (4.73%) Clustering
8 49 (4.22%) Public Cloud
9 42 (3.61%) Onboarding
10 41 (3.53%) Legacy Code
11 27 (2.32%) Self-Motivation
12 21 (1.81%) Enterprise Software
13 20 (1.72%) Distributed Systems
13 20 (1.72%) IoT
14 19 (1.64%) Greenfield Project
15 18 (1.55%) Hybrid Cloud
16 17 (1.46%) Legacy Systems
17 15 (1.29%) Cyber Defence
17 15 (1.29%) Cybercrime
18 14 (1.20%) Distributed Computing
Operating Systems
1 99 (8.52%) Linux
2 36 (3.10%) Unix
3 31 (2.67%) CentOS
3 31 (2.67%) Debian
3 31 (2.67%) Red Hat Enterprise Linux
3 31 (2.67%) Ubuntu
4 22 (1.89%) Windows
5 13 (1.12%) Windows Server
6 6 (0.52%) Mesosphere
7 4 (0.34%) FreeRTOS
8 3 (0.26%) Windows Server 2012
9 1 (0.086%) Android
9 1 (0.086%) Apple iOS
Processes & Methodologies
1 703 (60.50%) Agile
2 589 (50.69%) Software Engineering
3 523 (45.01%) CI/CD
4 474 (40.79%) SDLC
5 380 (32.70%) Operational Stability
6 345 (29.69%) Machine Learning
7 299 (25.73%) Artificial Intelligence
8 245 (21.08%) Risk Management
9 231 (19.88%) Visualisation
10 229 (19.71%) Analytics
11 227 (19.54%) Performance Tuning
12 225 (19.36%) Problem-Solving
13 219 (18.85%) Community of Practice
14 212 (18.24%) DevOps
15 194 (16.70%) Data Modelling
16 188 (16.18%) Continuous Improvement
16 188 (16.18%) Data Science
17 153 (13.17%) Business Intelligence
18 151 (12.99%) Mentoring
19 140 (12.05%) Data Pipeline
Programming Languages
1 647 (55.68%) SQL
2 563 (48.45%) Python
3 551 (47.42%) Java
4 350 (30.12%) Scala
5 118 (10.15%) JavaScript
6 92 (7.92%) Go
7 57 (4.91%) R
8 54 (4.65%) C#
9 51 (4.39%) PL/SQL
10 30 (2.58%) Bash
11 21 (1.81%) T-SQL
12 19 (1.64%) Shell Script
13 16 (1.38%) C
14 12 (1.03%) C++
15 11 (0.95%) Data Analysis Expressions
16 10 (0.86%) TypeScript
17 8 (0.69%) Ruby
18 6 (0.52%) PHP
19 5 (0.43%) XAML
20 4 (0.34%) VB
Qualifications
1 208 (17.90%) Degree
2 101 (8.69%) Security Cleared
3 70 (6.02%) SC Cleared
4 60 (5.16%) Computer Science Degree
5 59 (5.08%) DV Cleared
6 53 (4.56%) Master's Degree
7 19 (1.64%) PhD
8 16 (1.38%) Microsoft Certification
9 14 (1.20%) AWS Certification
9 14 (1.20%) Azure Certification
10 11 (0.95%) DBS Check
11 10 (0.86%) AWS Certified Solutions Architect
12 8 (0.69%) BPSS Clearance
13 6 (0.52%) IIBA
14 5 (0.43%) CCNA
14 5 (0.43%) Cisco Certification
14 5 (0.43%) CISSP
15 4 (0.34%) CIMA
15 4 (0.34%) Network+ Certification
16 3 (0.26%) MBA
Quality Assurance & Compliance
1 63 (5.42%) Data Quality
2 30 (2.58%) SLA
3 27 (2.32%) GDPR
4 26 (2.24%) QA
5 17 (1.46%) Accessibility
6 6 (0.52%) WAI
7 4 (0.34%) ISO/IEC 27001
8 2 (0.17%) SEPA
9 1 (0.086%) PMO
System Software
1 82 (7.06%) Docker
2 52 (4.48%) HDFS
3 7 (0.60%) VMware Infrastructure
4 6 (0.52%) Hyper-V
5 5 (0.43%) Firmware
6 3 (0.26%) Active Directory
6 3 (0.26%) Virtual Machines
6 3 (0.26%) vSphere
7 2 (0.17%) IAG
8 1 (0.086%) Apache Flume
8 1 (0.086%) KVM
8 1 (0.086%) Slurm Workload Manager
8 1 (0.086%) VMware ESXi
Systems Management
1 246 (21.17%) Kubernetes
2 177 (15.23%) Terraform
3 79 (6.80%) Ansible
4 71 (6.11%) Prometheus
5 44 (3.79%) Puppet
6 16 (1.38%) Grafana
6 16 (1.38%) HAProxy
7 8 (0.69%) Progress Chef
8 6 (0.52%) Docker Swarm
9 4 (0.34%) Microsoft Intune
10 3 (0.26%) Perfmon
10 3 (0.26%) Podman
11 2 (0.17%) Argo
11 2 (0.17%) Kibana
11 2 (0.17%) Kubeflow
11 2 (0.17%) Kustomize
12 1 (0.086%) HP ALM
12 1 (0.086%) Nagios
12 1 (0.086%) vCenter Server
12 1 (0.086%) vRealize
Vendors
1 192 (16.52%) Databricks
2 116 (9.98%) Microsoft
3 74 (6.37%) Google
4 37 (3.18%) Informatica
5 31 (2.67%) Oracle
6 29 (2.50%) Red Hat
6 29 (2.50%) SaltStack
7 21 (1.81%) Alteryx
7 21 (1.81%) Cloudera
8 18 (1.55%) Cognos
9 16 (1.38%) Sybase
10 14 (1.20%) Dell
11 13 (1.12%) VMware
12 12 (1.03%) Teradata
13 11 (0.95%) Salesforce
13 11 (0.95%) SAP
14 8 (0.69%) YouTube
15 7 (0.60%) Citrix
15 7 (0.60%) Sparx
16 4 (0.34%) Cisco