Data Pipeline Jobs in the UK excluding London

Data Pipelines
UK > UK excluding London

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 27 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 May 2024
Same period 2023 Same period 2022
Rank 267 297 302
Rank change year-on-year +30 +5 +116
Permanent jobs citing Data Pipeline 745 654 852
As % of all permanent jobs advertised in the UK excluding London 1.01% 1.12% 1.16%
As % of the Processes & Methodologies category 1.23% 1.17% 1.23%
Number of salaries quoted 367 283 401
10th Percentile £35,000 £41,250 £42,500
25th Percentile £42,500 £47,500 £50,000
Median annual salary (50th Percentile) £60,000 £60,000 £65,000
Median % change year-on-year - -7.69% +11.12%
75th Percentile £73,250 £77,715 £87,500
90th Percentile £86,000 £86,000 -
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +11.11%

All Process and Methodology Skills
UK excluding London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 60,809 55,778 69,247
As % of all permanent jobs advertised in the UK excluding London 82.57% 95.55% 94.26%
Number of salaries quoted 41,900 28,986 41,442
10th Percentile £27,300 £30,500 £30,000
25th Percentile £36,250 £40,000 £38,750
Median annual salary (50th Percentile) £50,000 £55,000 £52,500
Median % change year-on-year -9.09% +4.76% +9.38%
75th Percentile £65,000 £70,000 £67,500
90th Percentile £77,500 £82,500 £80,000
UK median annual salary £55,000 £61,000 £60,000
% change year-on-year -9.84% +1.67% +9.09%

Data Pipeline
Job Vacancy Trend in the UK excluding London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Data Pipeline in the UK excluding London.

Salary trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Data Pipeline in the UK excluding London over the 6 months to 27 May 2024.

Salary histogram for Data Pipeline in the UK excluding London

Data Pipeline
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the UK excluding London region over the 6 months to 27 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
North of England +4 227 £50,750 -20.39% 53
Scotland +40 186 £67,000 +3.08% 23
North West +65 142 £47,500 -5.00% 30
Midlands +22 109 £52,000 -9.57% 27
South East +23 105 £67,500 +17.39% 154
South West -62 72 £67,500 -1.69% 20
West Midlands +4 58 £60,000 - 21
East Midlands +12 51 £40,000 -27.27% 6
Yorkshire -56 44 £59,750 -13.57% 17
North East +35 41 £52,500 +34.62% 6
East of England +17 30 £57,500 -9.80% 16
Wales +10 17 £46,131 -14.97% 4
Northern Ireland +12 3 £60,000 -7.69% 11
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 65 (8.72%) Apache Spark
2 46 (6.17%) Apache
3 18 (2.42%) Apache Airflow
4 3 (0.40%) Luigi
5 2 (0.27%) SharePoint
6 1 (0.13%) Apache Synapse
6 1 (0.13%) Confluence
6 1 (0.13%) SAS
Applications
1 7 (0.94%) Microsoft Excel
Business Applications
1 1 (0.13%) Salesforce CRM
1 1 (0.13%) SAP S/4HANA
Cloud Services
1 245 (32.89%) Azure
2 232 (31.14%) GCP
3 210 (28.19%) AWS
4 128 (17.18%) Power Platform
5 110 (14.77%) Snowflake
6 100 (13.42%) Azure Data Factory
7 54 (7.25%) Matillion
8 49 (6.58%) Cloud Computing
9 41 (5.50%) Azure Synapse Analytics
10 35 (4.70%) Serverless
11 30 (4.03%) Azure Cosmos DB
12 26 (3.49%) dbt
13 21 (2.82%) Azure DevOps
14 20 (2.68%) Amazon S3
15 15 (2.01%) AWS Lambda
15 15 (2.01%) GitHub
16 14 (1.88%) Fivetran
17 12 (1.61%) SaaS
18 10 (1.34%) PaaS
19 8 (1.07%) Dynamics 365
Communications & Networking
1 65 (8.72%) Kerberos
2 18 (2.42%) DSL
3 5 (0.67%) Firewall
4 2 (0.27%) Intrusion Detection
4 2 (0.27%) VPN
5 1 (0.13%) 3GPP
5 1 (0.13%) 5G
Database & Business Intelligence
1 227 (30.47%) Data Warehouse
2 191 (25.64%) BigQuery
3 166 (22.28%) Data Lake
4 164 (22.01%) Looker
5 125 (16.78%) Power BI
6 96 (12.89%) Metadata
7 90 (12.08%) SQL Server
8 85 (11.41%) Big Data
9 64 (8.59%) NoSQL
10 57 (7.65%) Tableau
11 53 (7.11%) SQL Server Integration Services
12 35 (4.70%) Azure SQL Data Warehouse
13 33 (4.43%) Amazon Redshift
13 33 (4.43%) Elasticsearch
13 33 (4.43%) Star Schema
14 24 (3.22%) PostgreSQL
15 23 (3.09%) Hadoop
16 21 (2.82%) Azure SQL Database
17 20 (2.68%) MongoDB
18 19 (2.55%) MySQL
Development Applications
1 121 (16.24%) Git
2 84 (11.28%) Jenkins
3 66 (8.86%) Bitbucket
4 65 (8.72%) Artifactory
5 40 (5.37%) GitLab
6 7 (0.94%) Oracle Forms
7 6 (0.81%) RStudio
8 5 (0.67%) GDB
8 5 (0.67%) Spinnaker
9 3 (0.40%) Octopus Deploy
10 2 (0.27%) TeamCity
10 2 (0.27%) Visual Studio
10 2 (0.27%) Visual Studio Team System
11 1 (0.13%) Cucumber
11 1 (0.13%) ERwin
11 1 (0.13%) JIRA
11 1 (0.13%) Selenium
General
1 261 (35.03%) Analytical Skills
2 229 (30.74%) Finance
3 170 (22.82%) Inclusion and Diversity
4 153 (20.54%) Law
5 130 (17.45%) Social Skills
6 112 (15.03%) Marketing
7 57 (7.65%) Banking
8 47 (6.31%) Presentation Skills
9 45 (6.04%) Legal
10 41 (5.50%) Retail
11 27 (3.62%) Public Sector
12 19 (2.55%) Financial Institution
12 19 (2.55%) Investment Banking
13 12 (1.61%) Billing
13 12 (1.61%) Games
14 8 (1.07%) Back Office
15 7 (0.94%) Telecoms
16 4 (0.54%) Agriculture
16 4 (0.54%) Tech for Good
16 4 (0.54%) Wearables
Job Titles
1 422 (56.64%) Data Engineer
2 160 (21.48%) Platform Engineer
2 160 (21.48%) Principal Engineer
3 159 (21.34%) Principal Data Engineer
4 126 (16.91%) Senior
5 119 (15.97%) Software Engineer
6 114 (15.30%) Lead
7 66 (8.86%) Lead Software Engineer
8 58 (7.79%) Developer
9 47 (6.31%) Senior Software Engineer
10 46 (6.17%) Senior Data Engineer
11 39 (5.23%) AWS Engineer
11 39 (5.23%) Software Engineering Director
12 38 (5.10%) Architect
12 38 (5.10%) Data Architect
13 35 (4.70%) Analyst
14 34 (4.56%) AWS Software Engineer
14 34 (4.56%) Lead Data Engineer
15 26 (3.49%) Data Analyst
16 22 (2.95%) Technology Director
Libraries, Frameworks & Software Standards
1 71 (9.53%) RESTful
2 70 (9.40%) JSON
2 70 (9.40%) XML
3 68 (9.13%) Web Services
4 65 (8.72%) JSON-LD
4 65 (8.72%) LDAP
4 65 (8.72%) OpenID
4 65 (8.72%) SAML
5 42 (5.64%) Kafka
6 25 (3.36%) Pandas
7 21 (2.82%) Apache NiFi
8 20 (2.68%) PySpark
9 13 (1.74%) XGBoost
10 10 (1.34%) REST
11 8 (1.07%) Apache Beam
12 6 (0.81%) Flask
12 6 (0.81%) PyTorch
12 6 (0.81%) TensorFlow
13 5 (0.67%) Django
13 5 (0.67%) FastAPI
Miscellaneous
1 194 (26.04%) Self-Motivation
2 93 (12.48%) Management Information System
3 72 (9.66%) Data Structures
4 65 (8.72%) Enterprise Cloud
4 65 (8.72%) Reference Data
5 55 (7.38%) Algorithms
6 52 (6.98%) Cloud Native
7 49 (6.58%) Onboarding
8 44 (5.91%) Product Ownership
9 25 (3.36%) Public Cloud
10 23 (3.09%) Taxonomies
11 10 (1.34%) IoT
12 8 (1.07%) Renewable Energy
13 6 (0.81%) Analytical Mindset
13 6 (0.81%) Client/Server
13 6 (0.81%) Data Centre
13 6 (0.81%) Enterprise Software
14 5 (0.67%) Reinsurance
14 5 (0.67%) Replication
15 4 (0.54%) Greenfield Project
Operating Systems
1 17 (2.28%) Linux
2 7 (0.94%) Unix
3 1 (0.13%) Windows
Processes & Methodologies
1 421 (56.51%) Agile
2 348 (46.71%) Data Engineering
3 297 (39.87%) Problem-Solving
4 288 (38.66%) ETL
5 280 (37.58%) Data Science
6 278 (37.32%) Data Modelling
7 252 (33.83%) CI/CD
8 241 (32.35%) Analytics
9 207 (27.79%) Mentoring
10 206 (27.65%) DevOps
11 190 (25.50%) Machine Learning
12 185 (24.83%) Platform Engineering
13 182 (24.43%) Software Engineering
14 170 (22.82%) Visualisation
15 166 (22.28%) DataOps
16 162 (21.74%) Business Intelligence
17 159 (21.34%) Data Analysis
18 151 (20.27%) Change Management
19 141 (18.93%) Data Transformation
20 137 (18.39%) SDLC
Programming Languages
1 398 (53.42%) SQL
2 332 (44.56%) Python
3 82 (11.01%) Java
4 72 (9.66%) Go
5 65 (8.72%) Prolog
5 65 (8.72%) SPARQL
6 61 (8.19%) Scala
7 50 (6.71%) T-SQL
8 20 (2.68%) PL/SQL
9 15 (2.01%) C#
10 13 (1.74%) R
11 8 (1.07%) Data Analysis Expressions
12 7 (0.94%) JavaScript
12 7 (0.94%) Kotlin
13 4 (0.54%) C
14 2 (0.27%) Kusto Query Language
14 2 (0.27%) PowerShell
15 1 (0.13%) TypeScript
Qualifications
1 75 (10.07%) Degree
2 57 (7.65%) DBS Check
3 34 (4.56%) Computer Science Degree
4 18 (2.42%) Security Cleared
5 17 (2.28%) Master's Degree
6 13 (1.74%) DV Cleared
7 12 (1.61%) SC Cleared
8 11 (1.48%) Azure Certification
9 7 (0.94%) Microsoft Certification
10 4 (0.54%) PMI Certification
11 3 (0.40%) AWS Certification
11 3 (0.40%) AWS Certified Solutions Architect
12 2 (0.27%) SnowPro
13 1 (0.13%) Numerate Degree
Quality Assurance & Compliance
1 171 (22.95%) GDPR
2 108 (14.50%) Data Quality
3 19 (2.55%) SLA
4 6 (0.81%) QA
5 5 (0.67%) Accessibility
6 3 (0.40%) ISO/IEC 27001
7 1 (0.13%) California Consumer Privacy Act
7 1 (0.13%) HIPAA
7 1 (0.13%) NCSC
System Software
1 67 (8.99%) Active Directory
2 13 (1.74%) Docker
3 2 (0.27%) Virtual Machines
4 1 (0.13%) HDFS
Systems Management
1 43 (5.77%) Kubernetes
2 19 (2.55%) Terraform
3 3 (0.40%) Ansible
Vendors
1 194 (26.04%) Databricks
2 186 (24.97%) Google
3 89 (11.95%) Microsoft
4 31 (4.16%) Oracle
5 26 (3.49%) Alteryx
6 18 (2.42%) Cognos
6 18 (2.42%) Sybase
7 13 (1.74%) Informatica
8 8 (1.07%) Teradata
9 7 (0.94%) YouTube
10 6 (0.81%) Dataiku
10 6 (0.81%) F5
11 5 (0.67%) Confluent
11 5 (0.67%) SAP
11 5 (0.67%) Talend
12 3 (0.40%) SnapLogic
13 2 (0.27%) Sage
13 2 (0.27%) Splunk
13 2 (0.27%) Twitter
14 1 (0.13%) Salesforce