Data Pipeline Jobs in the UK excluding London

Data Pipelines
UK > UK excluding London

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 7 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
7 Jun 2024
Same period 2023 Same period 2022
Rank 271 297 309
Rank change year-on-year +26 +12 +86
Permanent jobs citing Data Pipeline 748 607 861
As % of all permanent jobs advertised in the UK excluding London 0.95% 1.08% 1.14%
As % of the Processes & Methodologies category 1.17% 1.14% 1.21%
Number of salaries quoted 380 289 396
10th Percentile £35,000 £42,250 £42,500
25th Percentile £42,500 £47,500 £50,000
Median annual salary (50th Percentile) £60,000 £62,000 £65,000
Median % change year-on-year -3.23% -4.62% +11.12%
75th Percentile £73,750 £77,715 £87,500
90th Percentile £92,500 £86,484 -
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +11.11%

All Process and Methodology Skills
UK excluding London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 63,715 53,455 71,081
As % of all permanent jobs advertised in the UK excluding London 81.19% 95.50% 94.28%
Number of salaries quoted 43,312 28,495 41,629
10th Percentile £27,500 £30,500 £30,000
25th Percentile £36,250 £40,000 £38,750
Median annual salary (50th Percentile) £50,000 £55,000 £52,500
Median % change year-on-year -9.09% +4.76% +9.38%
75th Percentile £65,000 £70,000 £67,500
90th Percentile £77,500 £82,500 £80,000
UK median annual salary £55,000 £60,800 £60,000
% change year-on-year -9.54% +1.33% +9.09%

Data Pipeline
Job Vacancy Trend in the UK excluding London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Data Pipeline in the UK excluding London.

Salary trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Data Pipeline in the UK excluding London over the 6 months to 7 June 2024.

Salary histogram for Data Pipeline in the UK excluding London

Data Pipeline
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the UK excluding London region over the 6 months to 7 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
North of England +22 233 £52,500 -19.85% 52
Scotland +37 176 £66,500 +2.31% 17
North West +55 146 £50,000 -12.44% 31
South East +17 112 £67,500 +15.40% 29
Midlands +13 110 £52,000 -9.57% 26
South West -62 73 £67,500 -1.69% 13
West Midlands -2 59 £60,000 +2.13% 18
East Midlands +9 51 £40,000 -27.27% 6
Yorkshire -24 47 £70,000 +0.80% 16
North East +21 40 £52,500 +34.62% 5
East of England +13 29 £57,500 -9.80% 9
Wales +8 16 £46,131 +6.05% 2
Northern Ireland +8 3 £60,000 -20.00% 5
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 63 (8.42%) Apache Spark
2 44 (5.88%) Apache
3 18 (2.41%) Apache Airflow
4 3 (0.40%) Confluence
4 3 (0.40%) Luigi
5 2 (0.27%) SharePoint
6 1 (0.13%) SAS
Applications
1 7 (0.94%) Microsoft Excel
2 1 (0.13%) Revit
Business Applications
1 1 (0.13%) Salesforce CRM
1 1 (0.13%) SAP S/4HANA
Cloud Services
1 256 (34.22%) Azure
2 238 (31.82%) GCP
3 200 (26.74%) AWS
4 133 (17.78%) Power Platform
5 108 (14.44%) Snowflake
6 105 (14.04%) Azure Data Factory
7 54 (7.22%) Matillion
8 45 (6.02%) Cloud Computing
9 44 (5.88%) Azure Synapse Analytics
10 34 (4.55%) Serverless
11 30 (4.01%) Azure Cosmos DB
12 27 (3.61%) Azure DevOps
13 25 (3.34%) dbt
14 19 (2.54%) Amazon S3
15 16 (2.14%) GitHub
16 15 (2.01%) AWS Lambda
17 14 (1.87%) Fivetran
18 13 (1.74%) SaaS
19 9 (1.20%) PaaS
20 8 (1.07%) Dynamics 365
Communications & Networking
1 65 (8.69%) Kerberos
2 14 (1.87%) DSL
3 3 (0.40%) Firewall
4 2 (0.27%) Intrusion Detection
4 2 (0.27%) VPN
5 1 (0.13%) 3GPP
5 1 (0.13%) 5G
Database & Business Intelligence
1 230 (30.75%) Data Warehouse
2 191 (25.53%) BigQuery
3 165 (22.06%) Data Lake
4 164 (21.93%) Looker
5 130 (17.38%) Power BI
6 98 (13.10%) Metadata
7 91 (12.17%) SQL Server
8 78 (10.43%) Big Data
9 63 (8.42%) NoSQL
10 56 (7.49%) SQL Server Integration Services
11 52 (6.95%) Tableau
12 34 (4.55%) Azure SQL Data Warehouse
13 33 (4.41%) Amazon Redshift
13 33 (4.41%) Elasticsearch
13 33 (4.41%) Star Schema
14 26 (3.48%) Azure SQL Database
15 24 (3.21%) PostgreSQL
16 23 (3.07%) Hadoop
17 19 (2.54%) MySQL
17 19 (2.54%) Relational Database
Development Applications
1 123 (16.44%) Git
2 80 (10.70%) Jenkins
3 65 (8.69%) Artifactory
3 65 (8.69%) Bitbucket
4 39 (5.21%) GitLab
5 7 (0.94%) Oracle Forms
6 6 (0.80%) RStudio
7 5 (0.67%) GDB
8 3 (0.40%) JIRA
8 3 (0.40%) Octopus Deploy
8 3 (0.40%) Spinnaker
9 2 (0.27%) Visual Studio
10 1 (0.13%) ERwin
10 1 (0.13%) TeamCity
10 1 (0.13%) Visual Studio Team System
General
1 261 (34.89%) Analytical Skills
2 224 (29.95%) Finance
3 158 (21.12%) Inclusion and Diversity
4 141 (18.85%) Law
5 132 (17.65%) Social Skills
6 104 (13.90%) Marketing
7 51 (6.82%) Banking
8 44 (5.88%) Retail
9 43 (5.75%) Presentation Skills
10 41 (5.48%) Legal
11 29 (3.88%) Public Sector
12 15 (2.01%) Financial Institution
12 15 (2.01%) Investment Banking
13 12 (1.60%) Billing
13 12 (1.60%) Games
14 8 (1.07%) Back Office
15 7 (0.94%) Telecoms
16 4 (0.53%) Agriculture
16 4 (0.53%) Tech for Good
16 4 (0.53%) Wearables
Job Titles
1 424 (56.68%) Data Engineer
2 162 (21.66%) Principal Engineer
3 161 (21.52%) Principal Data Engineer
4 159 (21.26%) Platform Engineer
5 132 (17.65%) Senior
6 115 (15.37%) Lead
7 113 (15.11%) Software Engineer
8 66 (8.82%) Lead Software Engineer
9 58 (7.75%) Developer
10 52 (6.95%) Senior Data Engineer
11 47 (6.28%) Senior Software Engineer
12 42 (5.61%) Architect
12 42 (5.61%) Data Architect
13 39 (5.21%) AWS Engineer
14 34 (4.55%) AWS Software Engineer
14 34 (4.55%) Lead Data Engineer
15 33 (4.41%) Analyst
16 31 (4.14%) Software Engineering Director
17 26 (3.48%) Data Analyst
18 21 (2.81%) Data Scientist
Libraries, Frameworks & Software Standards
1 70 (9.36%) RESTful
2 68 (9.09%) JSON
2 68 (9.09%) Web Services
2 68 (9.09%) XML
3 65 (8.69%) JSON-LD
3 65 (8.69%) LDAP
3 65 (8.69%) OpenID
3 65 (8.69%) SAML
4 35 (4.68%) Kafka
5 26 (3.48%) Pandas
6 24 (3.21%) PySpark
7 17 (2.27%) Apache NiFi
8 13 (1.74%) XGBoost
9 10 (1.34%) REST
10 8 (1.07%) Apache Beam
11 7 (0.94%) Flask
12 6 (0.80%) FastAPI
12 6 (0.80%) PyTorch
12 6 (0.80%) TensorFlow
13 5 (0.67%) Django
Miscellaneous
1 194 (25.94%) Self-Motivation
2 89 (11.90%) Management Information System
3 75 (10.03%) Data Structures
4 65 (8.69%) Enterprise Cloud
4 65 (8.69%) Reference Data
5 52 (6.95%) Algorithms
6 45 (6.02%) Onboarding
7 44 (5.88%) Cloud Native
8 39 (5.21%) Product Ownership
9 21 (2.81%) Public Cloud
10 19 (2.54%) Taxonomies
11 10 (1.34%) IoT
12 8 (1.07%) Renewable Energy
13 6 (0.80%) Analytical Mindset
13 6 (0.80%) Client/Server
13 6 (0.80%) Data Centre
13 6 (0.80%) Enterprise Software
13 6 (0.80%) Greenfield Project
13 6 (0.80%) Reinsurance
14 5 (0.67%) Replication
Operating Systems
1 17 (2.27%) Linux
2 7 (0.94%) Unix
3 1 (0.13%) Android
3 1 (0.13%) Windows
Processes & Methodologies
1 418 (55.88%) Agile
2 359 (47.99%) Data Engineering
3 295 (39.44%) Problem-Solving
4 286 (38.24%) ETL
5 280 (37.43%) Data Science
6 271 (36.23%) Data Modelling
7 247 (33.02%) Analytics
8 244 (32.62%) CI/CD
9 210 (28.07%) Mentoring
10 209 (27.94%) DevOps
11 184 (24.60%) Platform Engineering
12 182 (24.33%) Machine Learning
13 171 (22.86%) Software Engineering
14 165 (22.06%) DataOps
15 164 (21.93%) Visualisation
16 160 (21.39%) Business Intelligence
17 151 (20.19%) Change Management
18 148 (19.79%) Data Analysis
19 144 (19.25%) Data Transformation
20 132 (17.65%) SDLC
Programming Languages
1 400 (53.48%) SQL
2 326 (43.58%) Python
3 77 (10.29%) Java
4 72 (9.63%) Go
5 65 (8.69%) Prolog
5 65 (8.69%) SPARQL
6 59 (7.89%) Scala
7 50 (6.68%) T-SQL
8 16 (2.14%) PL/SQL
9 14 (1.87%) C#
10 13 (1.74%) R
11 8 (1.07%) Data Analysis Expressions
12 7 (0.94%) Kotlin
13 6 (0.80%) JavaScript
14 4 (0.53%) C
15 2 (0.27%) Kusto Query Language
15 2 (0.27%) PowerShell
15 2 (0.27%) TypeScript
16 1 (0.13%) C++
Qualifications
1 79 (10.56%) Degree
2 59 (7.89%) DBS Check
3 36 (4.81%) Computer Science Degree
4 22 (2.94%) Security Cleared
5 17 (2.27%) DV Cleared
5 17 (2.27%) Master's Degree
6 16 (2.14%) SC Cleared
7 11 (1.47%) Azure Certification
8 7 (0.94%) Microsoft Certification
9 4 (0.53%) PMI Certification
10 3 (0.40%) AWS Certification
10 3 (0.40%) AWS Certified Solutions Architect
11 1 (0.13%) Numerate Degree
11 1 (0.13%) SnowPro
Quality Assurance & Compliance
1 171 (22.86%) GDPR
2 112 (14.97%) Data Quality
3 15 (2.01%) SLA
4 7 (0.94%) QA
5 5 (0.67%) Accessibility
6 3 (0.40%) ISO/IEC 27001
7 1 (0.13%) California Consumer Privacy Act
7 1 (0.13%) HIPAA
7 1 (0.13%) NCSC
System Software
1 69 (9.22%) Active Directory
2 13 (1.74%) Docker
3 4 (0.53%) Virtual Machines
4 1 (0.13%) HDFS
Systems Management
1 37 (4.95%) Kubernetes
2 19 (2.54%) Terraform
3 3 (0.40%) Ansible
Vendors
1 189 (25.27%) Google
2 187 (25.00%) Databricks
3 92 (12.30%) Microsoft
4 26 (3.48%) Oracle
5 22 (2.94%) Alteryx
6 15 (2.01%) Informatica
7 14 (1.87%) Cognos
7 14 (1.87%) Sybase
8 8 (1.07%) Teradata
9 7 (0.94%) YouTube
10 6 (0.80%) Dataiku
10 6 (0.80%) F5
11 5 (0.67%) SAP
11 5 (0.67%) Talend
12 3 (0.40%) Confluent
12 3 (0.40%) SnapLogic
13 2 (0.27%) Sage
13 2 (0.27%) Splunk
13 2 (0.27%) Twitter
14 1 (0.13%) Salesforce