Data Pipeline Jobs in England

Data Pipelines
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 25 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
25 May 2024
Same period 2023 Same period 2022
Rank 239 274 215
Rank change year-on-year +35 -59 +89
Permanent jobs citing Data Pipeline 1,057 1,139 2,700
As % of all permanent jobs advertised in England 1.20% 1.31% 1.96%
As % of the Processes & Methodologies category 1.42% 1.37% 2.04%
Number of salaries quoted 625 640 951
10th Percentile £37,000 £46,250 £47,500
25th Percentile £51,250 £56,250 £57,500
Median annual salary (50th Percentile) £67,500 £70,000 £75,000
Median % change year-on-year -3.57% -6.67% +11.11%
75th Percentile £85,000 £87,500 £87,500
90th Percentile £107,500 £100,000 £100,000
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +11.11%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 74,286 83,164 132,327
As % of all permanent jobs advertised in England 84.41% 95.59% 95.92%
Number of salaries quoted 54,336 49,441 73,222
10th Percentile £29,000 £34,452 £33,384
25th Percentile £40,000 £46,000 £44,000
Median annual salary (50th Percentile) £55,000 £62,500 £60,000
Median % change year-on-year -12.00% +4.17% +9.09%
75th Percentile £72,500 £82,500 £80,000
90th Percentile £93,750 £102,500 £97,500
UK median annual salary £55,000 £61,000 £60,000
% change year-on-year -9.84% +1.67% +9.09%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Pipeline in England.

Salary trend for Data Pipeline in England

Data Pipeline
Salary Histogram in England

Salary distribution for jobs citing Data Pipeline in England over the 6 months to 25 May 2024.

Salary histogram for Data Pipeline in England

Data Pipeline
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 25 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +72 494 £75,000 -6.25% 335
North of England +7 227 £50,750 -18.15% 48
North West +57 142 £47,500 -5.00% 26
Midlands +25 109 £52,000 -9.57% 30
South East +19 106 £67,500 +17.39% 145
South West -63 73 £67,500 -1.46% 21
West Midlands +8 58 £60,000 - 24
East Midlands +14 51 £40,000 -27.27% 6
Yorkshire -47 44 £59,750 -13.18% 17
North East +32 41 £52,500 +34.62% 5
East of England +31 30 £57,500 -9.80% 14
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 119 (11.26%) Apache Spark
2 77 (7.28%) Apache Airflow
3 72 (6.81%) Apache
4 10 (0.95%) SAS
5 5 (0.47%) Luigi
5 5 (0.47%) SharePoint
6 4 (0.38%) Confluence
7 3 (0.28%) Microsoft Exchange
8 1 (0.095%) Apache Pulsar
8 1 (0.095%) Apache Synapse
Applications
1 19 (1.80%) Microsoft Excel
2 9 (0.85%) Microsoft Office
3 3 (0.28%) Microsoft PowerPoint
3 3 (0.28%) MS Visio
Business Applications
1 4 (0.38%) Primavera
2 1 (0.095%) Salesforce CRM
2 1 (0.095%) SAP S/4HANA
2 1 (0.095%) Shopify
Cloud Services
1 414 (39.17%) AWS
2 407 (38.51%) Azure
3 318 (30.09%) GCP
4 184 (17.41%) Power Platform
5 145 (13.72%) Snowflake
6 139 (13.15%) Azure Data Factory
7 84 (7.95%) Serverless
8 65 (6.15%) Azure Synapse Analytics
9 64 (6.05%) Amazon S3
10 61 (5.77%) dbt
11 56 (5.30%) Matillion
12 40 (3.78%) AWS Lambda
12 40 (3.78%) GitHub
13 36 (3.41%) Azure Cosmos DB
14 29 (2.74%) Azure DevOps
15 26 (2.46%) Amazon EMR
16 21 (1.99%) AWS Step Functions
17 17 (1.61%) Fivetran
18 16 (1.51%) PowerApps
18 16 (1.51%) SaaS
Communications & Networking
1 7 (0.66%) Firewall
2 2 (0.19%) Intrusion Detection
2 2 (0.19%) VPN
3 1 (0.095%) 3GPP
3 1 (0.095%) 5G
3 1 (0.095%) PPP
Database & Business Intelligence
1 323 (30.56%) Data Warehouse
2 206 (19.49%) BigQuery
3 204 (19.30%) Data Lake
4 197 (18.64%) Tableau
5 180 (17.03%) Power BI
6 164 (15.52%) Looker
7 126 (11.92%) SQL Server
8 104 (9.84%) Big Data
9 80 (7.57%) NoSQL
10 63 (5.96%) Amazon Redshift
11 62 (5.87%) SQL Server Integration Services
12 56 (5.30%) Metadata
13 52 (4.92%) PostgreSQL
14 50 (4.73%) Elasticsearch
15 45 (4.26%) Hadoop
16 40 (3.78%) Azure SQL Database
16 40 (3.78%) Star Schema
17 39 (3.69%) Azure SQL Data Warehouse
18 35 (3.31%) Relational Database
19 29 (2.74%) Amazon Athena
Development Applications
1 215 (20.34%) Git
2 49 (4.64%) GitLab
3 42 (3.97%) Jenkins
4 14 (1.32%) Spinnaker
5 8 (0.76%) CircleCI
5 8 (0.76%) Oracle Forms
6 6 (0.57%) Bitbucket
6 6 (0.57%) JIRA
6 6 (0.57%) RStudio
7 5 (0.47%) GDB
8 4 (0.38%) Octopus Deploy
9 3 (0.28%) Visual Studio
10 2 (0.19%) TeamCity
10 2 (0.19%) Visual Studio Team System
10 2 (0.19%) webpack
11 1 (0.095%) Cucumber
11 1 (0.095%) ERwin
11 1 (0.095%) Mockito
11 1 (0.095%) Selenium
11 1 (0.095%) SpecFlow
General
1 408 (38.60%) Analytical Skills
2 343 (32.45%) Social Skills
3 162 (15.33%) Retail
4 148 (14.00%) Presentation Skills
5 144 (13.62%) Finance
6 52 (4.92%) Inclusion and Diversity
7 51 (4.82%) Banking
8 36 (3.41%) Public Sector
9 22 (2.08%) Law
10 15 (1.42%) Games
11 14 (1.32%) Billing
11 14 (1.32%) Front Office
11 14 (1.32%) Marketing
12 11 (1.04%) Influencing Skills
13 10 (0.95%) Back Office
14 9 (0.85%) Retail Banking
14 9 (0.85%) Telecoms
15 8 (0.76%) Health Technology
16 6 (0.57%) Publishing
17 5 (0.47%) Legal
Job Titles
1 585 (55.35%) Data Engineer
2 307 (29.04%) Senior
3 159 (15.04%) Platform Engineer
4 158 (14.95%) Analyst
4 158 (14.95%) Principal Engineer
5 156 (14.76%) Principal Data Engineer
6 149 (14.10%) Data Analyst
7 121 (11.45%) Senior Data Engineer
8 105 (9.93%) Senior Analyst
9 103 (9.74%) Senior Data Analyst
10 102 (9.65%) Lead
11 77 (7.28%) Developer
12 59 (5.58%) Architect
13 53 (5.01%) Data Architect
14 44 (4.16%) Lead Data Engineer
15 43 (4.07%) Engineering Manager
16 39 (3.69%) Python Engineer
17 38 (3.60%) Azure Engineer
18 36 (3.41%) Data Manager
18 36 (3.41%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 74 (7.00%) Kafka
2 73 (6.91%) PySpark
3 41 (3.88%) Pandas
4 33 (3.12%) Apache Beam
5 29 (2.74%) React
6 21 (1.99%) PyTorch
6 21 (1.99%) TensorFlow
7 20 (1.89%) .NET
8 16 (1.51%) REST
9 15 (1.42%) .NET Core
9 15 (1.42%) XGBoost
10 11 (1.04%) .NET Framework
10 11 (1.04%) Spark Streaming
10 11 (1.04%) Unity DI Container
11 10 (0.95%) Flask
12 9 (0.85%) JSON
12 9 (0.85%) Lambda Expressions
12 9 (0.85%) NumPy
12 9 (0.85%) XML
13 8 (0.76%) RESTful
Miscellaneous
1 194 (18.35%) Self-Motivation
2 92 (8.70%) Data Structures
3 35 (3.31%) Algorithms
4 31 (2.93%) Cloud Native
5 24 (2.27%) Onboarding
6 17 (1.61%) Management Information System
7 16 (1.51%) IoT
8 15 (1.42%) Greenfield Project
8 15 (1.42%) Hedge funds
9 11 (1.04%) Blog
9 11 (1.04%) Distributed Systems
9 11 (1.04%) Private Cloud
9 11 (1.04%) Reinsurance
10 10 (0.95%) Enterprise Software
11 9 (0.85%) Client/Server
12 8 (0.76%) Data Centre
12 8 (0.76%) Distributed Applications
12 8 (0.76%) Product Ownership
12 8 (0.76%) Public Cloud
12 8 (0.76%) Renewable Energy
Operating Systems
1 40 (3.78%) Linux
2 21 (1.99%) Unix
3 2 (0.19%) Windows
4 1 (0.095%) Android
4 1 (0.095%) Apple iOS
4 1 (0.095%) Windows Server
Processes & Methodologies
1 478 (45.22%) Data Engineering
2 445 (42.10%) Analytics
3 432 (40.87%) Problem-Solving
4 388 (36.71%) Data Science
5 377 (35.67%) Agile
6 363 (34.34%) ETL
7 306 (28.95%) Visualisation
8 280 (26.49%) Data Modelling
9 247 (23.37%) DevOps
10 232 (21.95%) Mentoring
11 223 (21.10%) Data Analysis
12 214 (20.25%) Business Intelligence
13 198 (18.73%) Platform Engineering
14 178 (16.84%) Mathematics
15 173 (16.37%) CI/CD
15 173 (16.37%) Machine Learning
16 165 (15.61%) DataOps
17 164 (15.52%) Statistics
18 149 (14.10%) Actionable Insight
18 149 (14.10%) Change Management
Programming Languages
1 694 (65.66%) SQL
2 625 (59.13%) Python
3 138 (13.06%) Java
4 78 (7.38%) Scala
5 53 (5.01%) T-SQL
6 36 (3.41%) C#
7 29 (2.74%) R
8 25 (2.37%) TypeScript
9 24 (2.27%) JavaScript
10 17 (1.61%) Data Analysis Expressions
11 16 (1.51%) Go
11 16 (1.51%) Kotlin
12 9 (0.85%) C
13 8 (0.76%) Clojure
14 7 (0.66%) MATLAB
15 6 (0.57%) PowerShell
16 3 (0.28%) Rust
17 2 (0.19%) Bash
17 2 (0.19%) PL/SQL
17 2 (0.19%) Shell Script
Qualifications
1 279 (26.40%) Degree
2 171 (16.18%) DBS Check
3 73 (6.91%) Computer Science Degree
4 44 (4.16%) Master's Degree
5 28 (2.65%) Security Cleared
6 20 (1.89%) SC Cleared
7 15 (1.42%) DV Cleared
8 13 (1.23%) Microsoft Certification
9 12 (1.14%) Azure Certification
10 11 (1.04%) PhD
11 4 (0.38%) CIMA
11 4 (0.38%) PMI Certification
12 3 (0.28%) AWS Certification
12 3 (0.28%) AWS Certified Solutions Architect
12 3 (0.28%) BPSS Clearance
12 3 (0.28%) SnowPro
13 1 (0.095%) Numerate Degree
13 1 (0.095%) Postgraduate
Quality Assurance & Compliance
1 165 (15.61%) GDPR
2 160 (15.14%) Data Quality
3 19 (1.80%) QA
4 12 (1.14%) Accessibility
5 4 (0.38%) Solvency II
6 3 (0.28%) ISO/IEC 27001
7 1 (0.095%) California Consumer Privacy Act
7 1 (0.095%) HIPAA
7 1 (0.095%) NCSC
System Software
1 48 (4.54%) Docker
2 9 (0.85%) HDFS
3 2 (0.19%) Active Directory
3 2 (0.19%) Virtual Machines
Systems Management
1 79 (7.47%) Kubernetes
2 49 (4.64%) Terraform
3 12 (1.14%) Ansible
4 8 (0.76%) Argo
5 5 (0.47%) Kubeflow
6 1 (0.095%) Grafana
6 1 (0.095%) Prometheus
Vendors
1 293 (27.72%) Databricks
2 203 (19.21%) Google
3 127 (12.02%) Microsoft
4 31 (2.93%) Oracle
5 18 (1.70%) Informatica
6 12 (1.14%) Alteryx
6 12 (1.14%) Cloudera
6 12 (1.14%) OpenAI
7 10 (0.95%) SAP
7 10 (0.95%) Teradata
7 10 (0.95%) YouTube
8 7 (0.66%) Bloomberg
9 6 (0.57%) Confluent
9 6 (0.57%) Dataiku
9 6 (0.57%) F5
10 5 (0.47%) Talend
11 3 (0.28%) Hortonworks
11 3 (0.28%) SnapLogic
11 3 (0.28%) Splunk
12 2 (0.19%) Twitter