Data Pipeline Contracts in England

Data Pipelines
UK > England

The table below provides summary statistics for contract job vacancies advertised in England requiring Data Pipeline skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Pipeline over the 6 months leading up to 13 June 2024, comparing them to the same period in the previous two years.

6 months to
13 Jun 2024
Same period 2023 Same period 2022
Rank 181 289 277
Rank change year-on-year +108 -12 -25
Contract jobs citing Data Pipeline 502 414 701
As % of all contract jobs advertised in England 1.34% 0.88% 1.00%
As % of the Processes & Methodologies category 1.57% 0.98% 1.10%
Number of daily rates quoted 373 281 467
10th Percentile £363 £413 £453
25th Percentile £448 £488 £513
Median daily rate (50th Percentile) £525 £550 £600
Median % change year-on-year -4.55% -8.33% +14.29%
75th Percentile £650 £675 £726
90th Percentile £750 £750 £825
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 6 5 8
10th Percentile £34.24 £47.75 £27.30
25th Percentile £49.75 £65.00 £28.88
Median hourly rate £62.50 £75.50 £33.75
Median % change year-on-year -17.22% +123.70% -10.00%
75th Percentile £66.25 £82.50 £60.00
90th Percentile £67.50 £87.00 £82.40
UK median hourly rate £62.50 £75.50 £33.75
% change year-on-year -17.22% +123.70% -24.16%

All Process and Methodology Skills
England

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills in England.

Contract vacancies with a requirement for process or methodology skills 32,030 42,283 63,775
As % of all contract IT jobs advertised in England 85.40% 89.90% 90.87%
Number of daily rates quoted 20,779 29,697 45,496
10th Percentile £300 £325 £338
25th Percentile £413 £440 £435
Median daily rate (50th Percentile) £525 £550 £550
Median % change year-on-year -4.55% - +10.00%
75th Percentile £650 £675 £650
90th Percentile £750 £775 £750
UK median daily rate £525 £550 £538
% change year-on-year -4.55% +2.33% +7.50%
Number of hourly rates quoted 2,363 1,526 1,693
10th Percentile £12.79 £10.69 £12.50
25th Percentile £16.01 £15.75 £15.63
Median hourly rate £37.50 £36.00 £25.68
Median % change year-on-year +4.17% +40.19% +14.13%
75th Percentile £61.30 £64.59 £50.00
90th Percentile £72.50 £75.71 £65.00
UK median hourly rate £37.00 £35.65 £26.00
% change year-on-year +3.79% +37.12% +13.04%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Pipeline in England.

Daily rate trend for Data Pipeline in England

Data Pipeline
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Pipeline in England over the 6 months to 13 June 2024.

Daily rate histogram for Data Pipeline in England

Data Pipeline
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Pipeline in England.

Hourly rate trend for Data Pipeline in England

Data Pipeline
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Pipeline in England over the 6 months to 13 June 2024.

Hourly rate histogram for Data Pipeline in England

Data Pipeline
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 13 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London +97 334 £550 -2.65% 184
North of England +34 57 £500 -16.67% 55
Midlands +43 45 £550 -2.22% 33
West Midlands +40 39 £550 +7.32% 25
North West +13 31 £493 -8.37% 32
South East -4 27 £375 -28.57% 19
Yorkshire +33 26 £533 -16.47% 17
South West -4 11 £550 -15.38% 14
East of England +11 8 £538 +2.38% 8
East Midlands +11 6 £400 -40.74% 6
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 87 (17.33%) Apache Spark
2 62 (12.35%) Apache
3 50 (9.96%) Apache Airflow
4 4 (0.80%) Luigi
5 3 (0.60%) SharePoint
6 2 (0.40%) Confluence
7 1 (0.20%) Jupyter
Applications
1 16 (3.19%) Microsoft Excel
2 9 (1.79%) Microsoft Office
3 7 (1.39%) Microsoft PowerPoint
4 4 (0.80%) Microsoft Project
4 4 (0.80%) MS Visio
4 4 (0.80%) Sketch
Business Applications
1 2 (0.40%) Dynamics CRM
Cloud Services
1 209 (41.63%) Azure
2 186 (37.05%) AWS
3 66 (13.15%) Azure Data Factory
3 66 (13.15%) Serverless
4 61 (12.15%) GCP
5 57 (11.35%) Amazon S3
6 52 (10.36%) AWS Lambda
7 41 (8.17%) Power Platform
8 37 (7.37%) Snowflake
9 36 (7.17%) Azure Synapse Analytics
10 27 (5.38%) Azure DevOps
11 26 (5.18%) Amazon EMR
12 25 (4.98%) GitHub
13 24 (4.78%) dbt
14 22 (4.38%) Amazon EC2
14 22 (4.38%) AWS Step Functions
15 19 (3.78%) Amazon Kinesis
16 14 (2.79%) Azure Logic Apps
17 13 (2.59%) Amazon MSK
18 12 (2.39%) Cloud Computing
Communications & Networking
1 18 (3.59%) Intrusion Detection
1 18 (3.59%) Network Security
2 5 (1.00%) FTP
3 3 (0.60%) DAB
4 2 (0.40%) Firewall
4 2 (0.40%) SAN
Database & Business Intelligence
1 147 (29.28%) Data Warehouse
2 108 (21.51%) Big Data
3 94 (18.73%) Data Lake
4 48 (9.56%) Amazon Redshift
5 46 (9.16%) NoSQL
6 41 (8.17%) Power BI
7 37 (7.37%) Relational Database
8 32 (6.37%) SQL Server
9 29 (5.78%) BigQuery
10 23 (4.58%) Hadoop
10 23 (4.58%) Parquet
11 20 (3.98%) Azure SQL Database
11 20 (3.98%) Flink
11 20 (3.98%) Tableau
12 17 (3.39%) Amazon Athena
13 15 (2.99%) Delta Lake
13 15 (2.99%) DynamoDB
14 14 (2.79%) Amazon RDS
15 13 (2.59%) Metadata
15 13 (2.59%) PostgreSQL
Development Applications
1 46 (9.16%) Git
2 19 (3.78%) JIRA
3 12 (2.39%) Jenkins
4 8 (1.59%) GitLab
4 8 (1.59%) MLflow
5 4 (0.80%) Deequ
5 4 (0.80%) Mercurial
6 3 (0.60%) ERwin
6 3 (0.60%) JMeter
6 3 (0.60%) TestRail
7 2 (0.40%) Bugzilla
7 2 (0.40%) ER Studio
7 2 (0.40%) JUnit
7 2 (0.40%) kappa
7 2 (0.40%) Selenium
7 2 (0.40%) TestNG
7 2 (0.40%) Travis CI
8 1 (0.20%) Bitbucket
8 1 (0.20%) TeamCity
8 1 (0.20%) webpack
General
1 126 (25.10%) Social Skills
2 105 (20.92%) Analytical Skills
3 78 (15.54%) Finance
4 36 (7.17%) Public Sector
5 25 (4.98%) Banking
6 14 (2.79%) Front Office
6 14 (2.79%) Presentation Skills
7 13 (2.59%) Pharmaceutical
8 12 (2.39%) Marketing
9 6 (1.20%) Investment Banking
9 6 (1.20%) Retail
10 5 (1.00%) Manufacturing
11 4 (0.80%) Inclusion and Diversity
11 4 (0.80%) Multimedia
12 3 (0.60%) Back Office
12 3 (0.60%) Czech Language
12 3 (0.60%) Financial Institution
12 3 (0.60%) Games
12 3 (0.60%) Influencing Skills
12 3 (0.60%) Korean Language
Job Titles
1 255 (50.80%) Data Engineer
2 84 (16.73%) Senior
3 60 (11.95%) Developer
4 55 (10.96%) Azure Engineer
5 53 (10.56%) Azure Data Engineer
6 48 (9.56%) Senior Data Engineer
7 44 (8.76%) Architect
8 35 (6.97%) AWS Engineer
9 31 (6.18%) Lead
10 30 (5.98%) AWS Data Engineer
11 23 (4.58%) Analyst
11 23 (4.58%) Data Scientist
12 19 (3.78%) Python Developer
13 17 (3.39%) Data Analyst
14 16 (3.19%) Lead Data Engineer
15 14 (2.79%) Python Engineer
16 13 (2.59%) Senior Developer
17 12 (2.39%) Data Architect
18 11 (2.19%) Cloud Engineer
18 11 (2.19%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 73 (14.54%) PySpark
2 62 (12.35%) Kafka
3 31 (6.18%) Pandas
4 26 (5.18%) JSON
5 22 (4.38%) NumPy
6 20 (3.98%) Apache Avro
7 19 (3.78%) Apache NiFi
8 16 (3.19%) SciPy
9 12 (2.39%) scikit-learn
9 12 (2.39%) TensorFlow
10 9 (1.79%) React
11 8 (1.59%) Elastic Stack
11 8 (1.59%) REST
12 7 (1.39%) PyTorch
13 6 (1.20%) XML
14 5 (1.00%) .NET
14 5 (1.00%) ARM Templates
14 5 (1.00%) CSS
14 5 (1.00%) FastAPI
14 5 (1.00%) HTML
Miscellaneous
1 31 (6.18%) Algorithms
2 29 (5.78%) Management Information System
3 20 (3.98%) Cyber Defence
4 19 (3.78%) Distributed Applications
5 18 (3.59%) Data Structures
5 18 (3.59%) Derivative
6 15 (2.99%) Distributed Systems
7 14 (2.79%) Self-Motivation
8 11 (2.19%) Greenfield Project
9 9 (1.79%) Linux Command Line
9 9 (1.79%) Onboarding
10 8 (1.59%) Distributed Computing
11 7 (1.39%) Security Posture
12 6 (1.20%) Hedge funds
13 5 (1.00%) Biopharmaceutical
13 5 (1.00%) Renewable Energy
14 4 (0.80%) Analytical Mindset
14 4 (0.80%) Cloud Native
14 4 (0.80%) Social Media
14 4 (0.80%) Virtual Team
Operating Systems
1 39 (7.77%) Linux
2 32 (6.37%) Windows
3 18 (3.59%) Unix
4 16 (3.19%) Android
4 16 (3.19%) Apple iOS
5 8 (1.59%) Ubuntu
6 2 (0.40%) Windows Server
7 1 (0.20%) VMS
Processes & Methodologies
1 205 (40.84%) ETL
2 179 (35.66%) Analytics
3 177 (35.26%) Data Modelling
4 164 (32.67%) Data Engineering
5 116 (23.11%) CI/CD
6 105 (20.92%) Problem-Solving
7 91 (18.13%) DevOps
8 89 (17.73%) Data Science
9 86 (17.13%) Agile
10 77 (15.34%) Business Intelligence
11 76 (15.14%) Data Integration
12 69 (13.75%) Machine Learning
13 60 (11.95%) Data Management
14 58 (11.55%) Computer Science
15 57 (11.35%) Data Governance
15 57 (11.35%) Data Ingestion
16 49 (9.76%) Visualisation
17 46 (9.16%) Data Analysis
18 42 (8.37%) Test Automation
19 41 (8.17%) Data Analytics
Programming Languages
1 307 (61.16%) Python
2 272 (54.18%) SQL
3 67 (13.35%) Java
4 50 (9.96%) Scala
5 23 (4.58%) C++
6 22 (4.38%) JavaScript
7 19 (3.78%) C#
8 18 (3.59%) R
9 16 (3.19%) T-SQL
10 12 (2.39%) Rust
11 7 (1.39%) Bash
11 7 (1.39%) TypeScript
12 6 (1.20%) Bicep
12 6 (1.20%) Go
13 5 (1.00%) PowerShell
13 5 (1.00%) VBA
14 4 (0.80%) Perl
15 3 (0.60%) C
15 3 (0.60%) Data Analysis Expressions
15 3 (0.60%) MATLAB
Qualifications
1 97 (19.32%) Security Cleared
2 75 (14.94%) SC Cleared
3 62 (12.35%) Degree
4 41 (8.17%) Computer Science Degree
5 22 (4.38%) DV Cleared
6 16 (3.19%) Master's Degree
7 10 (1.99%) Azure Certification
8 6 (1.20%) AWS Certification
8 6 (1.20%) CISSP
9 5 (1.00%) BPSS Clearance
10 3 (0.60%) CISA
10 3 (0.60%) CRISC
10 3 (0.60%) Microsoft Certification
10 3 (0.60%) PhD
11 2 (0.40%) AWS Certified Solutions Architect
11 2 (0.40%) Numerate Degree
12 1 (0.20%) (ISC)2 CCSP
12 1 (0.20%) AWS Certified Developer
12 1 (0.20%) AWS Certified DevOps Engineer
12 1 (0.20%) SnowPro
Quality Assurance & Compliance
1 99 (19.72%) Data Quality
2 18 (3.59%) Actionable Recommendations
3 11 (2.19%) QA
4 10 (1.99%) GDPR
5 5 (1.00%) Accessibility
6 4 (0.80%) NIST
7 3 (0.60%) ISO/IEC 27001
8 2 (0.40%) PCI DSS
9 1 (0.20%) California Consumer Privacy Act
System Software
1 37 (7.37%) Docker
2 9 (1.79%) Active Directory
3 8 (1.59%) HDFS
3 8 (1.59%) iptables
4 2 (0.40%) Virtual Machines
4 2 (0.40%) VMware Infrastructure
Systems Management
1 43 (8.57%) Terraform
2 35 (6.97%) Kubernetes
3 8 (1.59%) Kibana
3 8 (1.59%) logstash
4 6 (1.20%) Ansible
5 4 (0.80%) Argo
6 1 (0.20%) Control-M
6 1 (0.20%) Hadoop YARN
6 1 (0.20%) Kubeflow
6 1 (0.20%) Microsoft Intune
6 1 (0.20%) Progress Chef
Vendors
1 115 (22.91%) Databricks
2 36 (7.17%) Microsoft
3 29 (5.78%) Google
4 16 (3.19%) Informatica
5 14 (2.79%) Red Hat
6 13 (2.59%) Oracle
7 11 (2.19%) SAP
8 8 (1.59%) Palantir
9 7 (1.39%) Foundry
10 5 (1.00%) Cloudera
10 5 (1.00%) Talend
11 4 (0.80%) IBM
11 4 (0.80%) IFS
11 4 (0.80%) TIBCO
12 3 (0.60%) Ab Initio
12 3 (0.60%) Alteryx
12 3 (0.60%) Salesforce
12 3 (0.60%) Splunk
13 2 (0.40%) Dynatrace
13 2 (0.40%) SnapLogic