Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 1 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
1 Jun 2024
Same period 2023 Same period 2022
Rank 137 226 234
Rank change year-on-year +89 +8 -49
Contract jobs citing Data Pipeline 320 297 491
As % of all contract jobs advertised in London 1.83% 1.17% 1.27%
As % of the Processes & Methodologies category 2.07% 1.28% 1.38%
Number of daily rates quoted 244 197 346
10th Percentile £387 £438 £469
25th Percentile £462 £500 £525
Median daily rate (50th Percentile) £575 £563 £625
Median % change year-on-year +2.22% -10.00% +13.64%
75th Percentile £688 £688 £750
90th Percentile £772 £775 £825
England median daily rate £550 £550 £600
% change year-on-year - -8.33% +12.83%
Number of hourly rates quoted 1 3 6
10th Percentile - £67.50 £27.00
25th Percentile £46.75 £71.25 £28.56
Median hourly rate £48.50 £80.00 £33.75
Median % change year-on-year -39.38% +137.04% -17.68%
75th Percentile £50.25 £86.25 £68.25
90th Percentile - £88.50 £84.83
England median hourly rate £62.50 £75.50 £33.75
% change year-on-year -17.22% +123.70% -10.00%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,465 23,124 35,641
As % of all contract IT jobs advertised in London 88.32% 90.91% 92.20%
Number of daily rates quoted 11,089 16,746 26,132
10th Percentile £340 £375 £390
25th Percentile £449 £475 £475
Median daily rate (50th Percentile) £550 £590 £575
Median % change year-on-year -6.78% +2.61% +9.52%
75th Percentile £675 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £545
% change year-on-year -4.55% +0.92% +9.00%
Number of hourly rates quoted 320 264 402
10th Percentile £15.50 £18.00 £16.50
25th Percentile £20.00 £22.50 £23.91
Median hourly rate £28.00 £39.21 £35.50
Median % change year-on-year -28.59% +10.45% +8.07%
75th Percentile £48.75 £64.50 £50.00
90th Percentile £68.08 £82.50 £67.50
England median hourly rate £37.50 £37.32 £25.00
% change year-on-year +0.48% +49.28% +11.11%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 1 June 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 1 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +40 50 £538 -6.52% 14
South London - 4 £450 - 1
West London +13 3 £525 -8.70% 1
East London -5 1 £750 +50.00%
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 62 (19.38%) Apache Spark
2 42 (13.13%) Apache
3 38 (11.88%) Apache Airflow
4 4 (1.25%) Luigi
5 3 (0.94%) SharePoint
6 2 (0.63%) Confluence
7 1 (0.31%) ArcGIS
Applications
1 7 (2.19%) Microsoft Excel
2 2 (0.63%) Microsoft Office
Business Applications
1 2 (0.63%) Dynamics CRM
Cloud Services
1 142 (44.38%) Azure
2 141 (44.06%) AWS
3 54 (16.88%) Serverless
4 44 (13.75%) GCP
5 42 (13.13%) AWS Lambda
6 41 (12.81%) Amazon S3
7 40 (12.50%) Azure Data Factory
8 28 (8.75%) Azure Synapse Analytics
9 23 (7.19%) Azure DevOps
10 20 (6.25%) AWS Step Functions
10 20 (6.25%) Snowflake
11 19 (5.94%) Amazon Kinesis
11 19 (5.94%) Power Platform
12 18 (5.63%) Amazon EMR
12 18 (5.63%) GitHub
13 17 (5.31%) Amazon EC2
14 14 (4.38%) dbt
15 12 (3.75%) Amazon MSK
15 12 (3.75%) Azure Logic Apps
16 7 (2.19%) Dagster
Communications & Networking
1 1 (0.31%) Firewall
Database & Business Intelligence
1 97 (30.31%) Data Warehouse
2 71 (22.19%) Big Data
3 63 (19.69%) Data Lake
4 35 (10.94%) NoSQL
5 33 (10.31%) Amazon Redshift
6 22 (6.88%) Parquet
7 21 (6.56%) Relational Database
8 19 (5.94%) BigQuery
8 19 (5.94%) Power BI
9 17 (5.31%) Azure SQL Database
10 16 (5.00%) SQL Server
11 14 (4.38%) DynamoDB
12 13 (4.06%) Amazon RDS
12 13 (4.06%) Flink
13 11 (3.44%) Amazon Athena
13 11 (3.44%) Delta Lake
14 10 (3.13%) PostgreSQL
15 9 (2.81%) Tableau
16 8 (2.50%) Hadoop
16 8 (2.50%) Spark SQL
Development Applications
1 27 (8.44%) Git
2 11 (3.44%) Jenkins
3 8 (2.50%) JIRA
4 7 (2.19%) GitLab
5 6 (1.88%) MLflow
6 4 (1.25%) Deequ
7 2 (0.63%) Bugzilla
7 2 (0.63%) ER Studio
7 2 (0.63%) ERwin
7 2 (0.63%) JMeter
7 2 (0.63%) JUnit
7 2 (0.63%) Selenium
7 2 (0.63%) TestNG
7 2 (0.63%) TestRail
7 2 (0.63%) Travis CI
8 1 (0.31%) GoCD
8 1 (0.31%) IBM UrbanCode
8 1 (0.31%) kappa
8 1 (0.31%) TeamCity
8 1 (0.31%) webpack
General
1 87 (27.19%) Social Skills
2 60 (18.75%) Finance
3 55 (17.19%) Analytical Skills
4 21 (6.56%) Public Sector
5 20 (6.25%) Banking
6 14 (4.38%) Front Office
7 12 (3.75%) Presentation Skills
8 6 (1.88%) Investment Banking
8 6 (1.88%) Marketing
9 4 (1.25%) Inclusion and Diversity
9 4 (1.25%) Retail
10 3 (0.94%) Financial Institution
10 3 (0.94%) Pharmaceutical
11 2 (0.63%) Czech Language
12 1 (0.31%) Games
12 1 (0.31%) Influencing Skills
12 1 (0.31%) Local Government
12 1 (0.31%) Organisational Skills
Job Titles
1 170 (53.13%) Data Engineer
2 59 (18.44%) Senior
3 43 (13.44%) Developer
4 37 (11.56%) Azure Engineer
5 36 (11.25%) Azure Data Engineer
6 33 (10.31%) Senior Data Engineer
7 30 (9.38%) Architect
8 29 (9.06%) AWS Engineer
9 24 (7.50%) AWS Data Engineer
10 20 (6.25%) Lead
11 19 (5.94%) Data Scientist
12 14 (4.38%) Lead Data Engineer
12 14 (4.38%) Python Developer
13 13 (4.06%) Analyst
14 12 (3.75%) Python Engineer
14 12 (3.75%) Senior Developer
15 10 (3.13%) Data Architect
15 10 (3.13%) Python Data Engineer
15 10 (3.13%) Quantitative Developer
16 8 (2.50%) GCP Engineer
Libraries, Frameworks & Software Standards
1 49 (15.31%) Kafka
2 48 (15.00%) PySpark
3 27 (8.44%) Pandas
4 19 (5.94%) Apache Avro
4 19 (5.94%) JSON
5 17 (5.31%) NumPy
6 12 (3.75%) SciPy
7 10 (3.13%) TensorFlow
8 9 (2.81%) scikit-learn
9 7 (2.19%) REST
10 5 (1.56%) ARM Templates
10 5 (1.56%) JSON Schema
11 4 (1.25%) GraphQL
11 4 (1.25%) Great Expectations
11 4 (1.25%) PyTorch
11 4 (1.25%) RESTful
11 4 (1.25%) Spark Streaming
11 4 (1.25%) Web Services
11 4 (1.25%) YAML
12 3 (0.94%) SOAP
Miscellaneous
1 23 (7.19%) Algorithms
2 18 (5.63%) Derivative
3 13 (4.06%) Data Structures
4 10 (3.13%) Distributed Systems
4 10 (3.13%) Greenfield Project
5 8 (2.50%) Management Information System
6 7 (2.19%) Hedge funds
7 6 (1.88%) Self-Motivation
8 5 (1.56%) Analytical Mindset
8 5 (1.56%) Renewable Energy
9 4 (1.25%) Cloud Native
9 4 (1.25%) Distributed Computing
9 4 (1.25%) Security Posture
10 3 (0.94%) Grid Computing
10 3 (0.94%) Legacy Systems
10 3 (0.94%) Life Science
10 3 (0.94%) Virtual Team
11 2 (0.63%) Credit Risk
11 2 (0.63%) Data Protection Act
11 2 (0.63%) Wiki
Operating Systems
1 12 (3.75%) Linux
2 2 (0.63%) Unix
3 1 (0.31%) VMS
3 1 (0.31%) Windows
3 1 (0.31%) Windows Server
Processes & Methodologies
1 135 (42.19%) ETL
2 107 (33.44%) Analytics
3 104 (32.50%) Data Modelling
4 89 (27.81%) Data Engineering
5 82 (25.63%) CI/CD
6 69 (21.56%) Problem-Solving
7 66 (20.63%) DevOps
8 61 (19.06%) Agile
8 61 (19.06%) Data Science
9 46 (14.38%) Data Integration
10 43 (13.44%) Machine Learning
11 41 (12.81%) Computer Science
11 41 (12.81%) Data Ingestion
12 37 (11.56%) Business Intelligence
13 35 (10.94%) Continuous Integration
14 33 (10.31%) Data Transformation
15 29 (9.06%) Test Automation
16 25 (7.81%) Data Analytics
16 25 (7.81%) Data Governance
16 25 (7.81%) Infrastructure as Code
Programming Languages
1 219 (68.44%) Python
2 195 (60.94%) SQL
3 39 (12.19%) Java
3 39 (12.19%) Scala
4 19 (5.94%) C++
5 13 (4.06%) JavaScript
6 12 (3.75%) Rust
7 11 (3.44%) C#
8 9 (2.81%) T-SQL
9 7 (2.19%) Bash
9 7 (2.19%) Go
9 7 (2.19%) TypeScript
10 6 (1.88%) Bicep
11 5 (1.56%) VBA
12 3 (0.94%) PowerShell
13 2 (0.63%) Lua
13 2 (0.63%) Perl
13 2 (0.63%) PHP
13 2 (0.63%) R
13 2 (0.63%) VB
Qualifications
1 57 (17.81%) Security Cleared
2 56 (17.50%) SC Cleared
3 42 (13.13%) Degree
4 29 (9.06%) Computer Science Degree
5 10 (3.13%) Master's Degree
6 8 (2.50%) Azure Certification
7 6 (1.88%) CISSP
8 4 (1.25%) AWS Certification
9 3 (0.94%) CISA
9 3 (0.94%) CRISC
9 3 (0.94%) Microsoft Certification
10 2 (0.63%) BPSS Clearance
11 1 (0.31%) (ISC)2 CCSP
11 1 (0.31%) AWS Certified Solutions Architect
11 1 (0.31%) Cisco Certification
11 1 (0.31%) CSSLP
11 1 (0.31%) DV Cleared
11 1 (0.31%) Numerate Degree
11 1 (0.31%) PhD
Quality Assurance & Compliance
1 62 (19.38%) Data Quality
2 5 (1.56%) QA
3 4 (1.25%) Accessibility
4 3 (0.94%) GDPR
5 1 (0.31%) NIST
System Software
1 24 (7.50%) Docker
2 3 (0.94%) HDFS
3 1 (0.31%) Virtual Machines
Systems Management
1 32 (10.00%) Terraform
2 21 (6.56%) Kubernetes
3 5 (1.56%) Ansible
4 4 (1.25%) Argo
5 1 (0.31%) Kubeflow
5 1 (0.31%) Progress Chef
Vendors
1 79 (24.69%) Databricks
2 23 (7.19%) Microsoft
3 19 (5.94%) Google
4 11 (3.44%) Oracle
5 7 (2.19%) Informatica
5 7 (2.19%) Palantir
6 6 (1.88%) Foundry
7 3 (0.94%) Alteryx
7 3 (0.94%) Cloudera
7 3 (0.94%) IBM
7 3 (0.94%) Splunk
7 3 (0.94%) TIBCO
8 2 (0.63%) Ab Initio
8 2 (0.63%) Dataiku
8 2 (0.63%) Dynatrace
8 2 (0.63%) OpenAI
8 2 (0.63%) Salesforce
8 2 (0.63%) SAP
8 2 (0.63%) SnapLogic
8 2 (0.63%) Workday