Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 8 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
8 Jun 2024
Same period 2023 Same period 2022
Rank 135 225 227
Rank change year-on-year +90 +2 -29
Contract jobs citing Data Pipeline 325 292 510
As % of all contract jobs advertised in London 1.85% 1.16% 1.31%
As % of the Processes & Methodologies category 2.10% 1.27% 1.42%
Number of daily rates quoted 248 193 356
10th Percentile £394 £438 £469
25th Percentile £460 £500 £525
Median daily rate (50th Percentile) £555 £565 £625
Median % change year-on-year -1.77% -9.60% +13.64%
75th Percentile £680 £688 £750
90th Percentile £763 £770 £838
England median daily rate £528 £550 £600
% change year-on-year -4.09% -8.33% +14.29%
Number of hourly rates quoted 1 3 8
10th Percentile - £67.50 £27.30
25th Percentile £46.75 £71.25 £28.88
Median hourly rate £48.50 £80.00 £33.75
Median % change year-on-year -39.38% +137.04% -17.68%
75th Percentile £50.25 £86.25 £60.00
90th Percentile - £88.50 £82.40
England median hourly rate £62.50 £75.50 £33.75
% change year-on-year -17.22% +123.70% -10.00%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,493 22,950 35,915
As % of all contract IT jobs advertised in London 88.26% 90.92% 92.18%
Number of daily rates quoted 11,091 16,613 26,332
10th Percentile £340 £375 £390
25th Percentile £445 £475 £475
Median daily rate (50th Percentile) £550 £590 £575
Median % change year-on-year -6.78% +2.61% +9.52%
75th Percentile £675 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £548
% change year-on-year -4.55% +0.46% +9.50%
Number of hourly rates quoted 317 266 397
10th Percentile £15.50 £18.00 £17.00
25th Percentile £20.00 £22.49 £23.91
Median hourly rate £28.50 £39.00 £36.00
Median % change year-on-year -26.92% +8.33% +5.29%
75th Percentile £48.75 £63.94 £51.75
90th Percentile £68.30 £82.38 £67.50
England median hourly rate £37.50 £36.00 £25.50
% change year-on-year +4.17% +41.18% +13.33%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 8 June 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 8 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +43 51 £525 -10.64% 20
South London - 4 £450 -
West London +14 2 £525 -8.70% 4
East London -2 1 £750 +50.00% 2
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 61 (18.77%) Apache Spark
2 41 (12.62%) Apache
3 35 (10.77%) Apache Airflow
4 4 (1.23%) Luigi
5 3 (0.92%) SharePoint
6 2 (0.62%) Confluence
7 1 (0.31%) ArcGIS
Applications
1 7 (2.15%) Microsoft Excel
2 2 (0.62%) Microsoft Office
Business Applications
1 2 (0.62%) Dynamics CRM
Cloud Services
1 149 (45.85%) Azure
2 139 (42.77%) AWS
3 55 (16.92%) Serverless
4 41 (12.62%) Amazon S3
4 41 (12.62%) AWS Lambda
4 41 (12.62%) Azure Data Factory
4 41 (12.62%) GCP
5 30 (9.23%) Azure Synapse Analytics
6 23 (7.08%) Azure DevOps
7 21 (6.46%) Power Platform
8 20 (6.15%) AWS Step Functions
8 20 (6.15%) GitHub
9 19 (5.85%) Amazon Kinesis
9 19 (5.85%) Snowflake
10 17 (5.23%) Amazon EC2
10 17 (5.23%) Amazon EMR
11 15 (4.62%) dbt
12 12 (3.69%) Amazon MSK
12 12 (3.69%) Azure Logic Apps
13 7 (2.15%) Dagster
Communications & Networking
1 1 (0.31%) Firewall
Database & Business Intelligence
1 101 (31.08%) Data Warehouse
2 69 (21.23%) Big Data
3 64 (19.69%) Data Lake
4 37 (11.38%) NoSQL
5 32 (9.85%) Amazon Redshift
6 22 (6.77%) Parquet
7 21 (6.46%) Power BI
7 21 (6.46%) Relational Database
8 17 (5.23%) Azure SQL Database
8 17 (5.23%) BigQuery
8 17 (5.23%) SQL Server
9 14 (4.31%) DynamoDB
10 13 (4.00%) Amazon RDS
10 13 (4.00%) Flink
11 11 (3.38%) Amazon Athena
11 11 (3.38%) Delta Lake
11 11 (3.38%) PostgreSQL
12 9 (2.77%) Tableau
13 8 (2.46%) Hadoop
13 8 (2.46%) Spark SQL
Development Applications
1 27 (8.31%) Git
2 11 (3.38%) Jenkins
3 8 (2.46%) JIRA
3 8 (2.46%) MLflow
4 7 (2.15%) GitLab
5 4 (1.23%) Deequ
6 2 (0.62%) Bugzilla
6 2 (0.62%) ER Studio
6 2 (0.62%) ERwin
6 2 (0.62%) JMeter
6 2 (0.62%) JUnit
6 2 (0.62%) Selenium
6 2 (0.62%) TestNG
6 2 (0.62%) TestRail
6 2 (0.62%) Travis CI
7 1 (0.31%) GoCD
7 1 (0.31%) IBM UrbanCode
7 1 (0.31%) kappa
7 1 (0.31%) TeamCity
7 1 (0.31%) webpack
General
1 87 (26.77%) Social Skills
2 63 (19.38%) Finance
3 56 (17.23%) Analytical Skills
4 21 (6.46%) Banking
4 21 (6.46%) Public Sector
5 14 (4.31%) Front Office
6 11 (3.38%) Presentation Skills
7 7 (2.15%) Marketing
8 6 (1.85%) Investment Banking
9 4 (1.23%) Inclusion and Diversity
9 4 (1.23%) Retail
10 3 (0.92%) Financial Institution
10 3 (0.92%) Pharmaceutical
11 2 (0.62%) Czech Language
11 2 (0.62%) Legal
12 1 (0.31%) Games
12 1 (0.31%) Influencing Skills
12 1 (0.31%) Local Government
12 1 (0.31%) Organisational Skills
Job Titles
1 170 (52.31%) Data Engineer
2 62 (19.08%) Senior
3 42 (12.92%) Developer
4 37 (11.38%) Azure Engineer
5 36 (11.08%) Azure Data Engineer
6 34 (10.46%) Senior Data Engineer
7 29 (8.92%) Architect
7 29 (8.92%) AWS Engineer
8 24 (7.38%) AWS Data Engineer
9 23 (7.08%) Lead
10 21 (6.46%) Data Scientist
11 14 (4.31%) Lead Data Engineer
12 13 (4.00%) Analyst
12 13 (4.00%) Python Developer
13 12 (3.69%) Senior Developer
14 11 (3.38%) Python Engineer
15 10 (3.08%) Data Architect
15 10 (3.08%) Quantitative Developer
16 9 (2.77%) Python Data Engineer
17 8 (2.46%) GCP Engineer
Libraries, Frameworks & Software Standards
1 50 (15.38%) PySpark
2 48 (14.77%) Kafka
3 26 (8.00%) Pandas
4 19 (5.85%) Apache Avro
4 19 (5.85%) JSON
5 17 (5.23%) NumPy
6 12 (3.69%) SciPy
7 9 (2.77%) TensorFlow
8 8 (2.46%) scikit-learn
9 7 (2.15%) REST
10 5 (1.54%) ARM Templates
10 5 (1.54%) JSON Schema
11 4 (1.23%) GraphQL
11 4 (1.23%) Great Expectations
11 4 (1.23%) PyTorch
11 4 (1.23%) RESTful
11 4 (1.23%) Spark Streaming
11 4 (1.23%) Web Services
11 4 (1.23%) YAML
12 3 (0.92%) Middleware
Miscellaneous
1 24 (7.38%) Algorithms
2 18 (5.54%) Derivative
3 13 (4.00%) Data Structures
4 10 (3.08%) Distributed Systems
4 10 (3.08%) Greenfield Project
5 8 (2.46%) Management Information System
6 7 (2.15%) Self-Motivation
7 6 (1.85%) Hedge funds
8 5 (1.54%) Renewable Energy
9 4 (1.23%) Analytical Mindset
9 4 (1.23%) Distributed Computing
9 4 (1.23%) Security Posture
10 3 (0.92%) Cloud Native
10 3 (0.92%) Grid Computing
10 3 (0.92%) Legacy Systems
10 3 (0.92%) Life Science
10 3 (0.92%) Virtual Team
11 2 (0.62%) Credit Risk
11 2 (0.62%) Data Protection Act
11 2 (0.62%) Wiki
Operating Systems
1 12 (3.69%) Linux
2 2 (0.62%) Unix
3 1 (0.31%) VMS
3 1 (0.31%) Windows
3 1 (0.31%) Windows Server
Processes & Methodologies
1 138 (42.46%) ETL
2 113 (34.77%) Analytics
3 109 (33.54%) Data Modelling
4 92 (28.31%) Data Engineering
5 84 (25.85%) CI/CD
6 72 (22.15%) Problem-Solving
7 66 (20.31%) DevOps
8 65 (20.00%) Agile
9 63 (19.38%) Data Science
10 48 (14.77%) Data Integration
11 45 (13.85%) Machine Learning
12 43 (13.23%) Computer Science
13 41 (12.62%) Data Ingestion
14 39 (12.00%) Business Intelligence
15 35 (10.77%) Continuous Integration
16 33 (10.15%) Data Transformation
17 29 (8.92%) Test Automation
18 28 (8.62%) Data Analytics
18 28 (8.62%) Data Governance
19 25 (7.69%) Visualisation
Programming Languages
1 220 (67.69%) Python
2 195 (60.00%) SQL
3 39 (12.00%) Scala
4 38 (11.69%) Java
5 18 (5.54%) C++
6 13 (4.00%) JavaScript
7 12 (3.69%) Rust
8 10 (3.08%) C#
9 9 (2.77%) T-SQL
10 7 (2.15%) Bash
10 7 (2.15%) TypeScript
11 6 (1.85%) Bicep
11 6 (1.85%) Go
12 5 (1.54%) VBA
13 4 (1.23%) R
14 3 (0.92%) PowerShell
15 2 (0.62%) Data Analysis Expressions
15 2 (0.62%) Lua
15 2 (0.62%) Shell Script
15 2 (0.62%) VB
Qualifications
1 60 (18.46%) Security Cleared
2 59 (18.15%) SC Cleared
3 44 (13.54%) Degree
4 29 (8.92%) Computer Science Degree
5 12 (3.69%) Master's Degree
6 9 (2.77%) Azure Certification
7 6 (1.85%) CISSP
8 4 (1.23%) AWS Certification
9 3 (0.92%) CISA
9 3 (0.92%) CRISC
9 3 (0.92%) Microsoft Certification
10 2 (0.62%) BPSS Clearance
10 2 (0.62%) Numerate Degree
11 1 (0.31%) (ISC)2 CCSP
11 1 (0.31%) AWS Certified Solutions Architect
11 1 (0.31%) Cisco Certification
11 1 (0.31%) CSSLP
11 1 (0.31%) DV Cleared
11 1 (0.31%) PhD
11 1 (0.31%) SnowPro
Quality Assurance & Compliance
1 64 (19.69%) Data Quality
2 5 (1.54%) QA
3 4 (1.23%) Accessibility
4 3 (0.92%) GDPR
5 1 (0.31%) NIST
System Software
1 24 (7.38%) Docker
2 3 (0.92%) HDFS
3 1 (0.31%) Active Directory
3 1 (0.31%) Virtual Machines
Systems Management
1 32 (9.85%) Terraform
2 20 (6.15%) Kubernetes
3 5 (1.54%) Ansible
4 4 (1.23%) Argo
5 1 (0.31%) Kubeflow
5 1 (0.31%) Microsoft Intune
5 1 (0.31%) Progress Chef
Vendors
1 82 (25.23%) Databricks
2 26 (8.00%) Microsoft
3 18 (5.54%) Google
4 12 (3.69%) Oracle
5 7 (2.15%) Informatica
5 7 (2.15%) Palantir
6 6 (1.85%) Foundry
7 4 (1.23%) IBM
8 3 (0.92%) Alteryx
8 3 (0.92%) Cloudera
8 3 (0.92%) Salesforce
8 3 (0.92%) SAP
8 3 (0.92%) Splunk
8 3 (0.92%) TIBCO
9 2 (0.62%) Ab Initio
9 2 (0.62%) Dataiku
9 2 (0.62%) Dynatrace
9 2 (0.62%) OpenAI
9 2 (0.62%) SnapLogic
9 2 (0.62%) Workday