Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 136 217 238
Rank change year-on-year +81 +21 -42
Contract jobs citing Data Pipeline 315 309 488
As % of all contract jobs advertised in London 1.80% 1.19% 1.25%
As % of the Processes & Methodologies category 2.03% 1.31% 1.36%
Number of daily rates quoted 241 209 344
10th Percentile £400 £450 £464
25th Percentile £463 £500 £525
Median daily rate (50th Percentile) £575 £565 £625
Median % change year-on-year +1.77% -9.60% +13.64%
75th Percentile £675 £688 £738
90th Percentile £750 £775 £825
England median daily rate £550 £550 £600
% change year-on-year - -8.33% +9.09%
Number of hourly rates quoted 1 4 6
10th Percentile - - £27.00
25th Percentile £46.75 £65.00 £28.56
Median hourly rate £48.50 £72.50 £33.75
Median % change year-on-year -33.10% +114.81% -24.16%
75th Percentile £50.25 £84.38 £68.25
90th Percentile - £87.75 £84.83
England median hourly rate £62.50 £70.25 £33.75
% change year-on-year -11.03% +108.15% -17.68%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,484 23,644 35,916
As % of all contract IT jobs advertised in London 88.60% 90.88% 92.26%
Number of daily rates quoted 11,107 17,068 26,253
10th Percentile £340 £375 £388
25th Percentile £450 £475 £475
Median daily rate (50th Percentile) £550 £593 £575
Median % change year-on-year -7.17% +3.04% +9.52%
75th Percentile £681 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £540
% change year-on-year -4.55% +1.85% +8.00%
Number of hourly rates quoted 308 267 420
10th Percentile £15.81 £18.30 £17.24
25th Percentile £20.00 £22.45 £23.91
Median hourly rate £27.92 £37.34 £36.41
Median % change year-on-year -25.23% +2.55% +13.78%
75th Percentile £48.75 £63.88 £51.00
90th Percentile £66.83 £82.50 £67.56
England median hourly rate £36.50 £36.54 £25.00
% change year-on-year -0.11% +46.16% +8.70%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 20 May 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 20 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +39 49 £563 -1.32% 15
South London - 6 £450 - 1
West London +10 3 £525 -8.70% 1
East London -2 1 £750 +50.00% 46
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 54 (17.14%) Apache Spark
2 41 (13.02%) Apache
3 35 (11.11%) Apache Airflow
4 4 (1.27%) Luigi
5 3 (0.95%) SharePoint
6 2 (0.63%) Confluence
7 1 (0.32%) ArcGIS
Applications
1 7 (2.22%) Microsoft Excel
2 2 (0.63%) Microsoft Office
Business Applications
1 2 (0.63%) Dynamics CRM
Cloud Services
1 144 (45.71%) Azure
2 143 (45.40%) AWS
3 54 (17.14%) Serverless
4 43 (13.65%) AWS Lambda
5 42 (13.33%) GCP
6 41 (13.02%) Azure Data Factory
7 38 (12.06%) Amazon S3
8 27 (8.57%) Azure Synapse Analytics
9 24 (7.62%) Amazon Kinesis
10 23 (7.30%) Azure DevOps
11 20 (6.35%) Power Platform
12 19 (6.03%) GitHub
12 19 (6.03%) Snowflake
13 17 (5.40%) Amazon EC2
13 17 (5.40%) Amazon EMR
13 17 (5.40%) AWS Step Functions
14 14 (4.44%) dbt
15 12 (3.81%) Amazon MSK
15 12 (3.81%) Azure Logic Apps
16 8 (2.54%) Dagster
Communications & Networking
1 1 (0.32%) Firewall
Database & Business Intelligence
1 90 (28.57%) Data Warehouse
2 70 (22.22%) Big Data
3 59 (18.73%) Data Lake
4 35 (11.11%) NoSQL
5 32 (10.16%) Amazon Redshift
6 23 (7.30%) Relational Database
7 22 (6.98%) Parquet
8 20 (6.35%) Power BI
9 19 (6.03%) BigQuery
10 17 (5.40%) Azure SQL Database
11 16 (5.08%) DynamoDB
11 16 (5.08%) Flink
12 15 (4.76%) SQL Server
13 13 (4.13%) Amazon RDS
14 11 (3.49%) Delta Lake
15 10 (3.17%) Amazon Athena
16 9 (2.86%) PostgreSQL
17 8 (2.54%) Tableau
18 6 (1.90%) Metadata
18 6 (1.90%) Spark SQL
Development Applications
1 28 (8.89%) Git
2 8 (2.54%) Jenkins
2 8 (2.54%) JIRA
3 7 (2.22%) GitLab
4 6 (1.90%) MLflow
5 4 (1.27%) Deequ
6 2 (0.63%) Bugzilla
6 2 (0.63%) ER Studio
6 2 (0.63%) ERwin
6 2 (0.63%) JMeter
6 2 (0.63%) JUnit
6 2 (0.63%) Selenium
6 2 (0.63%) TestNG
6 2 (0.63%) TestRail
6 2 (0.63%) Travis CI
7 1 (0.32%) GoCD
7 1 (0.32%) kappa
7 1 (0.32%) Poetry
7 1 (0.32%) webpack
General
1 83 (26.35%) Social Skills
2 57 (18.10%) Finance
3 48 (15.24%) Analytical Skills
4 22 (6.98%) Public Sector
5 18 (5.71%) Banking
6 14 (4.44%) Front Office
7 11 (3.49%) Presentation Skills
8 6 (1.90%) Investment Banking
9 4 (1.27%) Inclusion and Diversity
9 4 (1.27%) Retail
10 3 (0.95%) Marketing
11 2 (0.63%) Czech Language
11 2 (0.63%) Financial Institution
11 2 (0.63%) Influencing Skills
11 2 (0.63%) Pharmaceutical
12 1 (0.32%) Games
12 1 (0.32%) Local Government
12 1 (0.32%) Organisational Skills
Job Titles
1 168 (53.33%) Data Engineer
2 54 (17.14%) Senior
3 41 (13.02%) Developer
4 40 (12.70%) Azure Engineer
5 39 (12.38%) Azure Data Engineer
6 31 (9.84%) Architect
7 29 (9.21%) Senior Data Engineer
8 26 (8.25%) AWS Engineer
9 21 (6.67%) AWS Data Engineer
9 21 (6.67%) Lead
10 17 (5.40%) Data Scientist
11 15 (4.76%) Lead Data Engineer
12 14 (4.44%) Python Developer
13 13 (4.13%) Analyst
13 13 (4.13%) Data Architect
14 11 (3.49%) Senior Developer
15 10 (3.17%) Python Engineer
15 10 (3.17%) Quantitative Developer
16 8 (2.54%) Data Analyst
16 8 (2.54%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 49 (15.56%) Kafka
2 48 (15.24%) PySpark
3 29 (9.21%) Pandas
4 19 (6.03%) Apache Avro
4 19 (6.03%) JSON
5 18 (5.71%) NumPy
6 13 (4.13%) SciPy
7 10 (3.17%) scikit-learn
8 8 (2.54%) TensorFlow
9 7 (2.22%) REST
10 5 (1.59%) ARM Templates
10 5 (1.59%) Great Expectations
10 5 (1.59%) JSON Schema
11 4 (1.27%) GraphQL
11 4 (1.27%) RESTful
11 4 (1.27%) Spark Streaming
11 4 (1.27%) Web Services
11 4 (1.27%) YAML
12 3 (0.95%) .NET
12 3 (0.95%) SOAP
Miscellaneous
1 23 (7.30%) Algorithms
2 18 (5.71%) Derivative
3 13 (4.13%) Data Structures
4 10 (3.17%) Distributed Systems
4 10 (3.17%) Greenfield Project
5 8 (2.54%) Management Information System
6 6 (1.90%) Hedge funds
7 5 (1.59%) Analytical Mindset
7 5 (1.59%) Renewable Energy
7 5 (1.59%) Self-Motivation
8 4 (1.27%) Cloud Native
8 4 (1.27%) Distributed Computing
8 4 (1.27%) Legacy Systems
8 4 (1.27%) Security Posture
9 3 (0.95%) Grid Computing
9 3 (0.95%) Virtual Team
10 2 (0.63%) Credit Risk
10 2 (0.63%) Life Science
10 2 (0.63%) Linux Command Line
10 2 (0.63%) Wiki
Operating Systems
1 13 (4.13%) Linux
2 2 (0.63%) Unix
3 1 (0.32%) Windows
3 1 (0.32%) Windows Server
Processes & Methodologies
1 135 (42.86%) ETL
2 105 (33.33%) Analytics
2 105 (33.33%) Data Modelling
3 86 (27.30%) Data Engineering
4 80 (25.40%) CI/CD
5 66 (20.95%) DevOps
6 63 (20.00%) Problem-Solving
7 62 (19.68%) Agile
8 54 (17.14%) Data Science
9 45 (14.29%) Data Integration
10 40 (12.70%) Machine Learning
11 39 (12.38%) Data Ingestion
12 37 (11.75%) Business Intelligence
13 35 (11.11%) Computer Science
14 34 (10.79%) Continuous Integration
15 32 (10.16%) Data Transformation
16 28 (8.89%) Test Automation
17 25 (7.94%) Visualisation
18 24 (7.62%) Infrastructure as Code
19 22 (6.98%) Data Analytics
Programming Languages
1 218 (69.21%) Python
2 194 (61.59%) SQL
3 40 (12.70%) Java
4 37 (11.75%) Scala
5 18 (5.71%) C++
6 13 (4.13%) JavaScript
7 12 (3.81%) Rust
8 11 (3.49%) C#
9 9 (2.86%) T-SQL
10 7 (2.22%) Bash
10 7 (2.22%) TypeScript
11 6 (1.90%) Bicep
12 5 (1.59%) VBA
13 4 (1.27%) Go
14 3 (0.95%) PowerShell
14 3 (0.95%) Shell Script
15 2 (0.63%) Lua
15 2 (0.63%) Perl
15 2 (0.63%) R
15 2 (0.63%) VB
Qualifications
1 63 (20.00%) Security Cleared
2 62 (19.68%) SC Cleared
3 36 (11.43%) Degree
4 25 (7.94%) Computer Science Degree
5 8 (2.54%) Azure Certification
6 6 (1.90%) CISSP
7 5 (1.59%) AWS Certification
7 5 (1.59%) Master's Degree
8 3 (0.95%) CISA
8 3 (0.95%) CRISC
8 3 (0.95%) Microsoft Certification
9 2 (0.63%) BPSS Clearance
10 1 (0.32%) (ISC)2 CCSP
10 1 (0.32%) AWS Certified Solutions Architect
10 1 (0.32%) Cisco Certification
10 1 (0.32%) CSSLP
10 1 (0.32%) DV Cleared
Quality Assurance & Compliance
1 56 (17.78%) Data Quality
2 5 (1.59%) QA
3 3 (0.95%) GDPR
4 2 (0.63%) Accessibility
5 1 (0.32%) NIST
System Software
1 18 (5.71%) Docker
2 3 (0.95%) HDFS
3 1 (0.32%) Virtual Machines
Systems Management
1 32 (10.16%) Terraform
2 15 (4.76%) Kubernetes
3 5 (1.59%) Ansible
4 4 (1.27%) Argo
5 1 (0.32%) Kubeflow
5 1 (0.32%) Progress Chef
Vendors
1 78 (24.76%) Databricks
2 23 (7.30%) Microsoft
3 16 (5.08%) Google
4 11 (3.49%) Oracle
5 7 (2.22%) Informatica
5 7 (2.22%) Palantir
6 6 (1.90%) Foundry
7 3 (0.95%) Alteryx
7 3 (0.95%) Cloudera
7 3 (0.95%) Splunk
7 3 (0.95%) TIBCO
8 2 (0.63%) Ab Initio
8 2 (0.63%) Dataiku
8 2 (0.63%) Dynatrace
8 2 (0.63%) IBM
8 2 (0.63%) OpenAI
8 2 (0.63%) SAP
8 2 (0.63%) Workday
9 1 (0.32%) DataRobot
9 1 (0.32%) SnapLogic