Data Ingestion Contracts

Data Ingestion
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Ingestion over the 6 months to 2 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
2 Jun 2024
Same period 2023 Same period 2022
Rank 421 544 563
Rank change year-on-year +123 +19 -127
Contract jobs citing Data Ingestion 158 140 284
As % of all contract jobs advertised in the UK 0.37% 0.25% 0.32%
As % of the Processes & Methodologies category 0.43% 0.28% 0.36%
Number of daily rates quoted 117 112 177
10th Percentile £400 £471 £461
25th Percentile £425 £510 £513
Median daily rate (50th Percentile) £525 £600 £600
Median % change year-on-year -12.50% - +9.09%
75th Percentile £613 £650 £750
90th Percentile £730 £738 £815
UK excluding London median daily rate £610 £600 £661
% change year-on-year +1.67% -9.19% +39.10%
Number of hourly rates quoted 1 2 0
10th Percentile - £78.75 -
25th Percentile £66.25 £80.63 -
Median hourly rate £67.50 £85.00 -
Median % change year-on-year -20.59% - -
75th Percentile £68.75 £88.13 -
90th Percentile - £89.25 -
UK excluding London median hourly rate £67.50 - -

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 36,816 50,571 79,556
As % of all contract IT jobs advertised in the UK 85.44% 89.70% 90.62%
Number of daily rates quoted 23,638 35,025 55,934
10th Percentile £300 £325 £348
25th Percentile £413 £438 £433
Median daily rate (50th Percentile) £525 £550 £538
Median % change year-on-year -4.55% +2.33% +7.50%
75th Percentile £638 £650 £644
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £488
% change year-on-year - +2.56% +8.33%
Number of hourly rates quoted 2,533 1,671 1,865
10th Percentile £12.75 £10.63 £12.50
25th Percentile £16.00 £15.57 £15.63
Median hourly rate £36.50 £36.00 £25.68
Median % change year-on-year +1.39% +40.19% +9.70%
75th Percentile £60.75 £65.00 £50.00
90th Percentile £72.50 £75.00 £65.00
UK excluding London median hourly rate £38.12 £35.00 £20.00
% change year-on-year +8.91% +75.00% -4.88%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Ingestion.

Daily rate trend for Data Ingestion in the UK

Data Ingestion
Daily Rate Histogram

Daily rate distribution for jobs citing Data Ingestion over the 6 months to 2 June 2024.

Daily rate histogram for Data Ingestion in the UK

Data Ingestion
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Ingestion.

Hourly rate trend for Data Ingestion in the UK

Data Ingestion
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 2 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +124 146 £523 -12.92% 53
London +143 118 £500 -13.04% 26
Work from Home +100 52 £525 -12.50% 22
UK excluding London +34 26 £610 +1.67% 26
North of England +40 18 £593 -5.20% 10
Yorkshire +28 9 £610 -2.40% 1
North West +20 9 £525 +16.67% 8
South East +10 3 £738 +34.09% 3
Scotland +39 2 - - 1
Midlands +22 2 £468 -25.20% 3
East Midlands +11 2 £468 -28.08% 1
South West +6 1 £533 -16.47% 5

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (6.33%) Apache Spark
2 7 (4.43%) Apache
3 6 (3.80%) Apache Airflow
4 2 (1.27%) ArcGIS
4 2 (1.27%) Confluence
5 1 (0.63%) Apache Pulsar
5 1 (0.63%) SharePoint
Applications
1 2 (1.27%) Microsoft Excel
2 1 (0.63%) Microsoft Office
2 1 (0.63%) Microsoft PowerPoint
2 1 (0.63%) Spreadsheet
Business Applications
1 11 (6.96%) Dynamics CRM
2 1 (0.63%) Adobe Campaign
2 1 (0.63%) Unica
Cloud Services
1 51 (32.28%) AWS
2 46 (29.11%) GCP
3 43 (27.22%) Azure
4 30 (18.99%) Serverless
5 26 (16.46%) AWS Lambda
6 22 (13.92%) AWS Step Functions
7 21 (13.29%) dbt
8 20 (12.66%) Amazon MSK
9 17 (10.76%) Power Platform
10 16 (10.13%) Amazon S3
11 11 (6.96%) Snowflake
12 9 (5.70%) Azure DevOps
13 7 (4.43%) Azure Data Factory
13 7 (4.43%) GitHub
14 6 (3.80%) Adobe Analytics
14 6 (3.80%) Azure Synapse Analytics
14 6 (3.80%) Cloud Computing
14 6 (3.80%) Google Analytics
14 6 (3.80%) Vertex AI
15 5 (3.16%) Cloud Run
Communications & Networking
1 1 (0.63%) Network Security
Database & Business Intelligence
1 51 (32.28%) Data Warehouse
2 27 (17.09%) Amazon Redshift
3 23 (14.56%) Big Data
4 21 (13.29%) DynamoDB
5 20 (12.66%) Amazon RDS
5 20 (12.66%) Data Lake
5 20 (12.66%) Parquet
6 19 (12.03%) BigQuery
7 17 (10.76%) Power BI
8 10 (6.33%) Tableau
9 7 (4.43%) Flink
9 7 (4.43%) Relational Database
10 6 (3.80%) Azure SQL Database
10 6 (3.80%) Looker
10 6 (3.80%) Metadata
10 6 (3.80%) NoSQL
10 6 (3.80%) SQL Server
11 5 (3.16%) OLAP
11 5 (3.16%) OLTP
11 5 (3.16%) RDBMS
Development Applications
1 11 (6.96%) MLflow
2 5 (3.16%) Git
2 5 (3.16%) Postman
3 3 (1.90%) ERwin
3 3 (1.90%) Jenkins
4 2 (1.27%) ER Studio
4 2 (1.27%) kappa
5 1 (0.63%) JIRA
5 1 (0.63%) NUnit
General
1 33 (20.89%) Social Skills
2 24 (15.19%) Analytical Skills
3 16 (10.13%) Public Sector
4 15 (9.49%) Finance
5 13 (8.23%) Banking
6 9 (5.70%) Retail
7 8 (5.06%) Marketing
8 6 (3.80%) Advertising
8 6 (3.80%) Front Office
8 6 (3.80%) Investment Banking
9 5 (3.16%) Documentation Skills
10 3 (1.90%) Financial Institution
10 3 (1.90%) Pharmaceutical
10 3 (1.90%) Presentation Skills
11 1 (0.63%) Law
11 1 (0.63%) Organisational Skills
Job Titles
1 59 (37.34%) Data Engineer
2 39 (24.68%) Developer
3 31 (19.62%) Senior
4 20 (12.66%) Architect
5 18 (11.39%) Data Architect
5 18 (11.39%) Senior Developer
6 11 (6.96%) Microsoft Developer
7 10 (6.33%) Consultant
7 10 (6.33%) Python Developer
8 8 (5.06%) Lead
8 8 (5.06%) Lead Data Engineer
9 7 (4.43%) Senior Microsoft Developer
10 6 (3.80%) Senior Data Engineer
11 5 (3.16%) Azure Architect
11 5 (3.16%) Azure Data Architect
11 5 (3.16%) Data Modeller
11 5 (3.16%) GCP Data Engineer
11 5 (3.16%) GCP Engineer
11 5 (3.16%) Machine Learning Engineer
11 5 (3.16%) Solutions Architect
Libraries, Frameworks & Software Standards
1 25 (15.82%) JSON
2 19 (12.03%) Apache Avro
3 16 (10.13%) Kafka
4 10 (6.33%) PySpark
5 7 (4.43%) FastAPI
6 6 (3.80%) CSS
6 6 (3.80%) Flask
6 6 (3.80%) HTML
6 6 (3.80%) jQuery
6 6 (3.80%) Node.js
7 5 (3.16%) DOM
7 5 (3.16%) NumPy
7 5 (3.16%) Pandas
7 5 (3.16%) React
7 5 (3.16%) scikit-learn
7 5 (3.16%) Swagger
7 5 (3.16%) TensorFlow
8 4 (2.53%) .NET
8 4 (2.53%) Apache NiFi
9 3 (1.90%) SOAP
Miscellaneous
1 7 (4.43%) Onboarding
2 6 (3.80%) Derivative
2 6 (3.80%) Marketing Technology
2 6 (3.80%) Product Ownership
3 5 (3.16%) Management Information System
4 4 (2.53%) Algorithms
4 4 (2.53%) Smart Meter
5 3 (1.90%) Data Centre
5 3 (1.90%) Distributed Computing
5 3 (1.90%) Insider Threat
5 3 (1.90%) Renewable Energy
6 2 (1.27%) Data Structures
6 2 (1.27%) Greenfield Project
7 1 (0.63%) Cloud Native
7 1 (0.63%) Cyber Threat
7 1 (0.63%) Mobile App
7 1 (0.63%) Security Operations Centre
7 1 (0.63%) Self-Motivation
Operating Systems
1 9 (5.70%) Unix
2 6 (3.80%) Linux
Processes & Methodologies
1 67 (42.41%) ETL
2 66 (41.77%) Data Modelling
3 59 (37.34%) Data Pipeline
4 44 (27.85%) Analytics
5 41 (25.95%) Agile
6 35 (22.15%) CI/CD
7 29 (18.35%) DevOps
7 29 (18.35%) Machine Learning
8 27 (17.09%) Data Governance
9 25 (15.82%) Data Engineering
10 24 (15.19%) Problem-Solving
11 22 (13.92%) Business Transformation
12 21 (13.29%) Data Integration
13 20 (12.66%) Visualisation
14 19 (12.03%) Data Science
15 18 (11.39%) Artificial Intelligence
15 18 (11.39%) Business Intelligence
15 18 (11.39%) Computer Science
15 18 (11.39%) Unit Testing
16 17 (10.76%) Data Analytics
Programming Languages
1 84 (53.16%) Python
2 60 (37.97%) SQL
3 17 (10.76%) JavaScript
4 14 (8.86%) Java
4 14 (8.86%) Scala
5 9 (5.70%) Go
5 9 (5.70%) TypeScript
6 5 (3.16%) C#
7 4 (2.53%) Perl
8 3 (1.90%) Bicep
8 3 (1.90%) Search Processing Language
8 3 (1.90%) Shell Script
8 3 (1.90%) T-SQL
9 2 (1.27%) Lua
9 2 (1.27%) PHP
9 2 (1.27%) PowerShell
Qualifications
1 38 (24.05%) Security Cleared
2 36 (22.78%) SC Cleared
3 22 (13.92%) Degree
4 15 (9.49%) Computer Science Degree
5 13 (8.23%) Master's Degree
6 2 (1.27%) BPSS Clearance
7 1 (0.63%) Azure Certification
7 1 (0.63%) PhD
7 1 (0.63%) Postgraduate
Quality Assurance & Compliance
1 38 (24.05%) Data Quality
2 16 (10.13%) QA
3 3 (1.90%) Accessibility
4 1 (0.63%) GDPR
4 1 (0.63%) NIST
System Software
1 7 (4.43%) Docker
2 1 (0.63%) Apache Flume
2 1 (0.63%) Virtual Machines
Systems Management
1 8 (5.06%) Kubernetes
2 5 (3.16%) Kubeflow
2 5 (3.16%) Terraform
3 1 (0.63%) Kibana
3 1 (0.63%) Matomo
Vendors
1 32 (20.25%) Google
2 22 (13.92%) Databricks
3 12 (7.59%) Microsoft
4 8 (5.06%) Adobe
5 6 (3.80%) Foundry
5 6 (3.80%) Monetate
5 6 (3.80%) Optimizely
5 6 (3.80%) Palantir
6 5 (3.16%) Ensighten
6 5 (3.16%) Omniture
6 5 (3.16%) Tealium
7 3 (1.90%) Splunk
8 2 (1.27%) Cloudera
8 2 (1.27%) ESRI
8 2 (1.27%) Informatica
8 2 (1.27%) Proofpoint
8 2 (1.27%) Workday
9 1 (0.63%) IBM
9 1 (0.63%) SAP
9 1 (0.63%) Talend