Data Ingestion Contracts

Data Ingestion
UK

The table below provides summary statistics for contract job vacancies requiring Data Ingestion skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Ingestion over the 6 months leading up to 12 June 2024, comparing them to the same period in the previous two years.

6 months to
12 Jun 2024
Same period 2023 Same period 2022
Rank 432 559 578
Rank change year-on-year +127 +19 -141
Contract jobs citing Data Ingestion 153 138 276
As % of all contract jobs advertised in the UK 0.35% 0.25% 0.32%
As % of the Processes & Methodologies category 0.41% 0.28% 0.35%
Number of daily rates quoted 112 112 174
10th Percentile £400 £471 £460
25th Percentile £413 £510 £513
Median daily rate (50th Percentile) £507 £600 £613
Median % change year-on-year -15.58% -2.04% +11.36%
75th Percentile £613 £650 £750
90th Percentile £741 £738 £800
UK excluding London median daily rate £580 £600 £675
% change year-on-year -3.33% -11.11% +42.11%
Number of hourly rates quoted 1 2 0
10th Percentile - £78.75 -
25th Percentile £66.25 £80.63 -
Median hourly rate £67.50 £85.00 -
Median % change year-on-year -20.59% - -
75th Percentile £68.75 £88.13 -
90th Percentile - £89.25 -
UK excluding London median hourly rate £67.50 - -

All Process and Methodology Skills
UK

Data Ingestion falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 37,178 49,770 79,013
As % of all contract IT jobs advertised in the UK 85.13% 89.61% 90.64%
Number of daily rates quoted 23,737 34,458 55,587
10th Percentile £300 £325 £350
25th Percentile £413 £438 £436
Median daily rate (50th Percentile) £525 £550 £538
Median % change year-on-year -4.55% +2.33% +7.50%
75th Percentile £638 £650 £650
90th Percentile £750 £750 £743
UK excluding London median daily rate £500 £500 £490
% change year-on-year - +2.04% +8.89%
Number of hourly rates quoted 2,579 1,678 1,852
10th Percentile £12.75 £10.96 £12.50
25th Percentile £16.00 £15.75 £15.90
Median hourly rate £37.00 £35.65 £26.00
Median % change year-on-year +3.79% +37.12% +13.04%
75th Percentile £61.28 £65.00 £50.15
90th Percentile £72.50 £75.00 £65.25
UK excluding London median hourly rate £38.12 £34.90 £21.00
% change year-on-year +9.23% +66.18% -

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Ingestion.

Daily rate trend for Data Ingestion in the UK

Data Ingestion
Daily Rate Histogram

Daily rate distribution for jobs citing Data Ingestion over the 6 months to 12 June 2024.

Daily rate histogram for Data Ingestion in the UK

Data Ingestion
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Ingestion.

Hourly rate trend for Data Ingestion in the UK

Data Ingestion
Top 13 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 12 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +111 141 £500 -16.67% 61
London +120 112 £500 -13.04% 28
Work from Home +102 48 £513 -14.58% 25
UK excluding London +16 27 £580 -3.33% 26
North of England +28 17 £610 -2.40% 11
North West +20 9 £525 +16.67% 9
Yorkshire +20 8 £610 -2.40% 1
South East +16 4 £738 +34.09% 6
Midlands +16 3 £450 -28.00% 4
Scotland +46 2 - - 1
East Midlands +8 2 £468 -28.08% 1
West Midlands +16 1 £450 -28.00% 3
South West -2 1 £533 -16.47% 2

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 11 (7.19%) Apache Spark
2 7 (4.58%) Apache
3 5 (3.27%) Apache Airflow
4 2 (1.31%) ArcGIS
4 2 (1.31%) Confluence
5 1 (0.65%) Apache Pulsar
5 1 (0.65%) SharePoint
Applications
1 1 (0.65%) Microsoft Excel
1 1 (0.65%) Microsoft Office
1 1 (0.65%) Microsoft PowerPoint
1 1 (0.65%) Spreadsheet
Business Applications
1 11 (7.19%) Dynamics CRM
2 1 (0.65%) Adobe Campaign
2 1 (0.65%) Unica
Cloud Services
1 50 (32.68%) AWS
2 44 (28.76%) Azure
3 41 (26.80%) GCP
4 29 (18.95%) Serverless
5 26 (16.99%) AWS Lambda
6 22 (14.38%) AWS Step Functions
7 20 (13.07%) Amazon MSK
8 18 (11.76%) Power Platform
9 17 (11.11%) dbt
10 16 (10.46%) Amazon S3
11 11 (7.19%) Snowflake
12 10 (6.54%) Azure DevOps
13 7 (4.58%) Azure Data Factory
13 7 (4.58%) GitHub
14 6 (3.92%) Adobe Analytics
14 6 (3.92%) Azure Synapse Analytics
14 6 (3.92%) Cloud Computing
14 6 (3.92%) Google Analytics
15 5 (3.27%) Azure Machine Learning
15 5 (3.27%) Vertex AI
Communications & Networking
1 1 (0.65%) Network Security
Database & Business Intelligence
1 47 (30.72%) Data Warehouse
2 27 (17.65%) Amazon Redshift
3 23 (15.03%) Big Data
4 21 (13.73%) DynamoDB
5 20 (13.07%) Amazon RDS
5 20 (13.07%) Data Lake
6 19 (12.42%) Parquet
7 18 (11.76%) Power BI
8 15 (9.80%) BigQuery
9 10 (6.54%) Tableau
10 7 (4.58%) Relational Database
11 6 (3.92%) Flink
11 6 (3.92%) Looker
11 6 (3.92%) Metadata
11 6 (3.92%) NoSQL
11 6 (3.92%) SQL Server
12 5 (3.27%) OLAP
12 5 (3.27%) OLTP
12 5 (3.27%) PostgreSQL
12 5 (3.27%) RDBMS
Development Applications
1 10 (6.54%) MLflow
2 5 (3.27%) Git
2 5 (3.27%) Postman
3 3 (1.96%) ERwin
3 3 (1.96%) Jenkins
4 2 (1.31%) ER Studio
4 2 (1.31%) kappa
5 1 (0.65%) JIRA
General
1 34 (22.22%) Social Skills
2 25 (16.34%) Analytical Skills
3 16 (10.46%) Public Sector
4 14 (9.15%) Finance
5 13 (8.50%) Banking
6 9 (5.88%) Retail
7 8 (5.23%) Marketing
8 6 (3.92%) Advertising
8 6 (3.92%) Front Office
8 6 (3.92%) Investment Banking
9 5 (3.27%) Documentation Skills
10 3 (1.96%) Financial Institution
10 3 (1.96%) Pharmaceutical
10 3 (1.96%) Presentation Skills
11 1 (0.65%) Law
11 1 (0.65%) Organisational Skills
Job Titles
1 61 (39.87%) Data Engineer
2 38 (24.84%) Developer
3 30 (19.61%) Senior
4 18 (11.76%) Senior Developer
5 16 (10.46%) Architect
6 14 (9.15%) Data Architect
7 11 (7.19%) Microsoft Developer
8 10 (6.54%) Consultant
9 9 (5.88%) Python Developer
10 8 (5.23%) Lead
10 8 (5.23%) Lead Data Engineer
11 7 (4.58%) Senior Microsoft Developer
12 6 (3.92%) Senior Data Engineer
13 5 (3.27%) Azure Architect
13 5 (3.27%) Azure Data Architect
13 5 (3.27%) Cloud Architect
13 5 (3.27%) Data Modeller
13 5 (3.27%) GCP Data Engineer
13 5 (3.27%) GCP Engineer
13 5 (3.27%) Solutions Architect
Libraries, Frameworks & Software Standards
1 24 (15.69%) JSON
2 19 (12.42%) Apache Avro
3 16 (10.46%) Kafka
4 10 (6.54%) PySpark
5 6 (3.92%) CSS
5 6 (3.92%) FastAPI
5 6 (3.92%) HTML
5 6 (3.92%) jQuery
5 6 (3.92%) Node.js
6 5 (3.27%) DOM
6 5 (3.27%) Flask
6 5 (3.27%) React
6 5 (3.27%) Swagger
7 4 (2.61%) .NET
7 4 (2.61%) Apache NiFi
7 4 (2.61%) NumPy
7 4 (2.61%) Pandas
7 4 (2.61%) scikit-learn
7 4 (2.61%) TensorFlow
8 3 (1.96%) SOAP
Miscellaneous
1 7 (4.58%) Onboarding
2 6 (3.92%) Derivative
2 6 (3.92%) Marketing Technology
3 5 (3.27%) Management Information System
3 5 (3.27%) Product Ownership
4 4 (2.61%) Algorithms
4 4 (2.61%) Smart Meter
5 3 (1.96%) Data Centre
5 3 (1.96%) Distributed Computing
5 3 (1.96%) Insider Threat
5 3 (1.96%) Renewable Energy
6 2 (1.31%) Data Structures
6 2 (1.31%) Greenfield Project
7 1 (0.65%) Cyber Threat
7 1 (0.65%) Mobile App
7 1 (0.65%) Security Operations Centre
7 1 (0.65%) Self-Motivation
Operating Systems
1 9 (5.88%) Unix
2 6 (3.92%) Linux
Processes & Methodologies
1 63 (41.18%) Data Modelling
1 63 (41.18%) ETL
2 60 (39.22%) Data Pipeline
3 44 (28.76%) Analytics
4 42 (27.45%) Agile
5 33 (21.57%) CI/CD
6 29 (18.95%) DevOps
7 28 (18.30%) Machine Learning
8 26 (16.99%) Data Governance
9 24 (15.69%) Data Engineering
9 24 (15.69%) Problem-Solving
10 22 (14.38%) Business Transformation
11 21 (13.73%) Data Integration
11 21 (13.73%) Visualisation
12 19 (12.42%) Business Intelligence
13 18 (11.76%) Computer Science
13 18 (11.76%) Data Science
13 18 (11.76%) Unit Testing
14 17 (11.11%) Artificial Intelligence
14 17 (11.11%) Data Analytics
Programming Languages
1 82 (53.59%) Python
2 60 (39.22%) SQL
3 17 (11.11%) JavaScript
4 14 (9.15%) Java
4 14 (9.15%) Scala
5 9 (5.88%) Go
5 9 (5.88%) TypeScript
6 5 (3.27%) C#
7 4 (2.61%) Perl
8 3 (1.96%) Bicep
8 3 (1.96%) Search Processing Language
8 3 (1.96%) Shell Script
8 3 (1.96%) T-SQL
9 2 (1.31%) Lua
9 2 (1.31%) PHP
10 1 (0.65%) PowerShell
Qualifications
1 38 (24.84%) Security Cleared
2 36 (23.53%) SC Cleared
3 22 (14.38%) Degree
4 15 (9.80%) Computer Science Degree
5 13 (8.50%) Master's Degree
6 2 (1.31%) BPSS Clearance
7 1 (0.65%) Azure Certification
7 1 (0.65%) PhD
7 1 (0.65%) Postgraduate
Quality Assurance & Compliance
1 34 (22.22%) Data Quality
2 15 (9.80%) QA
3 3 (1.96%) Accessibility
4 1 (0.65%) GDPR
4 1 (0.65%) NIST
System Software
1 6 (3.92%) Docker
2 1 (0.65%) Apache Flume
2 1 (0.65%) Virtual Machines
Systems Management
1 7 (4.58%) Kubernetes
2 5 (3.27%) Terraform
3 4 (2.61%) Kubeflow
4 1 (0.65%) Kibana
4 1 (0.65%) Matomo
Vendors
1 28 (18.30%) Google
2 23 (15.03%) Databricks
3 10 (6.54%) Microsoft
4 8 (5.23%) Adobe
5 6 (3.92%) Foundry
5 6 (3.92%) Monetate
5 6 (3.92%) Optimizely
5 6 (3.92%) Palantir
6 5 (3.27%) Ensighten
6 5 (3.27%) Omniture
6 5 (3.27%) Tealium
7 3 (1.96%) Splunk
8 2 (1.31%) Cloudera
8 2 (1.31%) ESRI
8 2 (1.31%) Informatica
8 2 (1.31%) Proofpoint
8 2 (1.31%) Workday
9 1 (0.65%) IBM
9 1 (0.65%) SAP
9 1 (0.65%) Talend