Data Ingestion Jobs

Data Ingestion
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Ingestion over the 6 months to 6 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
6 Jun 2024
Same period 2023 Same period 2022
Rank 761 560 786
Rank change year-on-year -201 +226 -82
Permanent jobs citing Data Ingestion 143 437 534
As % of all permanent jobs advertised in the UK 0.13% 0.47% 0.31%
As % of the Processes & Methodologies category 0.16% 0.49% 0.33%
Number of salaries quoted 98 160 185
10th Percentile £52,500 £51,250 £47,500
25th Percentile £62,000 £65,000 £62,500
Median annual salary (50th Percentile) £75,000 £80,000 £72,500
Median % change year-on-year -6.25% +10.34% +16.00%
75th Percentile £86,250 £111,250 £80,000
90th Percentile £105,000 £140,000 £95,000
UK excluding London median annual salary £65,000 £70,000 £75,000
% change year-on-year -7.14% -6.67% +30.43%

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 89,168 89,599 164,158
As % of all permanent jobs advertised in the UK 83.34% 95.45% 95.91%
Number of salaries quoted 61,788 54,096 83,725
10th Percentile £29,500 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £60,800 £60,000
Median % change year-on-year -9.54% +1.33% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Salary Trend

3-month moving average salary quoted in jobs citing Data Ingestion.

Salary trend for Data Ingestion in the UK

Data Ingestion
Salary Histogram

Salary distribution for jobs citing Data Ingestion over the 6 months to 6 June 2024.

Salary histogram for Data Ingestion in the UK

Data Ingestion
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 6 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -235 105 £75,000 -9.09% 59
UK excluding London -17 92 £65,000 -7.14% 26
Work from Home +39 59 £70,750 -5.79% 25
London -166 46 £80,000 -20.00% 29
Scotland - 34 £75,000 - 1
North of England +28 20 £71,500 +10.00% 9
Midlands -11 16 £65,000 +85.71% 3
West Midlands -19 15 £65,000 +62.50% 2
North East - 15 £77,000 - 1
South West -27 11 £55,000 -26.67% 3
South East -25 7 £57,500 -23.33% 8
East of England -13 4 £75,000 - 1
North West -17 4 £70,250 +8.08% 7
East Midlands -27 1 - - 1
Yorkshire - 1 £55,000 - 1

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (13.29%) Apache Airflow
2 6 (4.20%) Apache
3 4 (2.80%) Apache Spark
4 3 (2.10%) Luigi
Applications
1 6 (4.20%) Microsoft Excel
2 1 (0.70%) Microsoft PowerPoint
2 1 (0.70%) MS Visio
Cloud Services
1 55 (38.46%) AWS
2 48 (33.57%) Azure
3 32 (22.38%) GCP
4 27 (18.88%) SaaS
5 25 (17.48%) Snowflake
6 24 (16.78%) dbt
7 21 (14.69%) Power Platform
8 16 (11.19%) Amazon Kinesis
9 11 (7.69%) Amazon S3
9 11 (7.69%) Azure Data Factory
10 8 (5.59%) GitHub
11 7 (4.90%) Boomi
12 6 (4.20%) PaaS
13 5 (3.50%) IaaS
13 5 (3.50%) Prefect
14 4 (2.80%) AWS Lambda
14 4 (2.80%) Azure DevOps
14 4 (2.80%) Serverless
15 2 (1.40%) Amazon EKS
15 2 (1.40%) AWS CloudFormation
Communications & Networking
1 8 (5.59%) Firewall
2 5 (3.50%) Intrusion Detection
2 5 (3.50%) Network Security
3 1 (0.70%) PPP
Database & Business Intelligence
1 36 (25.17%) Data Warehouse
2 24 (16.78%) Data Lake
3 23 (16.08%) Amazon Redshift
4 21 (14.69%) Power BI
5 19 (13.29%) BigQuery
5 19 (13.29%) SQL Server
6 17 (11.89%) PostgreSQL
7 12 (8.39%) Data Mining
8 10 (6.99%) Looker
8 10 (6.99%) Tableau
9 9 (6.29%) Azure SQL Database
10 7 (4.90%) NoSQL
11 5 (3.50%) Big Data
11 5 (3.50%) SQL Server Integration Services
12 4 (2.80%) Redis
13 3 (2.10%) Bigtable
13 3 (2.10%) CouchDB
13 3 (2.10%) Elasticsearch
13 3 (2.10%) MySQL
13 3 (2.10%) Relational Database
Development Applications
1 9 (6.29%) Git
2 2 (1.40%) ERwin
2 2 (1.40%) Jenkins
2 2 (1.40%) TeamCity
3 1 (0.70%) ER Studio
3 1 (0.70%) Toad
General
1 56 (39.16%) Social Skills
2 42 (29.37%) Finance
3 35 (24.48%) Inclusion and Diversity
4 29 (20.28%) Marketing
5 28 (19.58%) Law
6 24 (16.78%) Games
7 15 (10.49%) Analytical Skills
8 4 (2.80%) Agriculture
8 4 (2.80%) Banking
9 3 (2.10%) Retail
10 2 (1.40%) Automotive
11 1 (0.70%) Presentation Skills
Job Titles
1 70 (48.95%) Data Engineer
2 25 (17.48%) Lead
3 24 (16.78%) Software Engineering Director
4 17 (11.89%) Lead Data Engineer
5 16 (11.19%) Senior
6 15 (10.49%) AWS Data Engineer
6 15 (10.49%) AWS Engineer
6 15 (10.49%) Principal Engineer
7 12 (8.39%) Principal Data Engineer
8 9 (6.29%) Architect
8 9 (6.29%) Python Data Engineer
8 9 (6.29%) Python Engineer
8 9 (6.29%) Senior Data Engineer
9 8 (5.59%) Developer
10 7 (4.90%) Data Integration Engineer
10 7 (4.90%) Integration Engineer
10 7 (4.90%) Team Leader
11 6 (4.20%) Azure Engineer
11 6 (4.20%) Data Scientist
11 6 (4.20%) Software Engineer
Libraries, Frameworks & Software Standards
1 10 (6.99%) GraphQL
2 9 (6.29%) RESTful
3 7 (4.90%) PySpark
4 4 (2.80%) Kafka
4 4 (2.80%) Pandas
5 3 (2.10%) SQLAlchemy
6 2 (1.40%) .NET
6 2 (1.40%) React
7 1 (0.70%) LAMP
7 1 (0.70%) Micronaut
7 1 (0.70%) Node.js
7 1 (0.70%) Unreal Engine
7 1 (0.70%) YAML
Miscellaneous
1 24 (16.78%) Cloud Native
2 17 (11.89%) Client/Server
3 15 (10.49%) Data Structures
4 13 (9.09%) Online Games
5 10 (6.99%) Self-Motivation
6 6 (4.20%) Reinsurance
7 5 (3.50%) Legacy Systems
7 5 (3.50%) Management Information System
8 4 (2.80%) Product Ownership
9 2 (1.40%) Data Centre
9 2 (1.40%) Video Conferencing
10 1 (0.70%) Cyber Threat
10 1 (0.70%) Enterprise Software
10 1 (0.70%) Greenfield Project
10 1 (0.70%) Linked Data
10 1 (0.70%) Public Cloud
10 1 (0.70%) Renewable Energy
10 1 (0.70%) Security Operations Centre
10 1 (0.70%) Security Posture
10 1 (0.70%) Virtual Team
Operating Systems
1 1 (0.70%) Linux
1 1 (0.70%) Windows
Processes & Methodologies
1 78 (54.55%) Agile
2 77 (53.85%) ETL
3 57 (39.86%) Data Modelling
4 51 (35.66%) Data Pipeline
5 44 (30.77%) Computer Science
6 41 (28.67%) Problem-Solving
7 40 (27.97%) Data Engineering
7 40 (27.97%) Decision-Making
8 39 (27.27%) Machine Learning
9 33 (23.08%) Data-Driven Decision Making
10 32 (22.38%) Software Engineering
10 32 (22.38%) Visualisation
11 31 (21.68%) Mathematics
12 30 (20.98%) Data Transformation
12 30 (20.98%) Natural Language Processing
13 29 (20.28%) Data Integration
14 28 (19.58%) Artificial Intelligence
14 28 (19.58%) Data Science
14 28 (19.58%) Mentoring
15 26 (18.18%) Business Intelligence
Programming Languages
1 85 (59.44%) Python
2 79 (55.24%) SQL
3 20 (13.99%) Java
4 15 (10.49%) Scala
5 6 (4.20%) C#
6 5 (3.50%) PowerShell
7 1 (0.70%) Bicep
7 1 (0.70%) TypeScript
Qualifications
1 28 (19.58%) Degree
2 14 (9.79%) Computer Science Degree
3 5 (3.50%) CISM
3 5 (3.50%) CISSP
4 3 (2.10%) DBS Check
5 2 (1.40%) Master's Degree
5 2 (1.40%) SnowPro
Quality Assurance & Compliance
1 42 (29.37%) Data Quality
2 3 (2.10%) PSD2
3 2 (1.40%) QA
System Software
1 5 (3.50%) Docker
2 1 (0.70%) Active Directory
2 1 (0.70%) HDFS
2 1 (0.70%) Virtual Desktop
Systems Management
1 9 (6.29%) Terraform
2 3 (2.10%) Kubernetes
3 1 (0.70%) Microsoft Intune
Vendors
1 17 (11.89%) Databricks
1 17 (11.89%) Google
2 13 (9.09%) Microsoft
3 7 (4.90%) MuleSoft
4 6 (4.20%) Splunk
5 5 (3.50%) ServiceNow
6 2 (1.40%) Confluent
6 2 (1.40%) Oracle
7 1 (0.70%) Brio
7 1 (0.70%) Cloudera
7 1 (0.70%) Commvault
7 1 (0.70%) Informatica