Data Pipeline Jobs with Work from Home Options

Data Pipelines
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 9 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 Jun 2024
Same period 2023 Same period 2022
Rank 211 228 186
Rank change year-on-year +17 -42 +92
Permanent jobs citing Data Pipeline 541 570 1,646
As % of all permanent jobs with a WFH option 1.53% 1.51% 2.18%
As % of the Processes & Methodologies category 1.71% 1.57% 2.24%
Number of salaries quoted 358 378 616
10th Percentile £35,000 £47,000 £50,000
25th Percentile £46,306 £56,052 £61,250
Median annual salary (50th Percentile) £67,500 £68,823 £80,000
Median % change year-on-year -1.92% -13.97% +18.08%
75th Percentile £87,500 £85,938 £87,500
90th Percentile £107,500 £97,875 £100,000
UK median annual salary £67,500 £70,000 £75,000
% change year-on-year -3.57% -6.67% +11.11%

All Process and Methodology Skills
Work from Home

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 31,654 36,235 73,335
As % of all permanent jobs with a WFH option 89.73% 96.01% 97.14%
Number of salaries quoted 23,643 25,788 42,106
10th Percentile £33,750 £37,500 £36,250
25th Percentile £42,500 £47,500 £46,250
Median annual salary (50th Percentile) £57,500 £62,500 £60,000
Median % change year-on-year -8.00% +4.17% +9.09%
75th Percentile £75,000 £82,500 £80,000
90th Percentile £95,000 £100,000 £95,000
UK median annual salary £55,000 £60,800 £60,000
% change year-on-year -9.54% +1.33% +9.09%

Data Pipeline
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Pipeline as a proportion of all IT jobs advertised.

Data Pipeline trend for jobs with a WFH option

Data Pipeline
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline salary trend for jobs with a WFH option

Data Pipeline
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 9 June 2024.

Data Pipeline salary histogram for jobs with a WFH option

Data Pipeline
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 70 (12.94%) Apache Spark
2 34 (6.28%) Apache
2 34 (6.28%) Apache Airflow
3 4 (0.74%) Confluence
4 3 (0.55%) Luigi
5 2 (0.37%) SharePoint
Applications
1 10 (1.85%) Microsoft Excel
Business Applications
1 4 (0.74%) Primavera
2 1 (0.18%) Salesforce CRM
2 1 (0.18%) SAP S/4HANA
2 1 (0.18%) Shopify
Cloud Services
1 269 (49.72%) AWS
2 225 (41.59%) Azure
3 96 (17.74%) Power Platform
4 94 (17.38%) Snowflake
5 79 (14.60%) Azure Data Factory
6 78 (14.42%) GCP
7 48 (8.87%) Azure Synapse Analytics
7 48 (8.87%) Matillion
8 33 (6.10%) Serverless
9 31 (5.73%) dbt
10 30 (5.55%) Azure Cosmos DB
11 25 (4.62%) Amazon S3
12 15 (2.77%) Azure DevOps
13 10 (1.85%) Amazon EMR
13 10 (1.85%) GitHub
14 9 (1.66%) AWS Lambda
14 9 (1.66%) PowerApps
14 9 (1.66%) Prefect
14 9 (1.66%) SaaS
15 8 (1.48%) Cloud Computing
Communications & Networking
1 3 (0.55%) Firewall
2 2 (0.37%) Network Security
2 2 (0.37%) VPN
Database & Business Intelligence
1 174 (32.16%) Data Warehouse
2 157 (29.02%) Tableau
3 140 (25.88%) Data Lake
4 96 (17.74%) Power BI
5 91 (16.82%) SQL Server
6 53 (9.80%) Big Data
7 47 (8.69%) NoSQL
8 35 (6.47%) PostgreSQL
9 34 (6.28%) BigQuery
9 34 (6.28%) Elasticsearch
10 33 (6.10%) Metadata
11 32 (5.91%) Star Schema
12 28 (5.18%) SQL Server Integration Services
13 26 (4.81%) Relational Database
14 23 (4.25%) Amazon Redshift
15 19 (3.51%) Hadoop
16 18 (3.33%) Azure SQL Database
16 18 (3.33%) Enterprise Data Warehouse
17 17 (3.14%) Delta Lake
18 15 (2.77%) Amazon Athena
Development Applications
1 162 (29.94%) Git
2 37 (6.84%) GitLab
3 18 (3.33%) Jenkins
4 6 (1.11%) JIRA
4 6 (1.11%) Oracle Forms
4 6 (1.11%) Spinnaker
5 5 (0.92%) GDB
6 4 (0.74%) Bitbucket
7 3 (0.55%) Octopus Deploy
8 2 (0.37%) CircleCI
8 2 (0.37%) Visual Studio
9 1 (0.18%) Mockito
General
1 250 (46.21%) Social Skills
2 214 (39.56%) Analytical Skills
3 146 (26.99%) Retail
4 138 (25.51%) Presentation Skills
5 92 (17.01%) Finance
6 34 (6.28%) Banking
7 14 (2.59%) Billing
7 14 (2.59%) Games
8 11 (2.03%) Inclusion and Diversity
9 10 (1.85%) Back Office
9 10 (1.85%) Telecoms
10 9 (1.66%) Influencing Skills
11 8 (1.48%) Public Sector
12 7 (1.29%) Marketing
13 4 (0.74%) Agriculture
13 4 (0.74%) Music Industry
13 4 (0.74%) Wearables
14 3 (0.55%) Advertising
14 3 (0.55%) Law
14 3 (0.55%) Legal
Job Titles
1 222 (41.04%) Data Engineer
2 210 (38.82%) Senior
3 145 (26.80%) Analyst
4 142 (26.25%) Data Analyst
5 103 (19.04%) Senior Analyst
5 103 (19.04%) Senior Data Analyst
6 75 (13.86%) Senior Data Engineer
7 73 (13.49%) Lead
8 42 (7.76%) Developer
9 33 (6.10%) Architect
10 32 (5.91%) Lead Data Analyst
11 29 (5.36%) Data Architect
12 28 (5.18%) Data Manager
12 28 (5.18%) Engineering Manager
12 28 (5.18%) Lead Data Engineer
13 27 (4.99%) Python Engineer
14 26 (4.81%) Python Data Engineer
15 19 (3.51%) Azure Engineer
15 19 (3.51%) Data Scientist
16 18 (3.33%) Business Intelligence Manager
Libraries, Frameworks & Software Standards
1 38 (7.02%) PySpark
2 32 (5.91%) Kafka
3 26 (4.81%) Pandas
4 13 (2.40%) Apache Beam
5 12 (2.22%) XGBoost
6 10 (1.85%) React
7 6 (1.11%) .NET
7 6 (1.11%) Flask
7 6 (1.11%) Spring
8 5 (0.92%) Django
8 5 (0.92%) FastAPI
8 5 (0.92%) Web Services
9 4 (0.74%) .NET Core
9 4 (0.74%) ASP.NET Core
9 4 (0.74%) Entity Framework
9 4 (0.74%) JSON
9 4 (0.74%) REST
9 4 (0.74%) RESTful
9 4 (0.74%) Spring MVC
9 4 (0.74%) XML
Miscellaneous
1 70 (12.94%) Data Structures
2 37 (6.84%) Self-Motivation
3 19 (3.51%) Cloud Native
4 15 (2.77%) Algorithms
5 11 (2.03%) Enterprise Software
5 11 (2.03%) IoT
5 11 (2.03%) Management Information System
6 9 (1.66%) Client/Server
7 8 (1.48%) Renewable Energy
8 6 (1.11%) Onboarding
8 6 (1.11%) Product Ownership
8 6 (1.11%) Reinsurance
9 4 (0.74%) Credit Risk
9 4 (0.74%) Distributed Computing
9 4 (0.74%) PMI
10 3 (0.55%) Analytical Mindset
10 3 (0.55%) Driving Licence
10 3 (0.55%) Team-Oriented Environment
10 3 (0.55%) Video Conferencing
11 2 (0.37%) Blockchain
Operating Systems
1 21 (3.88%) Linux
2 11 (2.03%) Unix
3 1 (0.18%) Windows
Processes & Methodologies
1 304 (56.19%) Analytics
2 215 (39.74%) Problem-Solving
3 202 (37.34%) Visualisation
4 200 (36.97%) Data Engineering
5 195 (36.04%) ETL
6 183 (33.83%) Data Analysis
7 156 (28.84%) Data Modelling
8 148 (27.36%) Mathematics
9 143 (26.43%) Agile
10 141 (26.06%) Statistics
11 138 (25.51%) Actionable Insight
12 136 (25.14%) Storytelling
13 132 (24.40%) Data Science
14 128 (23.66%) Customer Intelligence
14 128 (23.66%) Root Cause Analysis
15 127 (23.48%) Business Strategy
16 126 (23.29%) Stakeholder Engagement
17 113 (20.89%) Business Intelligence
18 110 (20.33%) CI/CD
19 102 (18.85%) Machine Learning
Programming Languages
1 424 (78.37%) SQL
2 378 (69.87%) Python
3 60 (11.09%) Java
4 31 (5.73%) Scala
4 31 (5.73%) T-SQL
5 20 (3.70%) Kotlin
6 16 (2.96%) C#
7 15 (2.77%) Go
8 10 (1.85%) Clojure
8 10 (1.85%) TypeScript
9 5 (0.92%) JavaScript
10 4 (0.74%) Data Analysis Expressions
11 3 (0.55%) C
11 3 (0.55%) R
11 3 (0.55%) Rust
12 2 (0.37%) Kusto Query Language
Qualifications
1 202 (37.34%) Degree
2 171 (31.61%) DBS Check
3 34 (6.28%) Computer Science Degree
4 19 (3.51%) Security Cleared
5 18 (3.33%) Master's Degree
6 16 (2.96%) SC Cleared
7 9 (1.66%) DV Cleared
8 4 (0.74%) CIMA
8 4 (0.74%) PMI Certification
9 3 (0.55%) AWS Certification
9 3 (0.55%) AWS Certified Solutions Architect
10 2 (0.37%) Azure Certification
10 2 (0.37%) Microsoft Certification
11 1 (0.18%) PhD
11 1 (0.18%) Postgraduate
Quality Assurance & Compliance
1 113 (20.89%) Data Quality
2 20 (3.70%) GDPR
3 4 (0.74%) Solvency II
4 3 (0.55%) ISO/IEC 27001
4 3 (0.55%) QA
5 2 (0.37%) Accessibility
6 1 (0.18%) California Consumer Privacy Act
6 1 (0.18%) HIPAA
System Software
1 20 (3.70%) Docker
Systems Management
1 58 (10.72%) Kubernetes
2 28 (5.18%) Terraform
3 5 (0.92%) Ansible
4 3 (0.55%) Argo
Vendors
1 226 (41.77%) Databricks
2 76 (14.05%) Microsoft
3 27 (4.99%) Google
4 20 (3.70%) Oracle
5 9 (1.66%) SAP
6 8 (1.48%) Teradata
7 5 (0.92%) Informatica
7 5 (0.92%) Talend
8 3 (0.55%) Confluent
8 3 (0.55%) Salesforce
8 3 (0.55%) SnapLogic
9 2 (0.37%) Ab Initio
9 2 (0.37%) Cloudera
9 2 (0.37%) Hortonworks
9 2 (0.37%) Sage
10 1 (0.18%) CrowdStrike