Data Lake Jobs with Work from Home Options

Data Lakes
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 168 211 275
Rank change year-on-year +43 +64 +65
Permanent jobs citing Data Lake 636 673 1,000
As % of all permanent jobs with a WFH option 1.88% 1.66% 1.40%
As % of the Database & Business Intelligence category 8.10% 6.69% 4.73%
Number of salaries quoted 543 509 551
10th Percentile £42,300 £50,984 £47,500
25th Percentile £62,500 £61,180 £53,750
Median annual salary (50th Percentile) £100,000 £80,294 £70,000
Median % change year-on-year +24.54% +14.71% +12.00%
75th Percentile £142,500 £106,250 £86,250
90th Percentile £148,750 £150,000 £100,000
UK median annual salary £85,000 £80,000 £70,000
% change year-on-year +6.25% +14.29% -

All Database and Business Intelligence Skills
Work from Home

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 7,850 10,063 21,148
As % of all permanent jobs with a WFH option 23.22% 24.80% 29.67%
Number of salaries quoted 6,228 6,908 11,090
10th Percentile £37,000 £40,000 £36,500
25th Percentile £43,750 £49,750 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £75,208 £82,500 £78,750
90th Percentile £97,500 £102,500 £93,750
UK median annual salary £57,500 £65,000 £60,000
% change year-on-year -11.54% +8.33% +9.09%

Data Lake
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Lake as a proportion of all IT jobs advertised.

Data Lake trend for jobs with a WFH option

Data Lake
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Data Lake.

Data Lake salary trend for jobs with a WFH option

Data Lake
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Data Lake over the 6 months to 20 May 2024.

Data Lake salary histogram for jobs with a WFH option

Data Lake
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 280 (44.03%) Apache Airflow
2 232 (36.48%) Apache
3 45 (7.08%) Apache Spark
4 2 (0.31%) Confluence
4 2 (0.31%) Jupyter
5 1 (0.16%) IIS
5 1 (0.16%) Microsoft Exchange
5 1 (0.16%) SAS
5 1 (0.16%) SharePoint
Applications
1 9 (1.42%) Microsoft Excel
2 5 (0.79%) Microsoft Office
3 1 (0.16%) Microsoft PowerPoint
Business Applications
1 6 (0.94%) Primavera
2 3 (0.47%) SAP S/4HANA
3 1 (0.16%) Salesforce CRM
Cloud Services
1 368 (57.86%) AWS
2 340 (53.46%) Snowflake
3 303 (47.64%) Azure
4 280 (44.03%) dbt
5 133 (20.91%) GCP
6 120 (18.87%) Power Platform
7 87 (13.68%) Azure Data Factory
8 86 (13.52%) Azure Synapse Analytics
9 49 (7.70%) Matillion
10 42 (6.60%) Azure Cosmos DB
11 29 (4.56%) Serverless
12 25 (3.93%) Azure DevOps
13 14 (2.20%) PowerApps
14 13 (2.04%) Power Automate
15 12 (1.89%) Azure Data Lake Analytics
16 11 (1.73%) Azure Machine Learning
17 9 (1.42%) GitHub
18 7 (1.10%) Dynamics 365
18 7 (1.10%) SaaS
19 6 (0.94%) AWS Lambda
Communications & Networking
1 18 (2.83%) Wireless
2 11 (1.73%) Network Security
3 2 (0.31%) DNS
4 1 (0.16%) Firewall
4 1 (0.16%) HTTP
4 1 (0.16%) SAN
Database & Business Intelligence
1 278 (43.71%) Dremio
2 276 (43.40%) Apache Arrow
3 273 (42.92%) Amazon Athena
4 231 (36.32%) Data Warehouse
5 218 (34.28%) Apache Ignite
6 129 (20.28%) Big Data
7 118 (18.55%) Power BI
8 98 (15.41%) SQL Server
9 54 (8.49%) Azure SQL Data Warehouse
10 43 (6.76%) Azure SQL Database
11 33 (5.19%) Star Schema
12 31 (4.87%) Elasticsearch
13 27 (4.25%) Metadata
14 24 (3.77%) NoSQL
14 24 (3.77%) Tableau
15 20 (3.14%) Delta Lake
16 19 (2.99%) Relational Database
17 18 (2.83%) BigQuery
18 13 (2.04%) Data Mining
19 12 (1.89%) Microsoft Analysis Services
Development Applications
1 31 (4.87%) GitLab
2 10 (1.57%) MLflow
3 6 (0.94%) Git
3 6 (0.94%) Oracle Forms
4 5 (0.79%) Visual Studio
5 3 (0.47%) JIRA
5 3 (0.47%) Octopus Deploy
6 2 (0.31%) ER Studio
6 2 (0.31%) ERwin
7 1 (0.16%) Jenkins
7 1 (0.16%) Visual Studio Team System
General
1 392 (61.64%) Finance
2 236 (37.11%) Banking
3 222 (34.91%) Front Office
3 222 (34.91%) Investment Banking
4 74 (11.64%) Social Skills
5 51 (8.02%) Analytical Skills
6 50 (7.86%) Presentation Skills
7 20 (3.14%) Retail
8 16 (2.52%) Billing
8 16 (2.52%) Public Sector
9 14 (2.20%) Telecoms
10 13 (2.04%) Marketing
11 11 (1.73%) Back Office
12 9 (1.42%) Influencing Skills
12 9 (1.42%) Legal
13 5 (0.79%) Games
14 4 (0.63%) Inclusion and Diversity
14 4 (0.63%) Wearables
15 3 (0.47%) Organisational Skills
16 2 (0.31%) Manufacturing
Job Titles
1 172 (27.04%) Senior
2 155 (24.37%) Data Engineer
3 135 (21.23%) Lead
4 132 (20.75%) AWS Engineer
5 125 (19.65%) Software Engineer
6 110 (17.30%) Architect
7 94 (14.78%) Python Engineer
8 77 (12.11%) Java Engineer
8 77 (12.11%) Java Software Engineer
8 77 (12.11%) Python Software Engineer
9 76 (11.95%) AWS Software Engineer
10 73 (11.48%) Developer
11 68 (10.69%) Senior Software Engineer
12 63 (9.91%) Solutions Architect
13 62 (9.75%) Consultant
14 57 (8.96%) Data Consultant
15 56 (8.81%) Big Data Engineer
16 54 (8.49%) Data Architect
16 54 (8.49%) Site Engineer
16 54 (8.49%) Site Reliability Engineer
Libraries, Frameworks & Software Standards
1 272 (42.77%) gRPC
1 272 (42.77%) Protocol Buffers
2 226 (35.53%) Pandas
3 218 (34.28%) NumPy
3 218 (34.28%) SciPy
4 41 (6.45%) PySpark
5 9 (1.42%) JSON
5 9 (1.42%) Kafka
6 8 (1.26%) Apache Beam
7 6 (0.94%) XML
8 5 (0.79%) Web Services
9 4 (0.63%) MDX
9 4 (0.63%) YAML
10 3 (0.47%) .NET
10 3 (0.47%) RESTful
11 2 (0.31%) FastAPI
11 2 (0.31%) Flask
12 1 (0.16%) ARM Templates
12 1 (0.16%) FIXML
12 1 (0.16%) XBRL
Miscellaneous
1 276 (43.40%) Hedge funds
2 222 (34.91%) Derivative
2 222 (34.91%) Equities
2 222 (34.91%) Fixed Income
2 222 (34.91%) Foreign Exchange (FX)
3 54 (8.49%) Clustering
4 50 (7.86%) Data Structures
5 31 (4.87%) Self-Motivation
6 30 (4.72%) Pricing Data
7 22 (3.46%) Enterprise Software
8 14 (2.20%) Algorithms
8 14 (2.20%) Cloud Native
9 13 (2.04%) Product Ownership
10 11 (1.73%) Greenfield Project
11 8 (1.26%) IoT
12 7 (1.10%) Management Information System
13 6 (0.94%) Public Cloud
13 6 (0.94%) Virtual Team
14 5 (0.79%) Distributed Computing
15 3 (0.47%) Distributed Systems
Operating Systems
1 3 (0.47%) Linux
2 2 (0.31%) Unix
2 2 (0.31%) Windows
3 1 (0.16%) AIX
3 1 (0.16%) Solaris
3 1 (0.16%) VMS
Processes & Methodologies
1 290 (45.60%) Agile
2 276 (43.40%) Asset Management
3 241 (37.89%) Investment Management
4 231 (36.32%) Software Engineering
5 164 (25.79%) Analytics
6 143 (22.48%) Data Pipeline
7 132 (20.75%) Artificial Intelligence
8 130 (20.44%) ETL
9 126 (19.81%) Business Intelligence
9 126 (19.81%) Data Engineering
10 122 (19.18%) Data Modelling
11 112 (17.61%) DevOps
12 111 (17.45%) Data Science
13 103 (16.19%) Machine Learning
14 99 (15.57%) Line Management
15 94 (14.78%) Data Architecture
16 92 (14.47%) Greeks
17 81 (12.74%) Roadmaps
18 69 (10.85%) CI/CD
19 62 (9.75%) Data Analytics
Programming Languages
1 424 (66.67%) Python
2 301 (47.33%) Java
3 273 (42.92%) JavaScript
4 232 (36.48%) SQL
5 218 (34.28%) TypeScript
6 62 (9.75%) Go
7 47 (7.39%) T-SQL
8 25 (3.93%) Data Analysis Expressions
9 19 (2.99%) C#
10 13 (2.04%) R
11 11 (1.73%) Kotlin
11 11 (1.73%) Scala
11 11 (1.73%) U-SQL
12 3 (0.47%) C
13 2 (0.31%) PowerShell
13 2 (0.31%) VBA
14 1 (0.16%) Bash
14 1 (0.16%) Kusto Query Language
14 1 (0.16%) PL/SQL
Qualifications
1 60 (9.43%) Azure Certification
2 47 (7.39%) AWS Certification
3 35 (5.50%) Degree
4 27 (4.25%) Microsoft Certification
5 12 (1.89%) Computer Science Degree
6 9 (1.42%) SC Cleared
6 9 (1.42%) Security Cleared
7 7 (1.10%) DV Cleared
7 7 (1.10%) Master's Degree
8 6 (0.94%) CIMA
9 3 (0.47%) MCP
10 1 (0.16%) IBM Certification
10 1 (0.16%) LPIC
10 1 (0.16%) MCSE
10 1 (0.16%) Numerate Degree
Quality Assurance & Compliance
1 161 (25.31%) Data Quality
2 33 (5.19%) GDPR
3 6 (0.94%) California Consumer Privacy Act
4 4 (0.63%) Accessibility
5 2 (0.31%) PMO
6 1 (0.16%) HIPAA
6 1 (0.16%) QA
6 1 (0.16%) SLA
System Software
1 13 (2.04%) Docker
2 1 (0.16%) Active Directory
2 1 (0.16%) Virtual Machines
2 1 (0.16%) VMware Infrastructure
Systems Management
1 82 (12.89%) Kubernetes
2 68 (10.69%) Terraform
3 54 (8.49%) Prometheus
4 2 (0.31%) Argo
4 2 (0.31%) Progress Chef
Vendors
1 130 (20.44%) Databricks
2 92 (14.47%) Microsoft
3 15 (2.36%) Google
3 15 (2.36%) SAP
4 14 (2.20%) Oracle
5 8 (1.26%) Teradata
6 6 (0.94%) Adobe
6 6 (0.94%) Apple
7 5 (0.79%) Talend
8 3 (0.47%) SnapLogic
9 2 (0.31%) CrowdStrike
10 1 (0.16%) Ariba
10 1 (0.16%) Bloomberg
10 1 (0.16%) IBM
10 1 (0.16%) Reuters
10 1 (0.16%) Salesforce
10 1 (0.16%) Sparx
10 1 (0.16%) UiPath
10 1 (0.16%) VMware
10 1 (0.16%) Workday