Data Lake Contracts

Data Lakes
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 2 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
2 Jun 2024
Same period 2023 Same period 2022
Rank 180 197 226
Rank change year-on-year +17 +29 -27
Contract jobs citing Data Lake 562 741 1,126
As % of all contract jobs advertised in the UK 1.30% 1.31% 1.28%
As % of the Database & Business Intelligence category 7.70% 7.44% 6.52%
Number of daily rates quoted 432 569 742
10th Percentile £413 £437 £414
25th Percentile £475 £500 £500
Median daily rate (50th Percentile) £600 £570 £575
Median % change year-on-year +5.26% -0.87% +9.52%
75th Percentile £850 £675 £686
90th Percentile £888 £750 £775
UK excluding London median daily rate £488 £538 £575
% change year-on-year -9.30% -6.52% +15.00%
Number of hourly rates quoted 2 4 5
10th Percentile £42.50 - -
25th Percentile £45.50 - -
Median hourly rate £50.75 £35.00 £35.00
Median % change year-on-year +45.00% - -22.22%
75th Percentile £56.25 £38.75 -
90th Percentile £59.40 £45.50 £61.25
UK excluding London median hourly rate £50.75 £35.00 £35.00
% change year-on-year +45.00% - -

All Database and Business Intelligence Skills
UK

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,302 9,963 17,279
As % of all contract IT jobs advertised in the UK 16.95% 17.67% 19.68%
Number of daily rates quoted 5,237 7,078 12,316
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £550 £550
Median % change year-on-year -4.50% -0.05% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £755 £750
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +11.11%
Number of hourly rates quoted 150 177 180
10th Percentile £14.00 £21.24 £14.99
25th Percentile £20.77 £32.40 £21.25
Median hourly rate £40.00 £60.00 £44.48
Median % change year-on-year -33.33% +34.91% +64.97%
75th Percentile £56.88 £73.75 £63.00
90th Percentile £72.75 £81.00 £75.00
UK excluding London median hourly rate £35.00 £58.59 £35.00
% change year-on-year -40.26% +67.40% +42.45%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 2 June 2024.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 2 June 2024.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 2 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +21 530 £600 +4.35% 219
London +35 367 £750 +25.00% 126
Work from Home +64 269 £800 +45.45% 106
UK excluding London +12 152 £488 -9.30% 90
North of England +30 66 £500 -16.67% 40
North West +14 50 £475 -24.75% 31
South East -7 36 £500 -6.98% 13
Midlands +11 23 £445 -11.00% 11
South West +8 18 £533 -0.93% 15
Yorkshire +28 15 £500 -27.01% 7
East Midlands +4 13 £459 +1.94% 5
West Midlands +7 10 £400 -27.27% 6
Scotland +34 8 £450 -12.20% 3
East of England 0 3 £410 -25.45% 5
North East +4 1 £850 +41.67% 2

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 139 (24.73%) Apache Airflow
2 130 (23.13%) Apache
3 58 (10.32%) Apache Spark
4 13 (2.31%) SAS
5 5 (0.89%) Confluence
6 1 (0.18%) Jupyter
Applications
1 2 (0.36%) Microsoft Excel
2 1 (0.18%) Microsoft Office
2 1 (0.18%) Microsoft PowerPoint
Business Applications
1 28 (4.98%) Dynamics AX
2 14 (2.49%) Dynamics CRM
3 4 (0.71%) Oracle EBS
4 3 (0.53%) Maximo
4 3 (0.53%) Oracle ERP
4 3 (0.53%) Primavera
4 3 (0.53%) SAP S/4HANA
5 2 (0.36%) Oracle Payables
5 2 (0.36%) Oracle Receivables
5 2 (0.36%) PeopleSoft CRM
6 1 (0.18%) Oracle General Ledger
6 1 (0.18%) Shopify
6 1 (0.18%) thinkFolio
Cloud Services
1 290 (51.60%) Azure
2 223 (39.68%) AWS
3 160 (28.47%) Snowflake
4 146 (25.98%) Power Platform
5 139 (24.73%) dbt
6 111 (19.75%) GCP
7 107 (19.04%) Azure Data Factory
8 69 (12.28%) Azure Synapse Analytics
9 64 (11.39%) Azure DevOps
10 58 (10.32%) Power Automate
11 53 (9.43%) Dynamics 365
12 46 (8.19%) Serverless
13 45 (8.01%) PowerApps
14 26 (4.63%) Amazon S3
14 26 (4.63%) Azure Logic Apps
15 20 (3.56%) Azure Functions
16 19 (3.38%) Azure Key Vault
17 16 (2.85%) AWS Lambda
17 16 (2.85%) Azure Monitor
18 15 (2.67%) Cloud Computing
Communications & Networking
1 4 (0.71%) Firewall
2 3 (0.53%) VPN
3 1 (0.18%) DNS
3 1 (0.18%) Network Security
3 1 (0.18%) SSL
Database & Business Intelligence
1 158 (28.11%) Data Warehouse
2 143 (25.44%) Amazon Athena
3 134 (23.84%) Power BI
4 129 (22.95%) Dremio
5 127 (22.60%) Apache Arrow
6 116 (20.64%) Big Data
7 103 (18.33%) Apache Ignite
8 47 (8.36%) Azure SQL Database
9 41 (7.30%) SQL Server
10 33 (5.87%) NoSQL
11 27 (4.80%) Amazon Redshift
12 23 (4.09%) BigQuery
13 21 (3.74%) Relational Database
14 19 (3.38%) Delta Lake
14 19 (3.38%) Hadoop
15 17 (3.02%) Tableau
16 16 (2.85%) Metadata
16 16 (2.85%) OLTP
17 14 (2.49%) DynamoDB
18 13 (2.31%) Spark SQL
Development Applications
1 43 (7.65%) Git
2 20 (3.56%) Jenkins
3 17 (3.02%) JIRA
4 6 (1.07%) SonarQube
4 6 (1.07%) SQL Server Management Studio (SSMS)
4 6 (1.07%) Visual Studio Team System
5 4 (0.71%) Deequ
6 3 (0.53%) ERwin
6 3 (0.53%) kappa
6 3 (0.53%) Maven
7 2 (0.36%) Ant
7 2 (0.36%) ER Studio
7 2 (0.36%) Gradle
7 2 (0.36%) JUnit
7 2 (0.36%) Liquibase
7 2 (0.36%) MLflow
8 1 (0.18%) GitLab
8 1 (0.18%) Octopus Deploy
8 1 (0.18%) TestComplete
8 1 (0.18%) Zephyr
General
1 243 (43.24%) Finance
2 139 (24.73%) Banking
3 122 (21.71%) Social Skills
4 111 (19.75%) Front Office
5 110 (19.57%) Investment Banking
6 85 (15.12%) Analytical Skills
7 44 (7.83%) Public Sector
8 40 (7.12%) Retail
9 32 (5.69%) General Ledger
10 18 (3.20%) Pharmaceutical
11 8 (1.42%) Influencing Skills
12 7 (1.25%) Presentation Skills
13 6 (1.07%) Financial Institution
13 6 (1.07%) Legal
13 6 (1.07%) Marketing
14 4 (0.71%) Inclusion and Diversity
15 3 (0.53%) Documentation Skills
16 2 (0.36%) Billing
16 2 (0.36%) Czech Language
16 2 (0.36%) Law
Job Titles
1 139 (24.73%) Architect
2 133 (23.67%) Data Engineer
3 77 (13.70%) Solutions Architect
4 70 (12.46%) Lead
5 69 (12.28%) AWS Engineer
6 67 (11.92%) Senior
7 63 (11.21%) Software Engineer
8 60 (10.68%) Azure Engineer
9 59 (10.50%) Data Architect
10 57 (10.14%) Developer
11 54 (9.61%) Azure Data Engineer
12 49 (8.72%) Consultant
13 44 (7.83%) Python Engineer
14 39 (6.94%) Java Engineer
15 38 (6.76%) Java Software Engineer
15 38 (6.76%) Python Software Engineer
16 37 (6.58%) Senior Software Engineer
17 36 (6.41%) Analyst
17 36 (6.41%) AWS Software Engineer
18 28 (4.98%) Software Developer
Libraries, Frameworks & Software Standards
1 121 (21.53%) gRPC
1 121 (21.53%) Protocol Buffers
2 106 (18.86%) NumPy
2 106 (18.86%) Pandas
3 105 (18.68%) SciPy
4 65 (11.57%) PySpark
5 24 (4.27%) Kafka
6 19 (3.38%) JSON
7 13 (2.31%) .NET
7 13 (2.31%) ARM Templates
7 13 (2.31%) XML
8 9 (1.60%) Apache Avro
9 8 (1.42%) Oracle Fusion
10 7 (1.25%) Web Services
11 6 (1.07%) Middleware
12 5 (0.89%) JSON Schema
12 5 (0.89%) REST
13 4 (0.71%) Apache NiFi
13 4 (0.71%) Great Expectations
13 4 (0.71%) OpenID
Miscellaneous
1 128 (22.78%) Hedge funds
2 109 (19.40%) Derivative
2 109 (19.40%) Equities
2 109 (19.40%) Fixed Income
2 109 (19.40%) Foreign Exchange (FX)
3 38 (6.76%) Data Structures
4 21 (3.74%) Product Ownership
5 18 (3.20%) Clustering
6 14 (2.49%) Pricing Data
7 7 (1.25%) Distributed Computing
8 6 (1.07%) Credit Risk
8 6 (1.07%) Data Centre
8 6 (1.07%) Data Fabric
8 6 (1.07%) Reference Data
9 5 (0.89%) Algorithms
9 5 (0.89%) Hybrid Cloud
9 5 (0.89%) Self-Motivation
10 4 (0.71%) Greenfield Project
10 4 (0.71%) Legacy Systems
10 4 (0.71%) Renewable Energy
Operating Systems
1 15 (2.67%) Linux
2 4 (0.71%) Windows
3 2 (0.36%) Unix
4 1 (0.18%) Android
4 1 (0.18%) Apple iOS
4 1 (0.18%) VMS
4 1 (0.18%) Windows Server
4 1 (0.18%) Windows Server 2012
Processes & Methodologies
1 207 (36.83%) Agile
2 154 (27.40%) DevOps
3 144 (25.62%) Data Modelling
4 143 (25.44%) Business Intelligence
5 139 (24.73%) Analytics
6 131 (23.31%) Asset Management
7 123 (21.89%) ETL
8 119 (21.17%) Software Engineering
9 108 (19.22%) Investment Management
10 90 (16.01%) Data Engineering
10 90 (16.01%) Data Pipeline
11 67 (11.92%) Data Governance
12 66 (11.74%) CI/CD
13 54 (9.61%) Migration
14 53 (9.43%) Data Architecture
14 53 (9.43%) Problem-Solving
15 52 (9.25%) Line Management
16 48 (8.54%) Data Integration
17 44 (7.83%) Machine Learning
17 44 (7.83%) Visualisation
Programming Languages
1 273 (48.58%) Python
2 195 (34.70%) SQL
3 148 (26.33%) Java
4 121 (21.53%) JavaScript
5 103 (18.33%) TypeScript
6 27 (4.80%) PowerShell
6 27 (4.80%) T-SQL
7 25 (4.45%) Go
8 19 (3.38%) Scala
9 14 (2.49%) C#
10 10 (1.78%) R
11 7 (1.25%) Bash
11 7 (1.25%) Bicep
11 7 (1.25%) Data Analysis Expressions
12 4 (0.71%) C++
12 4 (0.71%) X++
13 3 (0.53%) C
14 2 (0.36%) Shell Script
14 2 (0.36%) U-SQL
15 1 (0.18%) PHP
Qualifications
1 57 (10.14%) Degree
2 44 (7.83%) Security Cleared
3 39 (6.94%) SC Cleared
4 15 (2.67%) DV Cleared
5 13 (2.31%) AWS Certification
5 13 (2.31%) Computer Science Degree
6 11 (1.96%) Azure Certification
6 11 (1.96%) Master's Degree
7 3 (0.53%) CIMA
7 3 (0.53%) Microsoft Certification
8 1 (0.18%) AWS Certified Solutions Architect
8 1 (0.18%) ISO 27001 Lead Implementer
8 1 (0.18%) PhD
8 1 (0.18%) PMI Certification
8 1 (0.18%) PMP
Quality Assurance & Compliance
1 86 (15.30%) Data Quality
2 17 (3.02%) QA
3 6 (1.07%) GDPR
4 5 (0.89%) Accessibility
5 4 (0.71%) ISO/IEC 27001
6 3 (0.53%) ISO 22301
6 3 (0.53%) PMO
7 2 (0.36%) NIST
7 2 (0.36%) SLA
8 1 (0.18%) CDISC
8 1 (0.18%) COBIT
8 1 (0.18%) Cyber Essentials
8 1 (0.18%) GxP
8 1 (0.18%) PCI DSS
System Software
1 21 (3.74%) Docker
2 7 (1.25%) Virtual Machines
3 5 (0.89%) Active Directory
4 2 (0.36%) HDFS
Systems Management
1 71 (12.63%) Terraform
2 42 (7.47%) Kubernetes
3 18 (3.20%) Ansible
3 18 (3.20%) Prometheus
4 10 (1.78%) Puppet
5 9 (1.60%) Progress Chef
6 6 (1.07%) HP Fortify
7 2 (0.36%) Ambari
7 2 (0.36%) Oozie
8 1 (0.18%) Kibana
8 1 (0.18%) Kubeflow
Vendors
1 151 (26.87%) Databricks
2 127 (22.60%) Microsoft
3 27 (4.80%) SAP
4 22 (3.91%) Google
5 19 (3.38%) Oracle
6 8 (1.42%) Salesforce
7 7 (1.25%) Dataiku
7 7 (1.25%) Informatica
8 6 (1.07%) Alteryx
8 6 (1.07%) ServiceNow
8 6 (1.07%) Splunk
8 6 (1.07%) Trillium
9 4 (0.71%) Talend
10 3 (0.53%) Ab Initio
10 3 (0.53%) BiZZdesign
10 3 (0.53%) Cloudera
10 3 (0.53%) Teradata
11 2 (0.36%) Adobe
11 2 (0.36%) PeopleSoft
12 1 (0.18%) Sybase