Data Lake Contracts

Data Lakes
UK

The table below provides summary statistics for contract job vacancies requiring Data Lake skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Lake over the 6 months leading up to 12 June 2024, comparing them to the same period in the previous two years.

6 months to
12 Jun 2024
Same period 2023 Same period 2022
Rank 173 207 224
Rank change year-on-year +34 +17 -18
Contract jobs citing Data Lake 595 723 1,108
As % of all contract jobs advertised in the UK 1.36% 1.30% 1.27%
As % of the Database & Business Intelligence category 7.97% 7.42% 6.48%
Number of daily rates quoted 468 556 730
10th Percentile £413 £428 £413
25th Percentile £500 £500 £500
Median daily rate (50th Percentile) £625 £565 £575
Median % change year-on-year +10.62% -1.74% +12.20%
75th Percentile £850 £675 £683
90th Percentile £888 £750 £775
UK excluding London median daily rate £495 £525 £575
% change year-on-year -5.71% -8.70% +19.17%
Number of hourly rates quoted 2 4 5
10th Percentile £42.50 - -
25th Percentile £45.50 - -
Median hourly rate £50.75 £35.00 £35.00
Median % change year-on-year +45.00% - -26.32%
75th Percentile £56.25 £38.75 -
90th Percentile £59.40 £45.50 £61.25
UK excluding London median hourly rate £50.75 £35.00 £35.00
% change year-on-year +45.00% - -

All Database and Business Intelligence Skills
UK

Data Lake falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,468 9,744 17,110
As % of all contract IT jobs advertised in the UK 17.10% 17.54% 19.63%
Number of daily rates quoted 5,332 6,905 12,217
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £545 £550
Median % change year-on-year -3.67% -0.91% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +11.11%
Number of hourly rates quoted 155 173 179
10th Percentile £14.00 £21.24 £15.38
25th Percentile £20.77 £32.40 £21.25
Median hourly rate £40.00 £58.59 £43.95
Median % change year-on-year -31.73% +33.31% +62.78%
75th Percentile £53.94 £73.75 £63.30
90th Percentile £72.50 £82.00 £75.00
UK excluding London median hourly rate £34.47 £56.95 £35.00
% change year-on-year -39.48% +62.71% +41.02%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 12 June 2024.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 12 June 2024.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 12 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +33 564 £648 +12.61% 192
London +41 397 £750 +25.04% 116
Work from Home +69 291 £800 +45.45% 106
UK excluding London -9 156 £495 -5.71% 72
North of England +21 68 £500 -16.67% 37
North West +15 50 £475 -25.49% 28
South East +1 37 £500 -9.09% 6
Midlands +3 23 £445 -11.00% 9
South West -1 19 £554 +5.48% 13
Yorkshire +23 17 £500 -27.01% 7
East Midlands +1 13 £459 +1.94% 5
West Midlands +10 10 £400 -27.27% 4
Scotland +41 8 £450 -10.00% 3
East of England -2 3 £410 -23.72% 3
North East +1 1 £850 +41.67% 2

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 167 (28.07%) Apache Airflow
2 160 (26.89%) Apache
3 65 (10.92%) Apache Spark
4 12 (2.02%) SAS
5 5 (0.84%) Confluence
6 1 (0.17%) Jupyter
Applications
1 2 (0.34%) Microsoft Excel
2 1 (0.17%) Microsoft Office
Business Applications
1 23 (3.87%) Dynamics AX
2 14 (2.35%) Dynamics CRM
3 4 (0.67%) Oracle EBS
3 4 (0.67%) Sparx Enterprise Architect
4 3 (0.50%) Maximo
4 3 (0.50%) Oracle ERP
4 3 (0.50%) Primavera
4 3 (0.50%) SAP S/4HANA
5 2 (0.34%) Oracle Payables
5 2 (0.34%) Oracle Receivables
5 2 (0.34%) PeopleSoft CRM
6 1 (0.17%) Oracle General Ledger
6 1 (0.17%) Shopify
6 1 (0.17%) thinkFolio
Cloud Services
1 298 (50.08%) Azure
2 259 (43.53%) AWS
3 184 (30.92%) Snowflake
4 168 (28.24%) dbt
5 149 (25.04%) Power Platform
6 130 (21.85%) GCP
7 107 (17.98%) Azure Data Factory
8 71 (11.93%) Azure Synapse Analytics
9 59 (9.92%) Azure DevOps
10 53 (8.91%) Power Automate
11 50 (8.40%) Serverless
12 49 (8.24%) Dynamics 365
13 41 (6.89%) PowerApps
14 27 (4.54%) Amazon S3
14 27 (4.54%) Azure Logic Apps
15 21 (3.53%) Azure Functions
16 18 (3.03%) Amazon EC2
17 17 (2.86%) AWS Lambda
17 17 (2.86%) Azure Key Vault
17 17 (2.86%) Cloud Computing
Communications & Networking
1 5 (0.84%) Firewall
2 3 (0.50%) VPN
3 1 (0.17%) DNS
3 1 (0.17%) Network Security
3 1 (0.17%) SSL
Database & Business Intelligence
1 168 (28.24%) Amazon Athena
2 167 (28.07%) Data Warehouse
3 157 (26.39%) Dremio
4 153 (25.71%) Apache Arrow
5 136 (22.86%) Power BI
6 127 (21.34%) Apache Ignite
7 125 (21.01%) Big Data
8 49 (8.24%) Azure SQL Database
9 45 (7.56%) SQL Server
10 36 (6.05%) NoSQL
11 28 (4.71%) Amazon Redshift
12 25 (4.20%) Hadoop
13 23 (3.87%) BigQuery
14 22 (3.70%) Relational Database
15 21 (3.53%) Tableau
16 20 (3.36%) Delta Lake
17 17 (2.86%) Metadata
18 16 (2.69%) Data Mining
18 16 (2.69%) OLTP
19 14 (2.35%) Star Schema
Development Applications
1 45 (7.56%) Git
2 20 (3.36%) Jenkins
3 17 (2.86%) JIRA
4 7 (1.18%) ERwin
5 6 (1.01%) SonarQube
5 6 (1.01%) SQL Server Management Studio (SSMS)
5 6 (1.01%) Visual Studio Team System
6 4 (0.67%) Deequ
6 4 (0.67%) kappa
6 4 (0.67%) MLflow
7 3 (0.50%) Maven
8 2 (0.34%) Ant
8 2 (0.34%) ER Studio
8 2 (0.34%) Gradle
8 2 (0.34%) JUnit
9 1 (0.17%) Octopus Deploy
9 1 (0.17%) Poetry
9 1 (0.17%) TeamCity
9 1 (0.17%) TestComplete
9 1 (0.17%) Visual Studio
General
1 268 (45.04%) Finance
2 166 (27.90%) Banking
3 139 (23.36%) Front Office
4 136 (22.86%) Investment Banking
5 126 (21.18%) Social Skills
6 85 (14.29%) Analytical Skills
7 43 (7.23%) Public Sector
8 34 (5.71%) Retail
9 28 (4.71%) General Ledger
10 18 (3.03%) Pharmaceutical
11 8 (1.34%) Influencing Skills
12 7 (1.18%) Financial Institution
12 7 (1.18%) Legal
13 6 (1.01%) Marketing
13 6 (1.01%) Presentation Skills
14 4 (0.67%) Inclusion and Diversity
15 3 (0.50%) Czech Language
15 3 (0.50%) Documentation Skills
16 2 (0.34%) Billing
16 2 (0.34%) Law
Job Titles
1 150 (25.21%) Architect
2 133 (22.35%) Data Engineer
3 85 (14.29%) Solutions Architect
4 80 (13.45%) AWS Engineer
4 80 (13.45%) Lead
5 78 (13.11%) Senior
6 77 (12.94%) Software Engineer
7 65 (10.92%) Developer
8 63 (10.59%) Data Architect
9 58 (9.75%) Azure Engineer
10 54 (9.08%) Python Engineer
11 52 (8.74%) Azure Data Engineer
12 47 (7.90%) Java Engineer
13 46 (7.73%) AWS Software Engineer
13 46 (7.73%) Java Software Engineer
13 46 (7.73%) Python Software Engineer
14 44 (7.39%) Consultant
15 43 (7.23%) Senior Software Engineer
16 38 (6.39%) Analyst
17 35 (5.88%) Software Developer
Libraries, Frameworks & Software Standards
1 145 (24.37%) gRPC
1 145 (24.37%) Protocol Buffers
2 132 (22.18%) NumPy
2 132 (22.18%) Pandas
3 131 (22.02%) SciPy
4 72 (12.10%) PySpark
5 26 (4.37%) Kafka
6 19 (3.19%) JSON
7 14 (2.35%) .NET
8 13 (2.18%) XML
9 12 (2.02%) ARM Templates
10 8 (1.34%) Apache Avro
10 8 (1.34%) Oracle Fusion
11 6 (1.01%) Middleware
11 6 (1.01%) Web Services
12 5 (0.84%) Great Expectations
12 5 (0.84%) JSON Schema
13 4 (0.67%) ADO
13 4 (0.67%) OpenID
13 4 (0.67%) REST
Miscellaneous
1 154 (25.88%) Hedge funds
2 135 (22.69%) Derivative
2 135 (22.69%) Equities
2 135 (22.69%) Fixed Income
2 135 (22.69%) Foreign Exchange (FX)
3 34 (5.71%) Data Structures
4 24 (4.03%) Product Ownership
5 18 (3.03%) Clustering
6 16 (2.69%) Pricing Data
7 8 (1.34%) Algorithms
7 8 (1.34%) Reference Data
8 7 (1.18%) Distributed Computing
9 6 (1.01%) Credit Risk
9 6 (1.01%) Data Centre
9 6 (1.01%) Self-Motivation
10 5 (0.84%) Data Fabric
10 5 (0.84%) Hybrid Cloud
11 4 (0.67%) Blockchain
11 4 (0.67%) Greenfield Project
11 4 (0.67%) Legacy Systems
Operating Systems
1 15 (2.52%) Linux
2 5 (0.84%) Windows
3 2 (0.34%) Android
3 2 (0.34%) Apple iOS
3 2 (0.34%) Unix
3 2 (0.34%) Windows Server
4 1 (0.17%) VMS
4 1 (0.17%) Windows Server 2012
Processes & Methodologies
1 236 (39.66%) Agile
2 159 (26.72%) Asset Management
3 156 (26.22%) Data Modelling
4 152 (25.55%) Analytics
5 148 (24.87%) DevOps
6 146 (24.54%) Software Engineering
7 144 (24.20%) Business Intelligence
8 133 (22.35%) ETL
9 121 (20.34%) Investment Management
10 98 (16.47%) Data Engineering
11 96 (16.13%) Data Pipeline
12 74 (12.44%) Data Governance
13 70 (11.76%) CI/CD
14 68 (11.43%) Line Management
15 64 (10.76%) Migration
16 63 (10.59%) Data Architecture
17 57 (9.58%) Problem-Solving
18 50 (8.40%) Data Science
19 49 (8.24%) Data Integration
19 49 (8.24%) Machine Learning
Programming Languages
1 306 (51.43%) Python
2 210 (35.29%) SQL
3 177 (29.75%) Java
4 146 (24.54%) JavaScript
5 127 (21.34%) TypeScript
6 29 (4.87%) PowerShell
7 28 (4.71%) T-SQL
8 24 (4.03%) Go
9 23 (3.87%) Scala
10 14 (2.35%) C#
11 12 (2.02%) R
12 7 (1.18%) Bash
12 7 (1.18%) Bicep
12 7 (1.18%) Data Analysis Expressions
13 4 (0.67%) C++
13 4 (0.67%) X++
14 3 (0.50%) C
15 2 (0.34%) Shell Script
16 1 (0.17%) PyPy
16 1 (0.17%) U-SQL
Qualifications
1 57 (9.58%) Degree
2 44 (7.39%) Security Cleared
3 39 (6.55%) SC Cleared
4 15 (2.52%) DV Cleared
5 13 (2.18%) AWS Certification
6 12 (2.02%) Azure Certification
6 12 (2.02%) Computer Science Degree
7 11 (1.85%) Master's Degree
8 3 (0.50%) CIMA
8 3 (0.50%) Microsoft Certification
9 1 (0.17%) AWS Certified Solutions Architect
9 1 (0.17%) ISO 27001 Lead Implementer
9 1 (0.17%) PhD
9 1 (0.17%) PMI Certification
9 1 (0.17%) PMP
Quality Assurance & Compliance
1 100 (16.81%) Data Quality
2 16 (2.69%) QA
3 6 (1.01%) Accessibility
3 6 (1.01%) GDPR
4 4 (0.67%) ISO/IEC 27001
5 3 (0.50%) ISO 22301
5 3 (0.50%) PMO
6 2 (0.34%) SLA
7 1 (0.17%) CDISC
7 1 (0.17%) COBIT
7 1 (0.17%) Cyber Essentials
7 1 (0.17%) GxP
7 1 (0.17%) NIST
7 1 (0.17%) PCI DSS
System Software
1 23 (3.87%) Docker
2 8 (1.34%) Virtual Machines
3 5 (0.84%) Active Directory
4 3 (0.50%) HDFS
Systems Management
1 73 (12.27%) Terraform
2 43 (7.23%) Kubernetes
3 18 (3.03%) Prometheus
4 17 (2.86%) Ansible
5 10 (1.68%) Puppet
6 9 (1.51%) Progress Chef
7 6 (1.01%) HP Fortify
8 1 (0.17%) Ambari
8 1 (0.17%) Ganglia
8 1 (0.17%) Kibana
8 1 (0.17%) Kubeflow
8 1 (0.17%) Oozie
Vendors
1 151 (25.38%) Databricks
2 126 (21.18%) Microsoft
3 28 (4.71%) SAP
4 21 (3.53%) Google
5 20 (3.36%) Oracle
6 8 (1.34%) Bloomberg
6 8 (1.34%) Informatica
6 8 (1.34%) Reuters
6 8 (1.34%) Salesforce
7 7 (1.18%) Alteryx
7 7 (1.18%) Dataiku
8 6 (1.01%) ServiceNow
8 6 (1.01%) Splunk
8 6 (1.01%) Trillium
9 4 (0.67%) Sparx
9 4 (0.67%) Talend
10 3 (0.50%) Ab Initio
10 3 (0.50%) BiZZdesign
10 3 (0.50%) Cloudera
10 3 (0.50%) Teradata