design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with modern … languages such as Python, Java, and Scala. In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift, AWS RDS, and Hadoop. Proven experience working with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets. more »
Manchester, North West, United Kingdom Hybrid / WFH Options
83zero Limited
design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with modern … languages such as Python, Java, and Scala. In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift, AWS RDS, and Hadoop. Proven experience working with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets. more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
83zero Limited
design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with modern … languages such as Python, Java, and Scala. In-depth knowledge of Data Warehouse, Database technologies, and Big Data Eco-system technologies such as AWS Redshift, AWS RDS, and Hadoop. Proven experience working with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets. more »
e.g., Hadoop, Spark, Kafka). Experience with AWS and its data services (e.g. S3, Athena, AWS Glue). Familiarity with data warehousing solutions (e.g., Redshift, BigQuery, Snowflake). Knowledge of containerization and orchestration tools (e.g., Docker, ECS, Kubernetes). Knowledge of data orchestration tools (e.g. Prefect, Apache Airflow). more »
from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, AmazonRedshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data … a related field. 5 to 8 years of experience in data engineering, including working with AWS services. Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR. Knowledge on Cloudera based hadoop is a plus. Strong ETL development skills and experience with data integration tools. Knowledge of data more »
and how to model data for efficient usage of them. Examples include relational DBMS (e.g. Postgress, Oracle ), Hadoop, NoSQL(E.g. Dynamo), Columnar DBs (E.g. AmazonRedshift), Graph DBs (e.g. Neptune), cloud object storage (E.g. Amazon S3), cloud DB as a service (e.g. Amazon RDS) Understanding of more »
engineering experience, including expertise in Python or Scala or Java. 3+ years of experience with cloud vendors (AWS, Azure, GCP), data warehouse services (e.g., Redshift, Databricks), and cloud storage (Azure Storage, S3). Production experience with KSQL for real-time data analytics and ClickHouse for fast analytics on streaming more »
Architect – Professional or AWS Certified Data Analytics – Specialty certification. Extensive experience in designing and implementing data solutions on AWS using services such as AWS Redshift, Glue, Athena, EMR, S3, RDS, and DynamoDB. Proficiency in data modelling, ETL/ELT pipelines, and data integration using tools such as AWS Glue more »
Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS, Informatica. Lead Data Engineer Summary: The role is as remote as you wish, but the door at more »
. Scripting Savvy: Skilled with PowerShell, Python, and Bash; comfortable in Linux/Unix environments. Data Enthusiast: Experience with SQL, MySQL, PostgreSQL, and AWS Redshift a plus. Security & Monitoring: Proficient with monitoring tools (CloudWatch, Datadog) and infrastructure security. Bonus Points: Certifications in AWS/GCP/Azure and passion more »
Hadoop-based technologies (e.g., Spark), and data pipelines (e.g., Beam, Flink). Experience designing data lake and data warehouse solutions (e.g., BigQuery, Azure Synapse, Redshift). Hands-on experience with visualisation tools (e.g., Looker, Tableau, PowerBI). Understanding of Agile methodologies such as Scrum. Knowledge of data science concepts more »
Cramlington, Northumberland, United Kingdom Hybrid / WFH Options
Tech4 Ltd
Ensure the integration of streaming data with batch processing systems for comprehensive data management Cloud Infrastructure Management: Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure Continuously optimize the platform for performance, scalability, and cost-effectiveness Communications: Collaborate with more »
Northumberland, North East, United Kingdom Hybrid / WFH Options
Tech 4
Ensure the integration of streaming data with batch processing systems for comprehensive data management Cloud Infrastructure Management: Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure Continuously optimize the platform for performance, scalability, and cost-effectiveness Communications: Collaborate with more »
based on trust and value. Role Overview The Principal Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow … aligned to the functional and non-functional requirements Work closely with other members of agile deployment team Selection & configuration of appropriate, base technologies (eg AmazonRedshift, RDS) Selection & application of appropriate standards & principles Capture & implementation of functional & non-functional requirements Expert in data modelling and latest data trends more »
City of London, London, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
data ingestion (batch and streaming), CI/CD tools (Azure DevOps, Terraform, AWS CodePipeline), and integration with databases such as SQL Server, PostgreSQL, Oracle, Redshift, and Synapse. * Business Intelligence Experience: Proficiency in reporting tools such as Power BI, Tableau, and QlikView. * Industry Knowledge: Preferable background in Insurance or Finance more »
multiple tasks in a fast-paced environment Preferred Experience and Competencies Experience with Kafka Connects (S3 and ElasticSearch), Kafka Streams Familiarity with AWS Glue, Redshift for streaming data integration AWS Certifications (AWS Certified DevOps Engineer, etc.) Knowledge of multi-region Kafka deployments and cross-cluster replication Aker Systems Attributes more »
in code optimisation using spark SQL and pyspark. Understanding of Code versioning ,Git repository , JFrog Artifactory. AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each Code Refactorization of Legacy Codebase: Clean, modernize, improve readability and maintainability. Unit Tests/TDD more »
Nottinghamshire, Nottingham, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data systems. To succeed, you’ll more »
and SQL for data processing and transformation. Experience designing and building scalable data pipelines. Expertise in AWS , with experience in services such as S3, Redshift, Lambda, or similar. A solid understanding of database technologies and data architecture. Strong problem-solving skills and attention to detail. Desirable Skills Experience with more »
Birmingham, West Midlands (County), United Kingdom Hybrid / WFH Options
Xpertise Recruitment
organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data systems. To succeed, you’ll more »
Sheffield, Birmingham, West Midlands (County), United Kingdom Hybrid / WFH Options
Xpertise Recruitment
organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data systems. To succeed, you’ll more »
languages such as Python, SQL, or other data-related languages. Experience with cloud services (e.g., AWS, Google Cloud, Azure) and data storage solutions (e.g., Redshift, BigQuery). Familiarity with data engineering tools and frameworks (e.g., Apache Spark, Kafka, Airflow). Strong problem-solving skills and a passion for working more »
related field, with experience in a leadership or strategic role. Strong proficiency in SQL and experience with cloud data warehouses (e.g., Snowflake, BigQuery, or Redshift). Hands-on experience with data visualisation tools like Tableau, Looker, or Power BI, creating impactful dashboards and reports. Expertise in defining and implementing more »
junior team members, and lead discussions. Client Engagement: Confidence in managing client relationships, especially with technical stakeholders. Beneficial Skills Experience with AWS services (S3, Redshift, RDS, Lambda, EC2, ECS, EKS). UI/UX Design experience. Familiarity with Python packages for data science (Pandas, Numpy, Scikit, TensorFlow). Strong more »