design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, AmazonKinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with more »
Manchester, North West, United Kingdom Hybrid / WFH Options
83zero Limited
design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, AmazonKinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
83zero Limited
design innovative data solutions that address complex business requirements and drive decision-making. Your Skills and Experience Demonstrable experience using AWS Glue, AWS Lambda, AmazonKinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Strong experience with more »
Oxford, Oxfordshire, United Kingdom Hybrid / WFH Options
Randstad Technologies Recruitment
integration and orchestration solution in AWS using the services like EventBridge, Lambda, SNS/SQS, API Gateway, Transfer Family, AppFlow, Glue, Step Function, S3, Kinesis, MQ, DynamoDB Streams. Expertise in designing and implementing data integration workflows using AWS services such as AWS Glue, Amazon S3, AWS Lambda, and … AmazonKinesis for both batch and real-time processing, along with monitoring and troubleshooting data pipelines using AWS CloudWatch and AWS X-Ray. Experience in building event-driven solutions, preferably in AWS using the services like SNS, SQS, EventBridge, and Lambda, leveraging decoupled, scalable integrations. Expertise in designing more »
optimise data models, ensuring data is structured, accessible, and performant for downstream analytics and machine learning models Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions) Knowledge and experience of Palantir Foundry or Gotham is more »
how to create scalable multi-region applications Experience with the following technologies: AWS Serverless and serverless-supported languages DB (ex, Postgresql, CockroachDB) Streaming technologies (AmazonKinesis, Kafka) Message Queues (SQS, RabbitMQ, ActiveMQ) Experience working with agile development Experience with containerization (Docker, Kubernetes, etc) Experience with Micro-Service and more »
Newcastle upon Tyne, Tyne & Wear, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. Data and Cloud Engineering tools like Apache Spark, Airflow, Kafka, Kinesis, Athena, Glue, Data Factory, SSIS, dbt and plenty more CI/CD pipeline automation utilising GitLab, Jenkins, Azure DevOps, GitHub Actions, and CircleCI DevOps more »
and master data. Experience in establishing analytics and AI solutions. Good working knowledge of ontologies and taxonomies. Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). Data quality/validation experience: designing more »
years of experience as a Senior DevOps Engineer 5+ years of core AWS cloud experience (RDS, ECS, EC2) Ideally Kafka experience (MSK or Kinesis as an alternative) Linux experience (Ubuntu) Terraform experience Docker experience Cloudflare experience (desirable) Deployment and management of PHP/Node JS applications (desirable) Package: Up more »
for the clients product Optimize data storage and retrieval processes to enhance system performance and scalability. AWS: Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure. Implement best practices for security, monitoring, and cost management within the AWS ecosystem. Collaborate with DevOps teams more »
Lichfield, Staffordshire, United Kingdom Hybrid / WFH Options
Gleeson Recruitment Group
services Proficiency with a variety of AWS-native data management and analytics tools and services, such as AWS Glue, DataBrew, Athena, LakeFormation, EMR, MSK, Kinesis, etc. Building data expertise and data quality into ETL pipelines by profiling data to measure quality, integrity, accuracy, and completeness Working within an AGILE more »
Operating Systems and Virtualisation (Windows and Linux) • Infrastructure as Code and Operational Automation (e.g. Terraform, Ansible) • Message Queueing and Streaming Fabrics (e.g. AMQP, Kafka, Kinesis) • Docker and Kubernetes • Scripting (Shell and PowerShell) • Basic Coding with a bias for Infrastructure (Python, Go, C#) • IAM Policy and Authentication/Authorization schemes more »
SOAP, gRPC, etc) Public cloud providers and service (e.g. Azure, AWS) Relational Database platforms (e.g. MS SQL, Oracle, PostgreSQL) Cloud data transformation tools (e.g. Kinesis, ADF, Kafka) Experience working with payment platforms/billing systems Benefits 25 days holiday plus Bank Holiday 2 Volunteering days Gym Membership Access to more »
Lambda, Elasticache (Redis), RDS, DocumentDB, DMS, VPC, Route53, Cloudfront, API-Gateway, Certificate Manager, Cognito, EBS, X-Ray, Cloudwatch, Cloudformation, Systems manager, Trusted Advisor, CloudTrail, Kinesis, Opensearch, Secrets Manager, WAF, Cost Explorer, Amplify, Amazon MQ, AWS Transfer (SFTP) You are key to maintaining a good relationship with the rest more »
architecture frameworks. Architect solutions leveraging AWS best practices to handle high-volume data ingestion, streaming, and processing. Utilise AWS services such as AWS Glue , Kinesis , and Data Pipelines for efficient and scalable data workflows. Develop cost-effective storage and computation solutions tailored to large-scale, computationally heavy applications. Create … AWS Solutions Architect - Associate certification (mandatory). Deep understanding of AWS services and architectural best practices for data-driven applications. Proficiency in AWS Glue , Kinesis , and/or Data Pipelines for handling large data volumes. Expertise in designing cost-effective, scalable, and computationally intensive solutions. Strong knowledge of VPC more »
data solutions. * Manage both real-time and batch data pipelines. Our technology stack includes a wide variety of technologies such as Spark, Kafka, AWS Kinesis, Redshift, and DBT. * Work independently with minimal supervision in remote team configurations. * Automate existing manual processes. Requirements * Expertise in the main components of continuous … DBT, or similar frameworks used to ship data processing pipelines at scale. * Demonstrated experience with and solid knowledge of AWS: AWS Glue, AWS EMR, Amazon S3, Redshift. * Familiarity with Infrastructure-as-code (IaC) using Terraform or AWS Cloud Formation. * Demonstrated experience in data migration projects. * Ability to work with more »
Birmingham, West Midlands, West Midlands (County), United Kingdom
Harvey Nash
technical data solutions. Manage both real-time and batch data pipelines. Our technology stack includes a wide variety of technologies such as Kafka, AWS Kinesis, Redshift, and DBT. Design and model data workflows from ingestion to presentation, ensuring data security, privacy, and cost-effective solutions. Create a showcase environment … and DBT, or similar frameworks for large-scale data processing. Deep knowledge of AWS services relevant to data engineering, including AWS Glue, AWS EMR, Amazon S3, Redshift. Experience with Infrastructure-as-Code (IaC) using Terraform or AWS CloudFormation. Proven ability to design and optimize data models to address data more »
to system problems in a timely manner. In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Ability to define the monitoring, alerting, deployment strategies for various services. Experience … Mandatory Skills At least 2 Hyperscalers GCP, AWS, Azure, Big data, Apache spark, beam on Big Query/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, Stack more »