Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
as Flask). Familiarity with SQL Server and/or PostgreSQL database technologies. Linux experience. Cloud development experience (e.g. AWS). Familiarity with SecDB, Athena or Quartz. Team Player with Excellent Communication Skills. more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
a majority of the following:Extensive experience in Python/PySpark coding and development, as well as SQL Expertise in AWS - Redshift, S3, Glue, Athena, Lambda etc Previous commercial experience in cloud migration projectsYou have led teams of Data Engineers before - making design decisions, interacting with stakeholders and being more »
Kafka or equivalent distributed event store and stream-processing platform. Experience working with Redis or equivalent in-memory storage. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience with concurrent development source control (GIT). Systems integration experience with networking, data migrations, API integration and design. more »
using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain more »
of data from multiple data sourcesExperience of CI/CD best practicesAnd would love you to know or learn:Experience of ETL technologiesAWS exposure (Athena, Glue, EMR, Step functions)Experience of relational database technologies (MS SQL Server, Redshift, Aurora)Experience with data solution BAU processes (ETL, table refresh etcAbout more »