Software Development Manager, Open Data Analytics AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and AmazonElastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart … Amazon Web Services Open Data Analytics (ODA) organization is looking for an experienced Software Development Manager to lead the AmazonEMR/Athena Fundamentals team. AmazonElasticMapReduce (EMR) is the industry-leading cloud big data platform for petabyte-scale data processing … interactive analytics, and machine learning using open-source frameworks such as Apache Spark, Trino, Hadoop, Hive, and HBase. Amazon Athena is a serverless query service that simplifies analyzing data directly in Amazon S3 using standard SQL. The ODA Fundamentals team is responsible for integrating and packaging More ❯
into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as AmazonEMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models … deliver high-quality data solutions. Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions. Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python. Good to have: Cloudera - Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin. Qualifications: Bachelor More ❯
implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue, AWS Lambda, AWS S3, AWS Redshift, AWS EMR). Troubleshoot and resolve complex data quality issues, performance bottlenecks, and production incidents. Develop and maintain CI/CD pipelines for data engineering workflows More ❯
Amazon Marketing team is working on a platform that will provide real-time insights of traffic, sales, deals, engagement and is looking for a rockstar data engineer to build this. At Amazon, understanding customer data is paramount to our success in making it Earth's most … effective marketing organization. This cuts across all of the investments we do across various verticals of A.in, Prime, Fashion, Fresh, Pay etc. At Amazon you will be working in one of the world's largest and most complex data environments. You will be part of a team that … HiveQL, SparkSQL, Scala) - Experience with one or more scripting languages (e.g., Python, KornShell) PREFERRED QUALIFICATIONS - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases/data stores (object storage, document or key-value stores, graph More ❯
Experience: 5+ years of experience in data architecture, with a strong focus on AWS. Technical Skills: Proficiency with AWS data services like Redshift, Glue, EMR, S3, Lambda, and DynamoDB, and extensive expertise in Snowflake data warehousing. Hands-on experience in data modeling, ETL processes, and data warehousing solutions. Strong More ❯
Python/Java/Scala/Ruby etc.). Experience using big data technologies (Spark, Presto, etc.). Experience using cloud technologies such as EMR, Lambda, EC2, and data pipelines. Experience leading data warehousing and analytics projects, including using technologies such as Airflow, Jenkins, Snowflake, and Kinesis. Experience with More ❯
Milton Keynes, Buckinghamshire, United Kingdom Hybrid / WFH Options
Banco Santander SA
Previous experience developing, testing, and deploying data pipelines, data lakes, data warehouses, and data marts using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda. Experience of major operating platforms and their linkage, connectivity functions and issues. Cloud Security - Experience/skills of addressing concept issues More ❯
like Python, Scala, Spark, and SQL. Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as: AWS: EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB Azure: Data Factory, Synapse, Databricks, Event Hubs, Logic Apps, Cosmos DB Understanding of best practices for end-to-end More ❯
tools like Apache Atlas or AWS Glue Data Catalog. Experience integrating data systems with machine learning workflows. Experience with services like AmazonEMR, Redshift Spectrum, and AWS Data Pipeline. If you’re an experienced Data Architect with a strong background in AWS and data solutions, we’d More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Hire Tech UK
and cloud engineering. You'll work within an agile team to design scalable solutions that power business-critical insights. 🛠️ Tech Stack Includes: Cloud: AWS (EMR, Lambda, Glue, Athena) Big Data: Apache Spark (Scala or PySpark), Kafka, Airflow Languages: Python, Scala, SQL Infrastructure: Terraform, CloudFormation DevOps: Git, Jenkins, Docker, CI More ❯
SQL queries and good understanding of data model, python knowledge is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using container platforms About S&P Global Ratings At S&P Global Ratings, our More ❯
Northampton, Northamptonshire, East Midlands, United Kingdom Hybrid / WFH Options
Data Inc. (UK) Ltd
for Search: When reviewing CVs, please look for relevant technologies such as: Spark, Hadoop, Big Data, Scala, Spark-Scala, Data Engineer, ETL, AWS (S3, EMR, Glue ETL) . Interview Process: the client will conduct an interview round that includes a Scala coding exercise . The candidate will be expected More ❯
Sr. Specialist SA, Analytics, WWSO-Startup Job ID: 2834888 | Amazon Web Services Australia Pty Ltd Are you a customer-obsessed builder with a passion for helping customers achieve their full potential? Do you have the business savvy, Database background in the Startup space, and sales skills necessary to … aligned teams in the field to solve them. Technical experience across analytical services such as Kafka, Amazon Kinesis, OpenSearch, AmazonEMR, AWS Glue, PostgreSQL and an understanding of Open Table Formats (Hudi, Delta and Iceberg). A day in the life Learn more about being … a Solutions Architect at Amazon Web Services: here . About the team The WWSO team helps customers adopt our newest and most advantageous technologies. We are technology specialists. The WWSO Startup team is a team dedicated to helping Startups scale quickly and cost-effectively on AWS. We want More ❯
processes and database management systems (e.g., MySQL, PostgreSQL, MongoDB) Hands-on experience with AWS services for data processing, storage and analysis (e.g., S3, Redshift, EMR, Glue) Familiarity with programming languages such as Python or Java Understanding of data warehousing concepts and data modeling techniques Experience working with big data More ❯
Kafka and Kinesis DataHub ML Flow and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy More ❯
Additional Qualifications: Domain knowledge in Financial Industry and Capital Markets is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using docker and containers. Python experience is a plus. About S&P Global Ratings More ❯
Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK Our AWS Professional Services consultants deliver IT infrastructure and application architecture guidance, lead proof-of-concept projects, perform enterprise portfolio assessments, review operational best practices and conduct skills transfer workshops. AWS … use AWS services such as AmazonElastic Compute Cloud (EC2), S3, AWS Glue, DynamoDB NoSQL, Relational Database Service (RDS), Elastic Map Reduce (EMR) and Amazon Redshift. Solutions: Deliver on-site technical engagements with partners and customers. This includes participating in pre-sales on-site visits … in working with data lakes, modern data architectures, Lambda type architectures Proficiency in writing and optimizing SQL Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS. Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) Ability to write code in Python, Ruby, Scala or More ❯
problems in a challenging and fun environment, using some of the latest Big Data open-source technologies like Apache Spark, as well as Amazon Web Service technologies including ElasticMapReduce, Athena, and Lambda to develop scalable data solutions. About You: Here's what we’re looking for: The More ❯
preferred; other languages include Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda, etc.). Excellent communication, organization, and prioritization skills, with a strong ability to deliver results within tight timelines. Passionate about working with small More ❯
with other languages including Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda etc.). Excellent communication, organisation and prioritisation skills, and have a strong ability to deliver results within tight timelines. Passionate to work with More ❯
Preferred Qualifications: Domain knowledge in Financial Industry and Capital Markets is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.). Experience in DevOps development and deployment using Docker and containers. Python experience is a plus. About S&P Global More ❯
and unstructured data from multiple sources, ensuring efficient data ingestion, transformation, and storage. Develop and optimize data lake and data warehouse solutions using Amazon S3, Redshift, Athena, and Lake Formation. Implement data governance, security, and compliance best practices, including IAM roles, encryption, and access controls. Monitor and optimize … cloud technologies. Proficiency in Python, PySpark, SQL, and AWS Glue for ETL development. Hands-on experience with AWS data services, including Redshift, Athena, Glue, EMR, and Kinesis. Strong knowledge of data modeling, warehousing, and schema design. Experience with event-driven architectures, streaming data, and real-time processing using Kafka More ❯