Data Engineer

Financial Services firm looking for a heavy hitting Data engineer where some of your Key Responsibilities will include:

• Develop new pipelines based on business needs or to improve the current system.
• Maintain existing data pipelines, anticipating and addressing issues promptly and professionally.
• Monitor critical processes effectively.
• Collaborate with various business units to define project requirements for pipelines and ETL.

Essential Skills and Qualifications

• Technical Proficiency: Expertise in SQL (Postgres, Athena Presto SQL) and proficiency in Python for building and managing data pipelines.
• AWS Experience: Skilled in using serverless architecture, including Lambda, Glue, Step Functions, SNS, SQS, and S3.
• Data Engineering Expertise: Over 2 years of experience in data engineering, creating data pipelines in a cloud environment, with a solid understanding of best practices.
• Effective Communication: Ability to clearly convey and gather requirements from non-technical business stakeholders.
• Deployment and Documentation: Proficient in controlled deployment and documentation practices using GitHub, ensuring changes are tested, approved, and easily understood by all.

Desirable Skills

• Infrastructure Automation: Experience with Terraform for new infrastructure and CloudFormation for legacy systems.
• iPaaS Knowledge: Familiarity with Integration Platform as a Service, particularly MuleSoft, is a plus.