Principal Kafka/Flink Infrastructure Architect

*Hybrid, 3 days onsite, 2 days remote*

*We are unable to sponsor as this is a permanent Full time role*

A prestigious company is looking for a Principal Kafka/Flink Infrastructure Architect. This architect will drive the architectural vision of the companies Real Time data streaming computing. They will need expert level expertise with Kafka, Flink, and have a heavy Java application development background. This architect will work on streaming of both on prem and AWS cloud environments.

Responsibilities:

• Collaborate with cross-functional teams to design, create and review software application architectures specifically tailored for streaming use cases.
• Ensure fault tolerance, scalability, and low-latency processing in streaming applications.
• Drive optimization of streaming application performance by fine-tuning configurations, monitoring resource utilization, and identifying bottlenecks.
• Drive Implementation of best practices for efficient data serialization, compression, and network communication.
• Create and maintain architecture documentation, including system diagrams, data flow, and component interactions.
• Evaluate and recommend tools and frameworks that enhance the performance and reliability of our streaming systems.
• Stay informed about industry trends related to Kafka, Flink, and Kubernetes.

Qualifications:

• Bachelor's or Master's degree in an engineering discipline
• 10+ years of experience architecting of mission critical Cloud and On-Prem Real Time data streaming and event-driven architectures
• 10+ years of experience with Java
• 5+ years of specific Kafka and Flink experience
• 5+ years of Kubernetes experience
• Expert level knowledge of Kafka
• Expert level knowledge of Flink
• Ability to execute spikes and provide code samples demonstrating best practices when developing solutions on Kafka and Flink.
• Experience with DevOps tools, eg Terraform, Ansible, Jenkins, Kubernetes, Helm and CI/CD pipeline etc.