Azure Data Platform Engineer

Job Title: Azure Data Platform Engineer
Location: Edinburgh, Scotland - Hybrid, 2 days On-site
Job Type: [Full-Time/Permanent]

Job Description:

We are seeking an experienced Azure Data Platform Engineer to join our dynamic team. You will be responsible for managing the platform and its integration with enterprise services, ensuring robust, secure, and scalable processes. If you have strong problem-solving skills, a solid background in data engineering, and experience with cloud services and DevOps practices, we'd love to hear from you.

Key Responsibilities:

Manage and integrate data platforms hosted on Azure with enterprise services (eg, ServiceNow, CyberArk, Azure DevOps).
Identify and manage backlogs to support scalability, performance, security, resilience, and observability.
Design, develop, and document efficient solutions and frameworks for organizational scalability.
Ensure the platform is secure, robust, and compliant with enterprise standards.
Leverage Infrastructure as Code (IaC) using Terraform and manage environments.
Implement and optimize development life cycles using CI/CD tools and techniques (Azure DevOps, Git).
Monitor, optimize, and scale Apache Spark jobs to meet performance and scalability needs.
Collaborate with cross-functional teams in a DevOps and Agile environment.

Key Skills and Experience:

Strong understanding of data engineering concepts and big data platforms.
Solid experience integrating Azure-hosted platforms with enterprise capabilities.
Expertise in cloud services, particularly Microsoft Azure, and its integration with Microsoft Fabric.
Strong knowledge of DevOps practices and tools, including CI/CD pipelines (Azure DevOps, Git).
Experience managing infrastructure using Infrastructure as Code (Terraform, APIs).
Deep understanding of Apache Spark architecture and optimizing Spark jobs.
Familiarity with cybersecurity best practices and enterprise platform compliance.
Experience working in a DevOps and Agile framework.