1 to 25 of 74 Slurm Workload Manager Jobs in the UK

looking for an AI Infra engineer to join our growing team. We work with Kubernetes, Slurm, Python, C++, PyTorch, and primarily on AWS. As an AI Infrastructure Engineer, you will be partnering closely with our Inference and Research teams to build, deploy, and optimize our large-scale AI training … inference clusters. Responsibilities Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads Manage and optimize Slurm-based HPC environments for distributed training of large language models Develop robust APIs and orchestration systems for both training pipelines and inference services Implement resource scheduling ...

vendors including NVIDIA and OEMs to resolve issues quickly and feed production learning back into design. Run the production HPC layer day to day: Slurm, GPU drivers and the CUDA stack, InfiniBand fabrics (subnet management, monitoring, firmware) and the parallel storage clusters depend on. Tune clusters for AI training … experience operating NVIDIA GPU infrastructure at scale, including drivers, CUDA, DCGM and diagnosing GPU hardware faults. Proven experience running production HPC clusters with a workload manager such as Slurm. Strong practical InfiniBand experience, including subnet management, RDMA, fabric monitoring and fault-finding. Experience benchmarking and tuning distributed workloads ...

evaluation. Education: PhD in AI/ML/CS or a related field. Beneficial knowledge: Distributed model training & infra: PyTorch DDP and FSDP, Kubeflow, Slurm, Kubernetes, and a large‐scale training framework such as DeepSpeed, Megatron or TorchTitan. LLM/Agent tooling: evaluation harnesses, prompt optimisation, agent frameworks. Inference ...

discoverability, including how structure and metadata affect retrieval. Experience defining information architecture for a large or fragmented content estate. Experience documenting HPC or ML workload schedulers such as Slurm, Slurm on Kubernetes (SUNK), or Kueue, including day-2 operations such as upgrades, node drain states, and control ...

environment. This is not a hybrid/remote role and will require full-time site attendance. Key Responsibilities: Assist in managing HPC clusters utilising Slurm workload manager. Perform entry-level system administration tasks on RHEL and other Linux-based systems under guidance. Help support and maintain license servers … Linux system administration. Familiarity with at least one scripting language (e.g., Bash, Python). Interest in high-performance computing and willingness to learn Slurm, xCAT, and Ansible. Strong problem-solving skills and attention to detail. Good communication and collaboration skills. Ability to work independently with mentorship and as part ...

support production platforms with proactive approach to problem‐solving and reliability Nice to Have Experience with high‐performance computing (HPC) environments in Azure, including Slurm workload scheduling Familiarity with Kubernetes, Flux, Helm and GitOps approaches to infrastructure and application delivery Experience developing or supporting internal developer platforms ...

translate complex challenges into practical solutions. It would also be great if you bring: Experience with high-performance computing (HPC) environments in Azure, including Slurm workload scheduling. Familiarity with Kubernetes, Flux, Helm and GitOps approaches to infrastructure and application delivery. Experience developing or supporting internal developer platforms ...

defects. Perform Software and firmware testing for any fixes, upgrades, security patch. Position requirements: Hands-on experience with HPC tools and schedulers such as Slurm and PBS Pro, as well as Confluent Solid scripting and automation skills using Ansible, Bash, and Python Experience with distributed storage systems and file ...

environments using containers (e.g. Docker). Scale processing across distributed cloud warehouses/storage via container orchestration (e.g. Kubernetes), High-Performance GPU Compute (e.g. Slurm), or distributed compute frameworks (e.g. Spark, Ray). Contribute to an engineering culture that values maintainability, testing, robust system design, and deep collaboration ...

Experience: Experience leveraging Kubernetes for application deployment, and familiarity with distributed computing frameworks (e.g., Ray, Spark), or specialised batch schedulers/resource managers (e.g., Slurm, Volcano, Kueue). Demonstratedexpertisewith specialised serving engines (e.g.,vLLM,SGLang) or techniques for deploying models in resource-constrained or high-throughput environments. Familiarity withGitOpsand ...

large-scale Linux environments, ensuring high availability, performance, security, and resilience. Architecting and supporting High Performance Computing (HPC) platforms, including compute, storage, networking, workload scheduling, and user environments. Designing, deploying, and managing container and orchestration platforms to support modern application delivery. Acting as a Linux Infrastructure Solutions Architect, driving … platform technologies. What you'll bring: Extensive experience administering enterprise Linux environments (RHEL, Rocky Linux, Ubuntu, or equivalent). Strong knowledge of HPC infrastructure, workload management ideally using Slurm, and performance optimisation. Proven experience designing and delivering Linux infrastructure and platform architectures. Strong understanding of Linux security, virtualisation ...

high-throughput file systems (e.g. Everpure, WEKA, VAST, NetApp) sized for training and checkpointing workloads. AI Software, MLOps & Generative AIOrchestration & containers: Kubernetes, Docker, Slurm, Run:ai or equivalent GPU scheduling platforms. ML frameworks: PyTorch and TensorFlow at a working, hands-on level. Distributed training: Horovod, DeepSpeed, Megatron … continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command Manager for GPU job scheduling; Kubernetes-native GPU scheduling including device plugins ...

Networking reliability experience, particularly low‐latency networking and InfiniBand Platform engineering background (Kubernetes, infrastructure‐as‐code, internal developer platforms) HPC infrastructure exposure (for example, Slurm‐managed clusters or research computing environments) ChatOps and ITSM integration experience (for example, Slack/Teams bots, ServiceNow or Jira Service Management APIs) Benefits ...

reliability of Linux-based enterprise and high-performance computing platforms. The role will provide hands-on technical ownership across Linux operating systems, HPC compute, workload scheduling and associated storage and network services.A major focus will be the operation of cloud and co-located HPC platforms. The position requires strong … Linux engineering experience, practical knowledge of HPC environments, including NVIDIA Base Command Manager, Azure CycleCloud and SLURM. The ability to diagnose complex cross-platform issues, and the confidence to work independently while acting as a senior technical resource for colleagues is also essential. This role does not include formal ...

Lenovo in the United Kingdom (Hampshire) is hiring an HPC System Administrator to manage data center infrastructure, Linux/Unix environments, and monitoring to ensure uptime and security. This role blends on-site and remote ...

communication skills and the ability to work effectively under pressure in a customer-facing environment. Desirable Experience Cluster management platforms such as Bright Cluster Manager, HPE Performance Cluster Manager (HPCM) or Cray Systems Manager (CSM). Batch job schedulers such as SLURM ...

continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command Manager for GPU job scheduling; Kubernetes-native GPU scheduling including device plugins ...

support a large scale computing environment used for data-intensive research, modelling and AI workloads. You will work across Linux compute environments, GPU infrastructure, Slurm, and containerisation with Docker or Singularity, driving automation and platform improvements to better serve researchers. #J-18808-Ljbffr ...

first engineers, with a path to technical leadership. Production experience in at least two of: job scheduling or batch systems (Slurm, PBS, LSF, or your own); orchestration (Kubernetes internals and operators, Nomad, Ray); HPC clusters; virtualisation (KVM, Firecracker, Cloud Hypervisor, QEMU). Tell us what broke ...

bioinformatics tools for genome assembly, annotation and variant analysis. Familiarity operating within Linux environments, including operating within HPC and/or cloud environments (e.g. SLURM, OCI). Experience applying machine learning methods to genomic and transcriptomic data, with an understanding of different ML approaches and their suitability for different ...

leases, retries, and the failure modes that only show up under load. Experience with a scheduler, workflow engine or job queue - Temporal, Airflow, Celery, Slurm, or one you built - or with event-driven systems that react to changes in state. A habit of settling design questions in writing, with ...

openstack HPC stackhpc community news AI azimuth ironic monitoring deployment baremetal kolla-ansible ansible networking kayobe kolla infrastructure kubernetes slurm monasca scheduling newsletter mpi virtualisation beegfs cloudkitty sriov cluster training ciuk operations recruitment network overcloud slinky ceph data github ucx galaxy cloud-init storage gpu grafana cuda vm kata … following additional technologies is always beneficial: O/S : Rocky Linux, Ubuntu Storage : Ceph, NFS Networking : Ethernet, Infiniband, SRIOV Compute and Workloads : Kubernetes, Slurm Our technology stack is constantly evolving to meet market and user requirements. So we will help you get up to speed as required. Flexible working ...

seeking an experienced HPC Engineer to validate and tune large-scale NVIDIA GPU clusters, owning the HPC layer in production. You will work on Slurm, NCCL, InfiniBand and storage, ensuring performance meets strict criteria before handover to customers. This remote role reports to the Head of Infrastructure and offers ...

GenAI to improve monitoring, management, and efficiency of large compute platforms. You will collaborate with cross-functional teams, deploy on Kubernetes, and work with Slurm, LSF, Spark, Ray, and Symphony in cloud environments to deliver scalable, secure technologies #J-18808-Ljbffr ...

scale inference; multi-tenant serving or SLA-driven infrastructure; background at a hyperscaler, frontier AI lab or large-scale distributed inference system; Kubernetes/Slurm; interest in energy markets, grid systems or sustainability-focused compute Competitive salary and eligibility for equity Biannual bonus scheme Fully expensed tech to match ...