Senior Software Engineer, AI Compute Scheduling
nvidiaDurham, NC
Senior Software Engineer, AI Compute Scheduling
nvidiaDurham, NC
today
Occupations
Computer Systems Engineers/ArchitectsSoftware DevelopersComputer and Information Research ScientistsAbout the role
Overview:
In this role you design and operate scheduling for NVIDIA’s large AI GPU fleets, spanning Slurm and Kubernetes. You will own parts of the scheduling stack, contribute to open-source platforms, and enable researchers to run thousands of GPU jobs efficiently. You collaborate across platform, storage, and research teams to optimize throughput, fairness, and reliability. This is a hands-on role with impact on real workloads and the chance to shape scalable AI compute. Compensation / Benefits equity benefits base salary within listed ranges opportunity to impact research workloads full-time role location flexibility implied by multiple US sites
Responsibilities:
Design and build scheduling for large GPU fleets on Slurm and Kubernetes Develop policy layer for fair share, quotas, and allocations across research teams Run Slurm as a cloud-native service on Kubernetes and extend batch scheduling (Kueue) for training, RL, sandboxes, and inference Build services around the scheduler (reservation automation, node-health-aware placement, workflow orchestration, APIs) Measure and optimize GPU occupancy, waste, fairness, and time-to-start; use data to guide next builds Own reliability for built components (on-call, incident analysis, fixes) Collaborate across teams and contribute to Slurm, Kubernetes, and related open-source projects
Key requirements:
BS or MS in CS/CE/EE or related field, or equivalent experience 6+ years building production systems software Deep experience with at least one batch/cluster scheduler (e.g., Slurm, Kueue, Volcano, KAI, YuniKorn) and understanding of internals Strong programming in Go, C/C++, and Python for tooling Hands-on Kubernetes experience: controllers/operators, CRDs, scheduling, resource management Solid Linux systems knowledge: containers, cgroups, networking, load debugging Proven track record of owning a production service and improving it Clear written and spoken communication with engineers and researchers strong communication cross-functional collaboration ownership mindset Go, C, C++, Python Kubernetes (controllers, operators, CRDs) Slurm, Kueue, Volcano, KAI or similar schedulers
Matching similar jobs
JOB OVERVIEW
Experience level
Senior
Location
Durham, NC
Occupation
Computer Systems Engineers/Architects
Industry
Software Publishers
Posted
today
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)