Skip to main content

About the role

Overview: In this role you will design and optimize Scale’s internal distributed framework for LLM training and inference, enabling researchers and MLEs to train, evaluate, and curate data at scale. You’ll collaborate with ML teams to accelerate research and integrate cutting-edge technologies, shaping the next generation of AI models and data pipelines. You will work across the ML organization to build a robust platform that supports the full ML lifecycle, from training to evaluation. This is a chance to contribute to scalable AI systems that power real-world deployments and research. Compensation / Benefits Base salary Equity Comprehensive health, dental and vision coverage Retirement benefits Learning and development stipend Generous PTO
Responsibilities: Build, profile and optimize the training and inference framework Collaborate with ML teams to accelerate research and development and enable next-generation models and data curation Research and integrate state-of-the-art technologies to optimize the ML system Contribute to building and refining the foundation platform for ML research and development
Key requirements: Strong excitement about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills, proficient in CUDA, PyTorch, transformers, flash attention, etc. Strong written and verbal communication skills, ability to operate in a cross-functional team environment Cross-functional collaboration Effective communication Problem-solving mindset CUDA PyTorch transformers

Matching similar jobs

JOB OVERVIEW

Experience level

Lead

Location

Brooklyn, NY

Occupation

Computer Systems Engineers/Architects

Industry

Software Publishers

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)