Skip to main content

About the role

Red Hat, Inc. is seeking a Senior Machine Learning Engineer to lead the design and optimization of vLLM-based inference systems on hybrid Boston workloads. You will implement high-performance Python, C++, CUDA, and Triton code for production-scale LLM serving, focusing on latency, throughput, and cost efficiency. The role requires deep GPU optimization expertise, strong collaboration with open-source communities, and the ability to guide performance-driven architecture and reviews across teams.

Matching similar jobs

JOB OVERVIEW

Experience level

Lead

Location

East Boston, MA

Occupation

Computer Systems Engineers/Architects

Industry

Computer Systems Design Services

Posted

8 days ago

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)