Senior LLM Inference Architect Hybrid/Remote
red hatEast Boston, MA
Senior LLM Inference Architect Hybrid/Remote
Occupations
Computer Systems Engineers/ArchitectsSoftware DevelopersComputer and Information Research ScientistsAbout the role
Red Hat, Inc. is seeking a Senior Machine Learning Engineer to lead the design and optimization of vLLM-based inference systems on hybrid Boston workloads. You will implement high-performance Python, C++, CUDA, and Triton code for production-scale LLM serving, focusing on latency, throughput, and cost efficiency. The role requires deep GPU optimization expertise, strong collaboration with open-source communities, and the ability to guide performance-driven architecture and reviews across teams.
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
East Boston, MA
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
8 days ago
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)