Skip to main content

About the role

Overview: In this role you will lead the development of LLM inference infrastructure and define the architectural direction for large-scale ML training and real-time inference at Amazon Ads. You will work with applied scientists to design end-to-end ML pipelines from training to deployment, ensuring reliable performance at internet scale. You’ll influence cross-team ML infrastructure practices and mentor engineers, accelerating GenAI workloads for Sponsored Products & Brands. This is a high-impact opportunity to shape ad relevance at scale with responsible AI. Compensation / Benefits health insurance (medical, dental, vision) 401(k) matching RSUs paid time off parential leave sign-on payments
Responsibilities: Lead the development of LLM inference infrastructure for GenAI workloads at scale and define technical strategy Own architectural direction for large-scale ML training and real-time inference systems to improve scalability and efficiency Collaborate with applied scientists to design end-to-end ML pipelines from training to deployment Influence cross-team ML infrastructure practices and contribute to architectural decisions Make principled tradeoffs on complex GenAI problems and deliver results independently Mentor engineers and act as a technical resource for ML infrastructure expertise
Key requirements: 5+ years of non-internship software development experience 5+ years of programming experience in at least one language 5+ years of design or architecture leadership for new or existing systems Experience as a mentor, tech lead, or leading an engineering team Bachelor in Computer Science or equivalent (preferred) mentoring leadership strong communication large-scale ML infrastructure LLM inference infrastructure real-time inference systems

Matching similar jobs

JOB OVERVIEW

Experience level

Lead

Location

Seattle, WA

Occupation

Software Developers

Industry

Software Publishers

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)