Software Engineer, Applied AI, Model Quality
googleBrooklyn, NY
Software Engineer, Applied AI, Model Quality
googleBrooklyn, NY
APPLY NOW (opens in a new tab)yesterday
About the role
Overview:
In this role you will help build both human-powered and LLM-driven evaluation systems to measure model performance across grounding, coherence, safety, and helpfulness. You’ll work on platforms to run evaluations over diverse models and datasets, and translate results into actionable insights for product and research teams. You will collaborate across functions to improve evaluation processes and scale QA capabilities for Google Pics within Google Workspace. You will influence model capability roadmaps and contribute to a culture of fast learning and high-ambition delivery. This role offers the chance to shape AI-supported visual editing at scale through GemPix and Gemini. Compensation / Benefits bonus target equity benefits
Responsibilities:
Build human-powered and LLM-powered evaluation systems to assess model performance Define and implement evaluation metrics for grounding, coherence, safety, and helpfulness Utilize platforms to run evaluations across models and datasets Provide actionable insights from evaluations to improve model quality with cross-functional teams Create tools and systems to increase evaluation efficiency and effectiveness Collaborate with research and cross-functional groups to align on model capability roadmaps
Key requirements:
Bachelor 5 years of experience with software development in one or more programming languages 3 years of experience testing, maintaining, or launching software products 1 year of experience with software design and architecture Experience integrating generative AI tools or LLM interfaces into workflows cross-functional collaboration leadership qualities strong communication ML design and ML infrastructure model deployment and evaluation data processing
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Brooklyn, NY
Occupation
Software Developers
Industry
Software Publishers
Posted
yesterday
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)