About the role

Detail-oriented and analytical, the remote AI Voice Evaluation Specialist will evaluate the performance of AI models through real-time voice-based conversations, comparing their responses and providing structured evaluations based on defined quality criteria.
Key responsibilities: Conduct comparable conversations with two different AI models, maintaining consistency in scenarios and interactions Evaluate each model across five defined dimensions and identify relevant error clusters during the conversations Write detailed rationales for model preferences, referencing specific observations from the evaluationsRequired qualificationsBachelor's Degree Strong attention to detail with the ability to notice subtle differences in conversational quality Excellent listening and comprehension skills Strong written communication skills for clear and objective explanations Familiarity with AI assistants, voice-based AI, or conversational systems

Matching similar jobs

JOB OVERVIEW

Experience level

Senior

Location

New York, NY

Occupation

Speech-Language Pathologists

Industry

All Other Professional, Scientific, and Technical Services

Posted

yesterday

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE