AI Voice Evaluation Specialist
virtual vocationsNew York, NY
AI Voice Evaluation Specialist
virtual vocationsNew York, NY
yesterday
Industries
All Other Professional, Scientific, and Technical ServicesTranslation and Interpretation ServicesOther Scientific and Technical Consulting ServicesAbout the role
Detail-oriented and analytical, the remote AI Voice Evaluation Specialist will evaluate the performance of AI models through real-time voice-based conversations, comparing their responses and providing structured evaluations based on defined quality criteria.
Key responsibilities:
Conduct comparable conversations with two different AI models, maintaining consistency in scenarios and interactions
Evaluate each model across five defined dimensions and identify relevant error clusters during the conversations
Write detailed rationales for model preferences, referencing specific observations from the evaluationsRequired qualificationsBachelor's Degree
Strong attention to detail with the ability to notice subtle differences in conversational quality
Excellent listening and comprehension skills
Strong written communication skills for clear and objective explanations
Familiarity with AI assistants, voice-based AI, or conversational systems
Matching similar jobs
JOB OVERVIEW
Experience level
Senior
Location
New York, NY
Occupation
Speech-Language Pathologists
Industry
All Other Professional, Scientific, and Technical Services
Posted
yesterday
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE