AI Evaluation Specialist | $50/Task

Experience: Professional / Domain Expertise Required

Job Type: Contractor

Schedule: Flexible Compensation: $50 per approved task

Role Overview: We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt, test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.

Key Responsibilities: Convert a familiar, complex workflow into a challenging AI prompt. Test the prompt using ChatGPT and identify incomplete or incorrect outputs. Refine the task to better test the model’s reasoning capabilities. Record your screen, camera, and microphone while completing the task. Create a clear and comprehensive grading rubric. Submit the final prompt, failure notes, rubric, and generated output file.

Key Requirements: Strong expertise in a specialized professional or technical workflow. Ability to quickly evaluate the quality and accuracy of outputs in your domain. Strong reasoning, analytical, and problem-solving skills. Access to a laptop or desktop computer. Active ChatGPT account; free tier is acceptable. Comfortable completing a screen-recorded session with audio and video. Selection Process Step 1 – Application / Profile Submission Step 2 – Paid Trial Assessment Step 3 – Submission Review Step 4 – Payment & Future Opportunities