Skip to main content

About the role

Role Overview: Use your machine learning engineering expertise to help improve advanced AI systems by creating rigorous technical tasks, evaluating model-generated work, identifying failures, and defining objective standards for correct solutions. This opportunity is designed for professionals who have already completed substantive AI training, model evaluation, benchmarking, or improvement work.
Key Responsibilities: Create realistic machine learning engineering tasks that challenge advanced AI models. Develop task instructions, reproducible environments, reference solutions, and evaluation criteria. Evaluate model-generated code, experiments, analyses, and other technical deliverables. Identify issues such as data leakage, incorrect validation, unstable training, performance problems, and reproducibility failures.
Qualifications: Prior paid experience training, evaluating, benchmarking, or improving AI systems. Strong practical Python proficiency. Hands-on experience with PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or comparable machine learning tools. Public technical evidence, such as GitHub repositories or public model implementations; Kaggle, DrivenData, AIcrowd, or similar competition results; Hugging Face models or datasets; research publications or technical reports; open-source ML contributions; or public benchmarks, experiments, or technical projects.
Preferred Qualifications: Experience creating AI training tasks, reference answers, rubrics, graders, or benchmark problems. Experience reviewing other AI trainers'' technical submissions. Kaggle Expert, Master, or Grandmaster status, or strong performance in another technical competition. Machine learning publications or open-source contributions. Experience with long-horizon or agentic AI evaluations. Availability to begin immediately. Work Terms Independent contractor engagement. Global, fully remote work arrangement. Flexible schedule with a commitment of at least 15 hours per week. Task availability and completion time may vary. Compensation $60 to $120 per hour equivalent, paid per accepted task. Compensation is output-based. Payment is provided for tasks that meet project specifications and quality requirements.
Application Process: Submit an application that includes your AI training experience and public technical evidence. Complete an AI interview with technical and integrity checks. Complete a hiring manager review. If selected, complete project onboarding and begin your first assigned task.

Matching similar jobs

JOB OVERVIEW

Salary

$60.00 - $120.00 per hour

Experience level

Senior

Location

Jacksonville, AR

Occupation

Data Scientists

Industry

All Other Professional, Scientific, and Technical Services

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)