Skip to main content

About the role

Role overview: Apply hands-on Bash and software engineering knowledge to evaluate and improve AI-generated technical guidance. You'll test the model against realistic programming tasks, judge whether its reasoning and code are sound, and document failures in a way that supports repeatable evaluation.
Responsibilities: Work through software engineering problems and technical scenarios with an AI model, using Bash where appropriate. Evaluate answers involving algorithms, data structures, software architecture, cloud infrastructure, and systems programming. Review the model's handling of asynchronous work, REST API integration, memory management, object-oriented design, secure coding, and distributed-system debugging. Assess code for logical correctness, fluency, quality, and clarity. Capture reproducible error cases and suggest improvements to prompts and evaluation metrics.
Requirements: Practical Bash coding experience and a solid software engineering background. Clear technical writing and the ability to explain your reasoning step by step. A degree in computer science, software engineering, or a related technical field is preferred.
Nice to have: Technical writing experience or open-source contributions. Experience across backend or frontend development, cloud infrastructure, or systems programming. Benefits and work setup Remote contract work; contractors provide a secure computer and high-speed internet. The stated rate is $8–$65 per hour, with the final rate based on experience, expertise, and location. Contractor benefits such as health insurance and paid time off are not provided.

Matching similar jobs

JOB OVERVIEW

Salary

$8–$65 per hour

Experience level

Senior

Location

New York, NY

Occupation

Software Developers

Industry

Custom Computer Programming Services

Posted

yesterday

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)