About the role

We are seeking a project team of skilled Software Engineers to work as project consultants in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.
Location: U.S.-based experts only
Engagement: Part-time, project-based expert evaluation work Work Type: Remote Contributors will design and evaluate realistic software engineering tasks, including bug resolution, feature implementation, refactoring/migration, and test generation. Work includes both creating complex coding scenarios and reviewing peer submissions for quality and accuracy. This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).
Responsibilities: Contributors will:
  • Design and implement multi-file coding tasks across bug fixing, feature development, refactoring, and testing
  • Write clear natural-language specifications and reference implementations
  • Develop and extend unit and integration test suites
  • Review peer-generated tasks for correctness, clarity, and realism
  • Identify edge cases, ambiguities, and potential failure modes
  • Ensure alignment between specifications, code, and expected outputs
  • Expected Outcomes:
  • High-quality, production-realistic coding tasks
  • Complete and correct reference implementations
  • Robust test coverage and validation artifacts
  • Structured, actionable peer review feedback
Qualifications:
  • Advanced professional written proficiency in English3–5 years of professional software engineering experience
  • Strong proficiency in Python and JavaScript/TypeScript; working knowledge of Java, C#, or GoBackend or full‑stack development experience in production systemsExperience with testing frameworks (e.g., pytest, Jest, JUnit, xUnit, Go testing)
  • Proven ability to debug and navigate large, multi‑file codebases
  • Experience with code reviews, refactoring, and production migrations
  • Prior experience with data annotation, evaluation, or structured labeling for AI/ML systemsExperience defining solution trajectories and writing evaluation rubrics
  • Familiarity with LLM evaluation, prompt design, or benchmarking workflows
LinkedIn Data Security and Privacy Notice:https://legal.linkedin.com/content/dam/legal/

Matching similar jobs

JOB OVERVIEW

Experience level

Senior

Location

Detroit, MI

Occupation

Software Developers

Industry

Custom Computer Programming Services

Posted

2 days ago

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE