Domain Expert Reviewer - Geography

Role Overview: We are seeking a highly qualified Geography Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your expertise in geography will help ensure the reliability, consistency, and quality of AI evaluation data across diverse geography-related topics.

Key Responsibilities: Review and validate domain-specific prompts covering physical geography, human geography, countries, capitals, climate, geopolitics, demographics, maps, environmental systems, and related topics. Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines. Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations. Ensure prompts are challenging, relevant, and aligned with project objectives. Provide clear, constructive, and evidence-based feedback to contributors to improve task quality. Maintain consistency across reviews by following established quality standards and review guidelines. Escalate ambiguous or complex cases when necessary and document review findings. Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.

Minimum Qualifications: Master’s degree or higher in any field; degrees in Geography, Human Geography, Physical Geography, Geospatial Science, Environmental Studies, Urban Studies, International Studies, or other geography-related disciplines are preferred. Strong knowledge of geography, including familiarity with countries, regions, cities, physical features, populations, cultures, political boundaries, human geography, and/or physical geography. 3+ years of relevant professional experience, preferably in geographic research, academia, education, geospatial analysis, journalism, publishing, research, geographic content development, or a related field. Excellent written English, research, and analytical skills. Strong attention to detail and ability to assess geographic, regional, demographic, and spatial information accurately. Offer Details:

Commitments Required: 40 hours per week with at least 4 hours PST overlap

Employment type: Contractor assignment (no medical/paid leave) Duration of contract: 8 weeks.