Overview

AI Evaluation Specialist – Analytical Review & Structured Feedback | Remote Jobs in United States at Crossing Hurdles

Title: AI Evaluation Specialist – Analytical Review & Structured Feedback | Remote

Company: Crossing Hurdles

Location: United States

Position: Generalist Expert

Type: Hourly contract

Compensation: $60 $200/hour

Location: Remote

Commitment: Part-time or full-time, flexible based on project needs

Role Responsibilities

  • Evaluate AI-generated responses for accuracy, reasoning, and clarity
  • Provide structured, detailed written feedback on model outputs
  • Identify gaps in logic, implicit assumptions, and reasoning flaws
  • Apply evaluation guidelines consistently across tasks
  • Write clear, evidence-based rationales beyond surface-level observations
  • Ensure high-quality, unbiased, and precise assessments

Requirements

  • Bachelor s degree preferred from a top-ranked university
  • Strong analytical thinking and critical reading skills
  • Strong written communication with clear and precise reasoning
  • Ability to identify nuanced issues in complex responses
  • Strong attention to detail and consistency in evaluations
  • Ability to work independently and follow structured guidelines
  • Native-level English proficiency
  • Ability to complete tasks without using AI writing tools

Application Process (Takes 20 Mins)

  • Upload your resume.
  • Complete an interview.
  • Submit a short form.
Upload your CV/resume or any other relevant file. Max. file size: 800 MB.