
Data Annotator | Remote
Job Description
Posted on: May 21, 2026
Generalist Evaluation Expert Remote | $60-$200 per hour | Flexible / Project-BasedQuick Snapshot Evaluate model-generated responses and provide structured, high-quality written feedback Work on frontier language model evaluation and research-focused projects Independent contractor role with fully remote, flexible scheduling Weekly payouts via Stripe or Wise based on completed work Strong emphasis on analytical thinking, reasoning quality, and written clarity Tasks require strict adherence to structured evaluation guidelines and rubrics No automated writing tools allowed; work must be completed independently Requirements Evaluate and compare model-generated outputs using structured evaluation criteria Identify reasoning gaps, implicit assumptions, inconsistencies, and nuanced errors Produce clear, precise, and well-supported written rationales Apply detailed evaluation rubrics with strict attention to accuracy and consistency Demonstrate strong critical reading skills and independent judgment in assessments Strong analytical thinking and written communication skills; top-tier academic background preferred Maintain high-quality standards while working fully independently without automated writing tools Easy apply to proceed.
Apply now
Please let the company know that you found this position on our job board. This is a great way to support us, so we can keep posting cool jobs every day!
RemoteITJobs.app
Get RemoteITJobs.app on your phone!

Software Engineer - YAML Experience

Senior Software Engineer, AI-Assisted Full Stack Development

Population Health Informaticist

Data Centre Design Engineer

