Multilingual AI Response and Rubric Evaluator

About this task

Evaluate multilingual AI reference responses and scoring rubrics. Use detailed guidelines to identify quality issues, correct critical errors, and help improve how advanced AI systems are assessed.

Responsibilities:
- Review AI-generated reference responses for quality and accuracy.
- Evaluate and improve scoring rubrics.
- Identify and correct critical P0 issues.
- Follow detailed annotation guidelines and meet project quality requirements.

Requirements:
- Native-level fluency in one of the available project languages.
- Strong reading comprehension, written communication, and attention to detail.
- Basic familiarity with medical, financial, and legal topics.
- Ability to follow detailed instructions carefully.
- Computer with a reliable internet connection.

Project details:
- Location: Remote within eligible language and location options.
- Schedule: Flexible; task availability may vary.
- Compensation: Fixed hourly rate; exact rate depends on selected language and location.