Confidential company via Go
AI Agentic Workflow Reviewer
- LocationUnited States
- TypePart-time
- Posted2026-10-14
- Valid through2026-10-28
- BudgetUSD 50–55 / hour
- Long-termYes
About this task
Review multi-step AI agent task trajectories against rubric-based criteria for task success, safety, and policy adherence. Evaluate whether agents respect user agency, informed consent, and privacy when handling sensitive or personal data. Work in isolated test environments and verify resets between test runs to prevent cross-contamination. Flag and escalate safety-relevant or ambiguous findings through defined escalation paths.
Requirements: Bachelor's degree or equivalent practical experience; 2–5+ years in quality review, QA/QC, trust and safety, content moderation, data annotation, or a similarly judgment-intensive review role. Strong written communication and comfort with ambiguity and rubric-based decision-making. Baseline understanding of AI/ML concepts and how AI agents complete tasks is helpful.