AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI‑generated responses against detailed policy rubrics, assessing safety, truthfulness, fairness and alignment with community guidelines.
• Identify and report systematic flaws, bias, hallucinations or policy gaps to product and engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and create “golden sets” of prompts and ideal responses.
• Participate in adversarial testing (red‑team) to expose vulnerabilities such as jailbreak attempts.
• Explain rating decisions to machine‑learning engineers, helping adjust model behavior.
• Handle complex edge cases where policy application is ambiguous, including satire and emerging risks.

Required profile

• Minimum 3 years of experience in Trust & Safety operations, content policy, risk analysis or legal/compliance review.
• Deep understanding of content moderation policies covering hate speech, harassment, misinformation and graphic violence.
• Proven emotional resilience and self‑care strategies for exposure to disturbing content.
• Strong written communication skills to explain AI errors to technical and policy audiences.
• Ability to follow complex scoring rubrics with high consistency and accuracy.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Experience using dashboards and spreadsheet tools for data analysis.
• Ability to work with specialized content‑review platforms.