Senior AI Safety Clinical Reviewer – TPM

Job Description

We are looking for a Senior AI Safety Clinical Reviewer to ensure clinical quality in our AI safety evaluations. You will: - Establish and refine clinical QA and adjudication workflows across evaluation projects, identifying areas for improvement. - Train and onboard expert raters on safety protocols, shared standards, and our evaluation philosophy. - Conduct calibration sessions to reduce disagreement and enhance consistency among raters. - Serve as the main point of contact for complex or high-risk conversations. - Provide adjudicated, high-confidence evaluation datasets for an initial pilot project. - Demonstrate consistent clinical judgment that aligns with our safety standards. - Design efficient workflows that can be independently managed. - Oversee clinical quality systems across multiple concurrent AI safety evaluation programs. - Develop comprehensive training, certification, and feedback mechanisms for expert evaluators. - Continuously improve inter-rater reliability, rubric clarity, and reviewer consistency. - Contribute to shaping our long-term strategy for emotionally grounded AI safety QA.

Qualifications

To be successful in this role, you should have: 1. 5+ years of experience in clinical supervision, training, or peer review. 2. Experience in clinical research operations or qualitative review. 3. Experience with trust & safety, human-centered AI, or behavioral science workflows. 4. Experience in AI evaluation, annotation QA, or rubric-based assessment systems. 5. Experience coaching clinicians or experts to apply shared standards in high-stakes domains. 6. Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent applied experience. 7. Deep familiarity with psychological stress, trauma, crisis response, or mental health frameworks. 8. Expertise evaluating emotionally complex conversations for safety, appropriateness, and harm risk. 9. Strong judgment in ambiguous edge cases involving distress, vulnerability, or sensitive disclosures.

Benefits

Our benefits include: - 100% company-funded health, dental, and vision insurance for full-time employees. - 401k plan, well-being programs, and flexible paid-time off.