[Remote] Rubrics Writer / Auditor $25-$45/hour
Description
**Role Overview**
Mercor is collaborating with a leading AI lab to engage generalist writers with experience in rubric-based evaluation for a short-term, project-based initiative. This opportunity focuses on improving AI assistants’ ability to generate and assess high-quality conversational content. Contributors will apply structured evaluation frameworks to assess outputs and help refine model performance. The work is well-suited for detail-oriented writers interested in shaping how AI systems understand quality and nuance in writing, and exhibiting human-levels of judgement and memory.
**Key Responsibilities**
* Evaluate AI-generated written conversations using predefined rubrics used to evaluation performance
* Draft and refine evaluation rubrics for generalist writing tasks
* Apply structured scoring criteria to assess clarity, coherence, accuracy, and style
* Review edge cases and ambiguous outputs to ensure consistent grading standards
**Ideal Qualifications**
* Experience with rubric-based grading, editing, or content evaluation at Mercor
* Strong generalist writing skills across multiple domains (e.g., business, academic, creative)
* Excellent attention to detail and consistency in applying guidelines consistently across a variety of contexts
* Ability to interpret nuanced criteria and make sound judgment calls
* Background in English, journalism, communications, or a related field is preferred
**Compensation & Contract Terms**
* Compensation range: $25–45/hour depending on experience and location
* Opportunities for expanded reviewer / lead responsibilities
**Application Process**
* **Application Link** \- [https://t.mercor.com/KFrKm](https://t.mercor.com/KFrKm)
* Upload resume
* **Complete AI interview** **and exam**
* Selected applicants will be contacted within a few days regarding next steps