← Back to all listings

[Remote] Rubrics Writer / Auditor $25-$45/hour

Pay
$25-45/hr
Location
Remote
Posted

Description

**Role Overview**

Mercor is collaborating with a leading AI lab to engage generalist writers with experience in rubric-based evaluation for a short-term, project-based initiative. This opportunity focuses on improving AI assistants’ ability to generate and assess high-quality conversational content. Contributors will apply structured evaluation frameworks to assess outputs and help refine model performance. The work is well-suited for detail-oriented writers interested in shaping how AI systems understand quality and nuance in writing, and exhibiting human-levels of judgement and memory. 

**Key Responsibilities**

* Evaluate AI-generated written conversations using predefined rubrics used to evaluation performance
* Draft and refine evaluation rubrics for generalist writing tasks
* Apply structured scoring criteria to assess clarity, coherence, accuracy, and style
* Review edge cases and ambiguous outputs to ensure consistent grading standards

**Ideal Qualifications**

* Experience with rubric-based grading, editing, or content evaluation at Mercor
* Strong generalist writing skills across multiple domains (e.g., business, academic, creative)
* Excellent attention to detail and consistency in applying guidelines consistently across a variety of contexts
* Ability to interpret nuanced criteria and make sound judgment calls
* Background in English, journalism, communications, or a related field is preferred

**Compensation & Contract Terms**

* Compensation range: $25–45/hour depending on experience and location
* Opportunities for expanded reviewer / lead responsibilities

**Application Process**

* **Application Link** \- [https://t.mercor.com/KFrKm](https://t.mercor.com/KFrKm)
* Upload resume
* **Complete AI interview** **and exam**
* Selected applicants will be contacted within a few days regarding next steps