← All careers
LLM-as-Judge Evaluator
$70 - $95/ hour · Part time · Techfilic
About this role
Compare model responses using rubrics, run pairwise preference tasks, and validate automated judge scores for production eval harnesses.
Requirements
- Strong analytical writing skills
- Experience with LLM evaluation or content moderation
- Comfort with repetitive quality-focused work
Skills
LLM evalRubricsPreferences