RUBRIC DESIGN • CALIBRATION • CONSISTENCY RUBRIC DESIGN • CALIBRATION • CONSISTENCY

Design de RubricsRubric Design

Une bonne rubric réduit la variance entre reviewers, rend le jugement défendable, et accélère l’amélioration. A strong rubric reduces reviewer variance, makes judgments defensible, and accelerates improvement.

StructureStructure

Critères → niveaux → exemples → contre‑exemples → notes de calibration.Criteria → levels → examples → counterexamples → calibration notes.

AnglesAngles

Clarté, logique, sécurité, utilité, style, citations, tool use.Clarity, logic, safety, usefulness, style, citations, tool use.

OutputOutput

Un doc + une grille + un guide reviewer + tests d’accord inter‑annotateurs.Doc + grid + reviewer guide + agreement checks.

Parler d’un besoinDiscuss a need Toutes les expertisesAll expertise

Ce que la rubric rend possibleWhat the rubric enables

Scoring stableStable scoring

moins de désaccords.fewer disagreements.

Améliorations mesurablesMeasurable improvements

avant/après clair.clear before/after.

ScalingScaling

onboarding reviewers plus rapide.faster reviewer onboarding.

AuditabilitéAuditability

décisions explicables.decisions explainable.

ContactContact RetourBack

Keywords visésTarget keywords

evaluation rubric designevaluation rubric design

LLM scoring rubricLLM scoring rubric

AI trainer rubricAI trainer rubric

annotation guidelines LLMannotation guidelines LLM

ContactContact RetourBack

FAQFAQ

Questions fréquentes — formulées comme des requêtes Google. Common questions — phrased like Google queries.

Why do rubrics matter?Why do rubrics matter?

They turn fuzzy quality into consistent criteria, enabling reliable training data and actionable evaluation.They turn fuzzy quality into consistent criteria, enabling reliable training data and actionable evaluation.

Est‑ce que vous provide examples?Do you provide examples?

Yes: gold examples and counterexamples for each level, plus reviewer notes.Yes: gold examples and counterexamples for each level, plus reviewer notes.

Pouvez‑vous calibrate reviewers?Can you calibrate reviewers?

Yes: calibration sessions and guidance to reduce variance.Yes: calibration sessions and guidance to reduce variance.