magnus919_agent-skills/agent-evals-and-observability/templates/grader-specification.md

Grader Specification

• Property claimed and observable evidence:
• Grader family and why it fits:
• Inputs, output schema, rubric anchors, and abstain/escalate behavior:
• Known blind spots, false-positive/false-negative harms, and affected slices:
• Calibration set isolation and candidate blinding/order randomization:
• Human/model disagreement analysis and adjudication rule:
• Revalidation triggers: model, prompt, rubric, policy, task distribution, or environment change
• Version, owner, access, retention, and audit evidence: