magnus919_agent-skills/agent-evals-and-observability/templates/eval-plan.md

Eval Plan

Decision and Risk

• Change and decision:
• Owner and authority:
• Harm, reversibility, and deployment stage:
• Task contract and prohibited outcomes:
• Trajectory contract and permitted side effects:

Evidence Design

Evidence type	Risk addressed	Dataset/version and slices	Grader	Limitations

Comparison and Analysis

• Baseline and candidate configuration:
• Pairing and stochastic-repeat plan:
• Primary metrics, effect sizes, uncertainty method, and minimum detectable effect rationale:
• Missingness, base-rate, multiple-comparison, and confounder handling:
• Privacy, rights, access, retention, deletion, and contamination controls:

Decision Rule

• Hard invariants:
• Statistical indicators and insufficient-evidence disposition:
• Rollback/containment and monitoring: