Add evals/evals.json with 7 cases: 6 positive covering risk-based
prioritization, exploratory charter design, SDD gate AC testability,
agentic eval dataset design, SDET career scope mapping, and test-design
technique selection; plus 1 negative/refusal case for production
debugging routing to systematic-debugging. All prompts are realistic
>=6-word utterances. Assertions are observable, unique, and coherent
with expected_output.
Verified: validate-evals.py exits 0, eval_runner.paired --adapter fake
exits 0 with 7 cases and 0 regressions.
Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
SKILL.md: thin routing index (128 lines, ~2600 tokens) with frontmatter
(name, description with imperative verb + negative boundary, license MIT,
compatibility, metadata with source_repo hermes-profiles attribution and
skill_version 2.0.0). Body includes ownership table, core principles,
loading-guide table covering all 27 supplementary files with load-when
conditions, scripts invocation table, triggers covering 10/10 keyword
families, When-not-to-use section naming 5 sibling skills by relative
link, and explicit stop/exit conditions. Zero no-op phrases, zero
sibling-mechanics duplication.
README.md: human-facing with all 6 required sections (Title, Why Install
This Skill, What You Get, Quick Start, Triggers, Requirements). Benefit-led
3-paragraph pitch, concrete python3 commands in Quick Start, platform-
agnostic Requirements with no tool mandates.
Note: supplementary files (templates, assets, scripts, evals) referenced
in the loading table are created by later features in this milestone.
Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
Two new reference files extending qa-methodology into the reactive side
of its domain — diagnosing failures rather than designing strategy.
ci-failure-triage.md: systematic CI failure diagnosis — runner
availability checks, log triage (gh run view), exit 137 / container
termination evidence-first procedure, pre-existing vs regression
classification, flaky test management, and compose readiness corollary.
Distilled from accumulated CI-failure incident notes.
test-debugging.md: diagnosing broken tests — mock path binding after
module-to-package refactors, FastAPI startup race (mock state set before
TestClient context is overwritten), httpx mock transport pattern, test
execution integrity (collection count vs exit code), deterministic
integration seeds, API signature change fixture recovery, and uv
lockfile hygiene. Distilled from accumulated test-debugging incident
notes.
Both are technique libraries serving qa-methodology's existing domain,
not new standalone skills. SKILL.md reference table updated.
Signed-off-by: Magnus Hedemark <magnus919@pm.me>
username