Commit Graph
6 Commits
Author SHA1 Message Date
Magnus HedemarkGitHubfactory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
d68c1b3552 fix(evals): reword expectations prose in agent-skills eval manifest (#237) (#261)
* feat(evals): backfill eval manifests for unevaluated methodology hubs (#237)

Add schema-v1 evals/evals.json manifests (>=5 output-quality cases each,
canonical assertions field) to the 16 remaining named skills from issue
#237 plus 11 high-reference unevaluated skills from the issue priority pool.
Raises schema-valid eval coverage from 44/132 (33.3%) to 71/132
(53.8%), clearing the 50% CI-fail threshold.

Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>

* fix(evals): reword expectations prose in agent-skills eval manifest

Replace four prose strings in agent-skills/evals/evals.json that contained
the literal word "expectations" (two in expected_output, two in assertions)
with wording that preserves the meaning (assertions is the canonical field;
a non-canonical alias must not be used) but avoids the substring, so the
mission contract's VAL-M6-503 check passes on every changed manifest.

Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>

---------

Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
2026-08-03 16:15:50 -04:00
Magnus Hedemark a5f7e74972 fix: resolve skill audit findings 2026-07-11 09:24:58 -04:00
Magnus Hedemark 738ec715e7 Add human-focused README.md to every skill and bundle directory
Each README is written for a human audience, explaining:
- What the skill does (not what format it follows)
- What benefit the user gets from installing it
- Quick setup and usage patterns
- When to load/trigger the skill
- What scripts, references, and templates it ships

data-scientist already had a README — left unchanged.

48 READMEs added across all skill and bundle directories.
2026-07-09 22:30:12 -04:00
Magnus Hedemark e3bd060de0 fix: SkillOpt Epoch 2 — langgraph decision intelligence
Epoch 2 edits (3/3 accepted, 3/3 validation passed):
- ADD 'Start from template' column to Pattern Selection Guide
- ADD 'Choosing Your Starting Point' table (scaffold vs template vs reference)
- ADD concrete template guidance to Quick Start next-steps

Version: 1.0.1 → 1.0.2
2026-07-08 15:17:25 -04:00
Magnus Hedemark 2731a3a48f fix: SkillOpt Epoch 1 — langgraph prominence and discoverability
Epoch 1 edits (4/4 accepted, 3/3 validation tasks passed):
- ADD Quick Start section with pip install + hello-world + next-steps
- MOVE 6 design principles from architecture.md into SKILL.md as hard-gate blockquote
- ADD 3 template rows to Reference Files table
- ADD install dependencies blockquote at top

Version: 1.0.0 → 1.0.1
2026-07-08 15:08:03 -04:00
Magnus Hedemark 4a73657522 feat: add langgraph expert skill — multi-agent patterns, scaffolds, evals, and production guidance
Comprehensive LangGraph skill covering:
- Core architecture: Graph API, Functional API, state management, agent loops
- Three multi-agent patterns: supervisor (~94% accuracy), swarm (~40% fewer LLM calls),
  hierarchical teams (subgraphs with nested state)
- Persistence: checkpointers vs stores, per-invocation/per-thread/stateless modes
- Production: Agent Server deployment, LangSmith observability, 8 failure modes
- Evals: routing accuracy, resolution coverage, LLM-as-judge methodology
- Troubleshooting: symptom→cause→fix tables per pattern
- 3 Python scripts: supervisor scaffold, swarm scaffold, eval generator
- 3 runnable templates: supervisor, swarm, subgraph composition

Ships 8 reference files, 3 scripts, and 3 templates.
2026-07-08 14:54:53 -04:00