5 Commits

Include renames

Author	SHA1	Message	Date
usernameandfactory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>	476d7e11b0	feat(ci): add linting, formatting, coverage, and security configs ... Add ruff linter/formatter with pre-commit hooks, pytest-cov with 60% coverage threshold, CODEOWNERS, Dependabot for pip/GHA updates, and .env.example. Auto-fix existing ruff violations across eval_runner/ and scripts/. 10 agent-readiness criteria resolved: lint_config, formatter, pre_commit_hooks, naming_consistency, dead_code_detection, test_coverage_thresholds, test_performance_tracking, codeowners, dependency_update_automation, env_template. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>	2026-07-29 17:43:41 -04:00
magnus919andMagnus Hedemark	cbe1b6927a	fix: reject duplicate eval fixture paths	2026-07-25 01:11:02 -04:00
magnus919andMagnus Hedemark	f49e670c9f	fix: align eval artifact schemas with runtime	2026-07-25 01:11:02 -04:00
magnus919andMagnus Hedemark	cb1579f23d	fix: harden paired evaluation isolation	2026-07-25 01:11:02 -04:00
3 people	e83558a6e3	feat: add harness adapter contract and reproducible eval run artifacts (#130) ... Implements #104. Adds a repository-level evaluation runner with: - Typed HarnessAdapter Protocol (adapter.py) - Dataclass models for AdapterInput/AdapterOutput (models.py) - FakeAdapter for deterministic CI without credentials (fake_adapter.py) - CliSubprocessAdapter for non-interactive CLI harnesses (cli_adapter.py) - Run manifest builder with schema validation (manifest.py) - Runner CLI entry point (runner.py, __main__.py) - JSON Schema for trial manifests (schemas/run-manifest-v1.schema.json) - Unit tests including schema validation (tests/test_runner.py) Co-authored-by: magnus919 <magnus919>	2026-07-24 18:46:18 -04:00