LukeandGitHub
7b086f550e
## Overview This PR adds two Codex readiness skills that evaluate repository guidance quality and end‑to‑end agentic execution. The unit test focuses on deterministic checks + in‑session LLM evaluation of AGENTS.md/PLANS.md quality, while the integration test runs a full agentic loop and scores real code changes and build/test outcomes. ## 1) codex-readiness-unit-test (LLM Codex Readiness Unit Test) ### Goal Validate that AGENTS.md and PLANS.md provide sufficient, usable guidance using deterministic checks plus in‑session LLM evaluation, and generate a scored JSON + HTML report. ### How it works This skill builds a report from two pipelines: deterministic filesystem checks and in‑session LLM evaluation of AGENTS.md/PLANS.md guidance. It writes a timestamped run directory with evidence, LLM results, and a scored JSON/HTML report; in optional execute mode it runs a user‑approved plan and includes execution logs in scoring. JSON outputs are strictly validated with a retry + json‑fix loop. ## 2) codex-readiness-integration-test (LLM Codex Readiness Integration Test) ### Goal Validate real agentic execution quality by running Codex CLI against the repo, executing an approved change prompt, and scoring results with evidence + LLM evaluation. ### How it works This skill runs an end‑to‑end agentic execution against the repo using Codex CLI, then executes a build/test plan and scores the run from evidence plus LLM evaluation. It spins up the Codex session by launching the CLI as a subprocess with HOME/XDG_CACHE_HOME pointed at the repo‑local .codex-home, using the approved prompt.json (change prompt + agentic_loop settings) so the CLI reads AGENTS.md and operates in the repo. It requires a repo‑local login, always runs in execute mode, and writes results to a timestamped run directory with agentic logs, LLM results, and a summary.
Agent Skills
Agent Skills are folders of instructions, scripts, and resources that AI agents can discover and use to perform at specific tasks. Write once, use everywhere.
Codex uses skills to help package capabilities that teams and individuals can use to complete specific tasks in a repeatable way. This repository catalogs skills for use and distribution with Codex.
Learn more:
Installing a skill
Skills in .system are automatically installed in the latest version of Codex.
To install curated or experimental skills, you can use the $skill-installer inside Codex.
Curated skills can be installed by name (defaults to skills/.curated):
$skill-installer gh-address-comments
For experimental skills, specify the skill folder. For example:
$skill-installer install the create-plan skill from the .experimental folder
Or provide the GitHub directory URL:
$skill-installer install https://github.com/openai/skills/tree/main/skills/.experimental/create-plan
After installing a skill, restart Codex to pick up new skills.
License
The license of an individual skill can be found directly inside the skill's directory inside the LICENSE.txt file.