mirror of
https://github.com/b-mendoza/agent-skills.git
synced 2026-09-19 07:10:27 +08:00
2.9 KiB
2.9 KiB
Verification Checklist
Load this file after editing a SKILL.md, subagent definition, or reference file. This repo has no CI pipeline for skill authoring; run every check below manually before declaring the work done (see empirical validation).
- Run
skills-ref validate <skill-dir>; it is required by the runtime portability matrix and checks that the frontmatter parses,namematches the directory or basename in kebab-case, and only standard fields are present (frontmatter contract). - Confirm
SKILL.mdstays within the line and token limits recorded in the runtime portability matrix. - Confirm any subagent path referenced in a registry table exists on disk and that each subagent's escalation section is a closed enum whose every value the orchestrator routes (escalation categories).
- If the skill mutates files, confirm
SKILL.mddeclaresMUTATION_LIMITSand passes them to every dispatched subagent (mutation scope boundaries). - If the skill takes a hard-to-reverse, outward-facing, destructive, or costly action, confirm a named checkpoint shows the exact artifact before it (human-in-the-loop checkpoints).
- If the skill declares critical outputs, confirm each has a named gate with a written predicate and an independent checker (critical output gates).
- If the orchestrator parses or routes on subagent fields, confirm
scripts/validate*exists, is named inSKILL.mdand every producing subagent, and run it once with a good payload and once with a bad one (script-enforced output contracts). - If the skill writes run-local files, confirm the paths are run-scoped and
git check-ignore --quietpasses for them (artifact lifecycle, handoff file dispatch). - If the skill ships other files under
scripts/, run each the way a consumer would and check its usage line and exit codes (helper script contracts). - If the skill has cases in
evals/, re-run them and commit the updatedevals/report.md, confirming only the intended behavior changed; if it has none, confirmSKILL.mddeclares that exception (empirical validation). Commands, approval rules, and check selection are owned byevals/AGENTS.mdand its verification reference.
When unsure whether a change is correct, escalate to the user rather than declare success.