Files

2.9 KiB

Verification Checklist

Load this file after editing a SKILL.md, subagent definition, or reference file. This repo has no CI pipeline for skill authoring; run every check below manually before declaring the work done (see empirical validation).

  • Run skills-ref validate <skill-dir>; it is required by the runtime portability matrix and checks that the frontmatter parses, name matches the directory or basename in kebab-case, and only standard fields are present (frontmatter contract).
  • Confirm SKILL.md stays within the line and token limits recorded in the runtime portability matrix.
  • Confirm any subagent path referenced in a registry table exists on disk and that each subagent's escalation section is a closed enum whose every value the orchestrator routes (escalation categories).
  • If the skill mutates files, confirm SKILL.md declares MUTATION_LIMITS and passes them to every dispatched subagent (mutation scope boundaries).
  • If the skill takes a hard-to-reverse, outward-facing, destructive, or costly action, confirm a named checkpoint shows the exact artifact before it (human-in-the-loop checkpoints).
  • If the skill declares critical outputs, confirm each has a named gate with a written predicate and an independent checker (critical output gates).
  • If the orchestrator parses or routes on subagent fields, confirm scripts/validate* exists, is named in SKILL.md and every producing subagent, and run it once with a good payload and once with a bad one (script-enforced output contracts).
  • If the skill writes run-local files, confirm the paths are run-scoped and git check-ignore --quiet passes for them (artifact lifecycle, handoff file dispatch).
  • If the skill ships other files under scripts/, run each the way a consumer would and check its usage line and exit codes (helper script contracts).
  • If the skill has cases in evals/, re-run them and commit the updated evals/report.md, confirming only the intended behavior changed; if it has none, confirm SKILL.md declares that exception (empirical validation). Commands, approval rules, and check selection are owned by evals/AGENTS.md and its verification reference.

When unsure whether a change is correct, escalate to the user rather than declare success.