 OthmanAdi
|
ade3ecec9f
|
docs: add formal benchmark results, article, and README verification badges (v2.22.0)
Evaluated planning-with-files using Anthropic's skill-creator framework:
- 10 parallel subagents (5 with_skill + 5 without_skill), 5 task types
- 30 objectively verifiable assertions
- with_skill: 96.7% pass rate (29/30) vs 6.7% (2/30) without_skill
- 3 blind A/B comparisons: with_skill wins 3/3, avg 10.0/10 vs 6.8/10
Also documents the v2.21.0 security fix (WebFetch/WebSearch removed from
allowed-tools, Security Boundary section added) with full technical context
on why the PreToolUse hook created an indirect prompt injection amplification
vector and how the fix resolves it.
Added:
- docs/evals.md: full methodology, assertions, results, benchmark data
- docs/article.md: technical write-up for publication
- README.md: Benchmark Results section + 3 verification badges
- CHANGELOG.md: v2.22.0 entry
|
2026-03-06 09:06:44 +01:00 |
|