Edward Cheng-I Wu cfbd2c6f63 evals: add claude plugin eval suite for the academic-paper revision-coach flow (#852) ...

Seven cases (five fire, two should-not-fire), twenty graders, run as a
with/without-plugin ablation. Primary quality axis is "no unauthorised
rewriting" (no manuscript prose drafted, nothing changed that no reviewer
asked for, no results or changes asserted that have not happened).
Calibrated against five pilots on 2026-09-12; README records the run
command, ceilings, pilot cost and caveats. plugin-evals/results/ is
gitignored. The ICLR case surfaced the trigger gap filed as #851 and is
its acceptance check.


Claude-Session: https://claude.ai/code/session_013fbc5qpXkAac1o4HLMGinE

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-12 22:54:35 +08:00

..

graders

evals: add claude plugin eval suite for the academic-paper revision-coach flow (#852)

2026-09-12 22:54:35 +08:00

prompt.md

evals: add claude plugin eval suite for the academic-paper revision-coach flow (#852)

2026-09-12 22:54:35 +08:00