RIC 1175bfe7a9 bench(wiki-rag): reproducible 60-question doc-vs-chunk evaluation harness ...

Three scripts + 60 hand-annotated questions over the public
countbot.cn/docs corpus (52 pages, fetched by fetch_corpus.py):

- run_g0.py: doc-level BM25 baseline (pre-change behaviour)
- run_g1.py: chunk-level BM25 (this PR) on the same questions
- fetch_corpus.py: downloads the public corpus into rag-bench/corpus/

Pure programmatic scoring (recall@k / MRR@10 / NDCG@10 / top1 /
injected-token volume), no LLM judge, no private data. The headline
numbers quoted in the PR description come from running these on the
same corpus/questions before and after the chunk change.

Refs: #107

2026-09-03 16:01:51 +08:00

..

fetch_corpus.py

bench(wiki-rag): reproducible 60-question doc-vs-chunk evaluation harness

2026-09-03 16:01:51 +08:00

run_g0.py

bench(wiki-rag): reproducible 60-question doc-vs-chunk evaluation harness

2026-09-03 16:01:51 +08:00

run_g1.py

bench(wiki-rag): reproducible 60-question doc-vs-chunk evaluation harness

2026-09-03 16:01:51 +08:00