Jack 4b4a6e72f0 fix(chunker): unify TokenChunker merge and strip coord tags in Python JSON path (#18002) ...

Unifies the Go TokenChunker merge path on a single `mergeUnits` core and
fixes coordinate-tag drift in the Python JSON merge at `overlap > 0`.
Rebased on top of #17979 (delimiter_mode convergence).

2026-08-07 21:55:07 +08:00

..

dsl_examples

Support pipeline DSL modification through dataset configuration (backend) (#16991)

2026-07-17 14:40:09 +08:00

client.py

Refa:replace trio with asyncio (#11831)

2025-12-09 19:23:14 +08:00

test_token_chunker_delimiter.py

Fix: delimiter is chunk boundary, drop token_size atom-split (OVER_CAP default) (#17808)

2026-08-05 11:50:07 +08:00

test_token_chunker_tag_overlap.py

fix(chunker): unify TokenChunker merge and strip coord tags in Python JSON path (#18002)

2026-08-07 21:55:07 +08:00

test_token_chunker.py

fix(chunker): unify TokenChunker merge and strip coord tags in Python JSON path (#18002)

2026-08-07 21:55:07 +08:00