Commit Graph

8403 Commits

Author SHA1 Message Date
Wang Qi
2a132d281d Fix parent chunk with extra newline (#18426) 2026-08-18 16:06:30 +08:00
Try everything
4a3b20a889 fix(web): prevent docx preview zoom from skipping a level (#17323)
### Summary

Fixes a zoom bug in the DOCX preview: the first "zoom in" or "zoom out"
click
skips a level whenever the current zoom is a fit-to-width value.
2026-08-18 15:54:51 +08:00
Muhammad Furqan
c3153ba294 fix(agent/tools): port DeepL to ToolBase so it works as an Agent tool (#18395)
### Summary

Closes #18394.
2026-08-18 15:36:11 +08:00
Jack
fb788ee7dc fix(deepdoc): assign each PDF box to a single table cell matching Python (#18410) 2026-08-18 15:13:41 +08:00
mkaaad
94a93748db Feat: connector go webdav (#18379)
as title
2026-08-18 15:01:53 +08:00
Wang Qi
86750bd24e Fix: some pdf with chinese name cannot preview (#18422) 2026-08-18 14:54:10 +08:00
Haruko386
8583bc3938 fix(web): remove duplicate tags for locales files (#18421) 2026-08-18 14:26:42 +08:00
Lynn
c642e01f4b Fix: set database version to v0.27.0 (#18424)
### Summary

As title.
2026-08-18 14:25:01 +08:00
Jack
fa386ddf10 fix(deepdoc): drop per-cell OCR in Go table parser to align with Python (#18405) 2026-08-18 13:42:16 +08:00
Wang Qi
75f737de67 Refactor: make page number readable (#18409) 2026-08-18 13:27:04 +08:00
Jack
97db1b4c38 chore(table): remove stale manual parity-issues test (#18403) 2026-08-18 13:18:57 +08:00
Jack
3a7e275155 fix(deepdoc): add orphan-row cleanup to Go table construction (parity with Python) (#18402) 2026-08-18 13:18:25 +08:00
Jack
d3ff25763c fix(deepdoc): align table orientation scoring with Python recognition confidence (#18401) 2026-08-18 13:18:09 +08:00
var4dev
63a454084e fix(agent): close MCP sessions wrapped in MCPToolBinding (#18399) 2026-08-18 13:15:16 +08:00
Jack
5ec11f7b07 fix(pdf): align TSR crop margin with Python (fixed 30px, not 3%) (#18387) 2026-08-18 13:11:41 +08:00
Lynn
344bd4d57a Fix: correct chunk order for non‑PDF documents (#18412) 2026-08-18 13:06:13 +08:00
Lynn
2368c54689 Fix: handle title and truncate document preview by sentence (#18407) 2026-08-18 11:54:55 +08:00
jay77721
c71991bb7a feat(ingestion,web): modularize extractor configuration with sub-tabs, independent prompts, and metadata integration (#18383)
This PR modularizes the **Extractor** component configuration with dedicated feature subtabs, adds independent system prompt configuration, fixes multi-node execution determinism and parameter persistence across save and page refresh, and ensures backward compatibility with legacy flat fields.
2026-08-18 11:38:52 +08:00
Haruko386
602f55deed feat[syncer]: add connection test with unified connector validation (#18281)
### Summary

as title
2026-08-18 11:30:29 +08:00
euvre
45d2ac0eef fix: update ZHIPU-AI API key URL to the new BigModel console (#18406) 2026-08-18 11:25:45 +08:00
chanx
c6ec7d4eee fix(web): confirm before removing models from a provider instance (#18400) 2026-08-18 11:22:08 +08:00
zws202606
d02723ca76 feat: Gaussdb adaptation (#17703) dev-20260818 2026-08-18 09:53:11 +08:00
Jack
f94438adcc fix(parser): check every grid row, not just the first, before cross-page rebuild (#18378) 2026-08-18 09:45:46 +08:00
chanx
171175a96f fix(web): hide verify button for OpenAI-API-Compatible provider (#18380) 2026-08-18 09:41:38 +08:00
buua436
f5efff8d6d fix: exclude compiled artifacts from chunk lists (#18382) 2026-08-18 09:41:27 +08:00
天海蒼灆
b85b908bb6 Feat: data source test connection with unified connector validation (#14992) 2026-08-18 09:36:48 +08:00
Jin Hai
68f8260821 Go: fix context, part3 (#18390)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-08-18 00:07:37 +08:00
Lem0nTea2002
110ed630bd fix(harness): honor node and engine retry policies in Pregel (#18388)
### Summary

Pregel nodes created with `AddNodeWithOptions` retain a node-level
`RetryPolicy`, but task construction dropped that policy. When a task
had no policy, execution also bypassed the engine-level policy
configured with `WithRetryPolicy` and instantiated the default policy
directly.
2026-08-17 21:27:18 +08:00
Ilya Bogin
9c81d9be8b fix(agent/tools): read Keenable result content from snippet (#18341)
### Summary

Follow-up bug fix to #16233 (the Keenable search tool, merged
2026-06-25).
2026-08-17 20:25:24 +08:00
Lem0nTea2002
ab9db9adf1 docs: fix Docker installation link in Korean README (#18385)
### Summary

Fix the malformed Markdown destination in `README_ko.md` so the Korean
setup instructions link to Docker's official Engine installation guide.

Validation:

- `git diff --check`
- Confirmed the malformed link is absent and the corrected link occurs
once.
- Verified `https://docs.docker.com/engine/install/` returns HTTP 200.
2026-08-17 20:18:19 +08:00
Jack
37b945c94d fix(ingestor): stop dropping tasks under burst parse backpressure (#18369)
Fixes the defect where selecting many files (e.g. 20+) in one dataset and starting parsing at once leaves most of them stuck in `RUNNING` forever: a few parse, the rest never do.
2026-08-17 19:09:58 +08:00
Jack
e217b0d08e fix(deepdoc): apply 0.4 garbage gate in LayoutRecognizer.forward (#18372) 2026-08-17 19:09:16 +08:00
Jack
cb012380fe fix(deepdoc): trim garbage-gate comments, fix subtest fact error, dedupe constants (#18377) 2026-08-17 19:08:47 +08:00
questfever
52519e2fd7 refactor: replace Split in loops with more efficient SplitSeq (#18248) 2026-08-17 19:04:04 +08:00
Haruko386
ebb7bd29c6 fix[syncer]: cannot run prune task (#18344)
### Summary

As title
2026-08-17 18:43:44 +08:00
Haruko386
e32723ee36 feat[syncer]: implement outlook data source (#18350)
### Summary

As title
2026-08-17 18:43:15 +08:00
Haruko386
5a5f600ae3 fix: unable to search agent log by ID (#18373)
### Summary

As title
2026-08-17 18:42:45 +08:00
Jack
68da250f8f Fix cross-page merged tables dropping continuation rows (#18362) 2026-08-17 17:58:19 +08:00
buua436
e96a0a1b5c fix: restore document query cache matching (#18376) 2026-08-17 17:57:44 +08:00
Jack
7ceafa07f8 fix(deepdoc): drop low-confidence garbage DLA regions to match Python (#18365)
- The Go DLA client (`inference.Client.DLA`) kept `footer`/`header`/`reference` regions whose detection confidence was below 0.4.
- Python's production path (`parse_into_bboxes` -> `LayoutRecognizer.__call__`, `deepdoc/vision/layout_recognizer.py:97` and `:379`) drops such regions via a 0.4 garbage gate over
`garbage_layouts=['footer','header','reference']`.
- The shared `/predict/dla` backend runs `LayoutRecognizer.forward`, which does **not** apply that gate, so the Go client was the only place the filter was missing — a real Go<->Python parity gap.
2026-08-17 17:50:28 +08:00
Harsh Kashyap
4593d08821 fix(model_meta): Ollama._get_api_key handles JSON-dict api_key for the verify path (#18321) 2026-08-17 17:14:04 +08:00
balibabu
e3d46efce3 Fix: The begin operator of the agent created from the template does not display a pattern. (#18367) 2026-08-17 17:12:50 +08:00
Jack
bd01c78d2b fix(pdf): drop text boxes only when replaced by a table HTML (#18363)
## Problem
In the Go PDF pipeline, `processTablesWithReplacements`
(`internal/deepdoc/parser/pdf/table/table_post.go`) marked **every** box
overlapping a DLA table region for removal, then `insertTableBoxes`
re-inserted an HTML box only when `buildTableHTMLs` produced one.

When DLA over-labels a **text** box as a table but TSR produces **no
cells** (so `buildTableHTMLs` skips the table and `htmls[ti]` is unset),
the box was removed with nothing re-inserted — the original text was
**silently dropped**.
2026-08-17 17:07:56 +08:00
chanx
6f0fff5b77 fix(web): exclude <think> reasoning blocks from copied answer (#18371) 2026-08-17 17:00:35 +08:00
buua436
1ef4ddddec fix: align Go ingestion progress and pipeline selection (#18366)
Fixes Go ingestion progress reporting and pipeline selection:
- Add timestamps to document progress logs.
- Keep document duration and status updated during parsing.
- Start frontend polling immediately after parsing begins.
- Prevent documents explicitly using General from inheriting an old
dataset pipeline.
- Populate missing pipeline operation log fields.
- Remove stale component progress logs between retries.
- Prevent progress values greater than `1`.
2026-08-17 16:58:44 +08:00
Lynn
238b1aee7d Fix: get memory size cache rightly (#18370) 2026-08-17 16:54:01 +08:00
Lynn
fd37d25d5a Feat: add qwen-3.8 series models. (#18368) 2026-08-17 16:53:08 +08:00
balibabu
3079e4f659 Feat: Move wiki-related translation resources to a namespace. (#18359) 2026-08-17 16:20:23 +08:00
Wang Qi
57b907cd1e Refactor: do not include compliation chunks in retrieval testing (#18364)
Retrieval Testing: do not include compilation result.
Search: include compilation result.
2026-08-17 16:19:05 +08:00
jay77721
3e38b6cacb fix(ingestion): unify extractor prompt placeholder rendering and per-chunk substitution (#18355) 2026-08-17 15:19:47 +08:00