Commit Graph

8379 Commits

Author SHA1 Message Date
buua436
f5efff8d6d fix: exclude compiled artifacts from chunk lists (#18382) 2026-08-18 09:41:27 +08:00
天海蒼灆
b85b908bb6 Feat: data source test connection with unified connector validation (#14992) 2026-08-18 09:36:48 +08:00
Jin Hai
68f8260821 Go: fix context, part3 (#18390)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-08-18 00:07:37 +08:00
Lem0nTea2002
110ed630bd fix(harness): honor node and engine retry policies in Pregel (#18388)
### Summary

Pregel nodes created with `AddNodeWithOptions` retain a node-level
`RetryPolicy`, but task construction dropped that policy. When a task
had no policy, execution also bypassed the engine-level policy
configured with `WithRetryPolicy` and instantiated the default policy
directly.
2026-08-17 21:27:18 +08:00
Ilya Bogin
9c81d9be8b fix(agent/tools): read Keenable result content from snippet (#18341)
### Summary

Follow-up bug fix to #16233 (the Keenable search tool, merged
2026-06-25).
2026-08-17 20:25:24 +08:00
Lem0nTea2002
ab9db9adf1 docs: fix Docker installation link in Korean README (#18385)
### Summary

Fix the malformed Markdown destination in `README_ko.md` so the Korean
setup instructions link to Docker's official Engine installation guide.

Validation:

- `git diff --check`
- Confirmed the malformed link is absent and the corrected link occurs
once.
- Verified `https://docs.docker.com/engine/install/` returns HTTP 200.
2026-08-17 20:18:19 +08:00
Jack
37b945c94d fix(ingestor): stop dropping tasks under burst parse backpressure (#18369)
Fixes the defect where selecting many files (e.g. 20+) in one dataset and starting parsing at once leaves most of them stuck in `RUNNING` forever: a few parse, the rest never do.
2026-08-17 19:09:58 +08:00
Jack
e217b0d08e fix(deepdoc): apply 0.4 garbage gate in LayoutRecognizer.forward (#18372) 2026-08-17 19:09:16 +08:00
Jack
cb012380fe fix(deepdoc): trim garbage-gate comments, fix subtest fact error, dedupe constants (#18377) 2026-08-17 19:08:47 +08:00
questfever
52519e2fd7 refactor: replace Split in loops with more efficient SplitSeq (#18248) 2026-08-17 19:04:04 +08:00
Haruko386
ebb7bd29c6 fix[syncer]: cannot run prune task (#18344)
### Summary

As title
2026-08-17 18:43:44 +08:00
Haruko386
e32723ee36 feat[syncer]: implement outlook data source (#18350)
### Summary

As title
2026-08-17 18:43:15 +08:00
Haruko386
5a5f600ae3 fix: unable to search agent log by ID (#18373)
### Summary

As title
2026-08-17 18:42:45 +08:00
Jack
68da250f8f Fix cross-page merged tables dropping continuation rows (#18362) 2026-08-17 17:58:19 +08:00
buua436
e96a0a1b5c fix: restore document query cache matching (#18376) 2026-08-17 17:57:44 +08:00
Jack
7ceafa07f8 fix(deepdoc): drop low-confidence garbage DLA regions to match Python (#18365)
- The Go DLA client (`inference.Client.DLA`) kept `footer`/`header`/`reference` regions whose detection confidence was below 0.4.
- Python's production path (`parse_into_bboxes` -> `LayoutRecognizer.__call__`, `deepdoc/vision/layout_recognizer.py:97` and `:379`) drops such regions via a 0.4 garbage gate over
`garbage_layouts=['footer','header','reference']`.
- The shared `/predict/dla` backend runs `LayoutRecognizer.forward`, which does **not** apply that gate, so the Go client was the only place the filter was missing — a real Go<->Python parity gap.
2026-08-17 17:50:28 +08:00
Harsh Kashyap
4593d08821 fix(model_meta): Ollama._get_api_key handles JSON-dict api_key for the verify path (#18321) 2026-08-17 17:14:04 +08:00
balibabu
e3d46efce3 Fix: The begin operator of the agent created from the template does not display a pattern. (#18367) 2026-08-17 17:12:50 +08:00
Jack
bd01c78d2b fix(pdf): drop text boxes only when replaced by a table HTML (#18363)
## Problem
In the Go PDF pipeline, `processTablesWithReplacements`
(`internal/deepdoc/parser/pdf/table/table_post.go`) marked **every** box
overlapping a DLA table region for removal, then `insertTableBoxes`
re-inserted an HTML box only when `buildTableHTMLs` produced one.

When DLA over-labels a **text** box as a table but TSR produces **no
cells** (so `buildTableHTMLs` skips the table and `htmls[ti]` is unset),
the box was removed with nothing re-inserted — the original text was
**silently dropped**.
2026-08-17 17:07:56 +08:00
chanx
6f0fff5b77 fix(web): exclude <think> reasoning blocks from copied answer (#18371) 2026-08-17 17:00:35 +08:00
buua436
1ef4ddddec fix: align Go ingestion progress and pipeline selection (#18366)
Fixes Go ingestion progress reporting and pipeline selection:
- Add timestamps to document progress logs.
- Keep document duration and status updated during parsing.
- Start frontend polling immediately after parsing begins.
- Prevent documents explicitly using General from inheriting an old
dataset pipeline.
- Populate missing pipeline operation log fields.
- Remove stale component progress logs between retries.
- Prevent progress values greater than `1`.
2026-08-17 16:58:44 +08:00
Lynn
238b1aee7d Fix: get memory size cache rightly (#18370) 2026-08-17 16:54:01 +08:00
Lynn
fd37d25d5a Feat: add qwen-3.8 series models. (#18368) 2026-08-17 16:53:08 +08:00
balibabu
3079e4f659 Feat: Move wiki-related translation resources to a namespace. (#18359) 2026-08-17 16:20:23 +08:00
Wang Qi
57b907cd1e Refactor: do not include compliation chunks in retrieval testing (#18364)
Retrieval Testing: do not include compilation result.
Search: include compilation result.
2026-08-17 16:19:05 +08:00
jay77721
3e38b6cacb fix(ingestion): unify extractor prompt placeholder rendering and per-chunk substitution (#18355) 2026-08-17 15:19:47 +08:00
Jack
0517aebb80 fix(parser): align Go spreadsheet HTML with Python and harden header detection (#18304)
Brings the Go `XLSX`/`XLS`/`CSV` parsers in line with the Python deepdoc spreadsheet HTML contract and improves header detection beyond it.
2026-08-17 15:17:14 +08:00
Jack
8d20cbd0b3 deepdoc(pdf): WarpCrop de-skew + score-based layer-2 rotation (Go OCR parity with Python) (#18299)
Supersedes / folds in #18305. The score-based layer-2 rotation selection from #18305 now lives here, on top of `WarpCrop` (layer 1), applied to **all three** Go OCR paths, together with the Python score plumbing the Go side depends on. #18305 is closed in favor of this PR.
2026-08-17 15:13:56 +08:00
Jack
272645a27a fix(pdf): align DLA region handling with Python reference (#18295)
Aligns three Go DLA / PDF post-processing behaviors with the Python `deepdoc` reference so the Go PDF pipeline matches Python's DLA region / annotation semantics.
2026-08-17 14:33:44 +08:00
jay77721
452720a62d feat(ingestion): end-to-end Auto metadata in Go (extractor merge, builtin UI, built-in fields) (#18273) 2026-08-17 14:17:48 +08:00
YanZhang
226ef835a6 docs:fix compilation docs & change page layout (#18358)
fix compilation docs
change page layout
adjust user guides order
2026-08-17 13:56:31 +08:00
balibabu
8664d8d62a Fix: Switching the rerank model on the chat page fails to save the configuration. (#18357) 2026-08-17 13:28:11 +08:00
chanx
f8764d30a5 Fix: enhance form submission error handling and update rerank form field prefix (#18351) 2026-08-17 13:27:58 +08:00
euvre
9f358cbeaa fix(ingestion): accumulate component progress lines into document.progress_msg (#18356) 2026-08-17 13:27:40 +08:00
Ricardo-M-L
7ef144279b fix(tcadp): add timeout to HTTP GET request for document download (#18336) 2026-08-17 13:22:21 +08:00
yzxcj797
b5512b8014 docs: fix dead internal links in FAQ and HTTP API reference (#18312)
Two dead internal links found by auditing every docs link against the
current file tree:

1. **docs/faq.mdx (3 occurrences)**: points to
`./guides/run_health_check.md`, which was removed in #12363 because the
system web page is disabled since v0.22.0 and health checking is now
covered by the API. The links now point to the "Check system health"
section of the HTTP API reference (`/api/v1/system/healthz`).

2. **docs/references/http_api_reference.md**: the custom-parameter note
links to `../guides/agent/agent_component_reference/begin.md`, but that
directory was replaced by `agent_workflow/`. Updated to
`../guides/agent/agent_workflow/basic_component.md`, which documents the
Begin component.
2026-08-17 13:16:30 +08:00
mkaaad
248a4e6960 Feat: connector go discord (#18349)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2026-08-17 13:09:07 +08:00
qinling0210
f8a16ecef2 Fix _routed_docs leak across parallel claims in agentic research (#18348)
### Summary

Fix _routed_docs leak across parallel claims in agentic research
2026-08-17 12:28:55 +08:00
chanx
ddff47e7cb feat(web): pin the current user to the top of admin user list (#18345) 2026-08-17 11:20:15 +08:00
mkaaad
c3b977f7b6 feat(syncer): Add REST API connector (#18256)
as title
2026-08-17 10:50:16 +08:00
S
c6ba54bc72 fix: stop three recurring errors on doc delete (#17685) (#17686)
Follow-up to #17526 ("Refactor: merge dataset scope graph"), which introduced two code paths that touch Infinity columns the deployed schema does not declare. This PR makes the runtime robust against the old schema while also adding the new column to the new schema so freshly created tables are correct.
dev-20260817
2026-08-16 09:25:51 +08:00
qinling0210
554fb1133a Search in navigation tree & store graph content in nav_doc (#18303)
### Summary

Search in navigation tree & store graph content in nav_doc during parse
2026-08-14 22:26:57 +08:00
euvre
00df872e03 fix(search): show honest empty state when mind map has no content (#18294) 2026-08-14 20:22:29 +08:00
euvre
0df1b24f76 fix(web): show queued memory extraction tasks as pending instead of failed (#18297) 2026-08-14 20:22:00 +08:00
balibabu
a897a25aa7 Fix:The dialog will display the referenced documentation even if the API does not return any documentation data. (#18298) 2026-08-14 20:18:55 +08:00
chanx
c9fda1c26c Fix: hide top-k under the rerank model (#18302)
### Summary

Fix: hide top-k under the rerank model
2026-08-14 20:16:37 +08:00
buua436
024c35f085 fix: track wiki chunk changes incrementally (#18285) 2026-08-14 20:11:55 +08:00
euvre
34e59c8ec9 fix(web): enlarge card '...' edit button hit area (#18262) 2026-08-14 20:07:12 +08:00
Jin Hai
fa5762336b Go: fix context, part2 (#18296)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-08-14 19:42:41 +08:00
euvre
01d351b54a Go: align cancel-parse error with Python for un-started documents (#18245) 2026-08-14 19:22:36 +08:00