Rustem Kamalov 04db5347a8 fix(core): harden extract and stabilize request protection ...

- breaker: stop counting client cancellations/deadlines (incl. bare
  rate-limiter wait errors) and circuit-open as engine failures
- rate limiting: cache limiters in SearchEngineOptions and rawEngine so
  pacing applies on raw/library paths; pool wrapper delegates
- /extract SSRF guard: public-IP-only policy with dial-time IP pinning,
  redirect re-validation, rendered-mode preflight, http/https allow-list,
  ErrTargetNotAllowed -> HTTP 400, extract.allow_private_networks
  escape hatch (default off)
- browser: no rod Must* on the request path; CLI parses block_resources
  without panicking

2026-06-12 18:09:40 +03:00

..

config.go

fix(core): harden extract and stabilize request protection

2026-06-12 18:09:40 +03:00

content.go

Add new URL extraction endpoint and search feature

2026-06-04 02:22:38 +03:00

extractor_test.go

fix(core): harden extract and stabilize request protection

2026-06-12 18:09:40 +03:00

extractor.go

fix(core): harden extract and stabilize request protection

2026-06-12 18:09:40 +03:00

llmstxt.go

Add new URL extraction endpoint and search feature

2026-06-04 02:22:38 +03:00

metadata.go

Add new URL extraction endpoint and search feature

2026-06-04 02:22:38 +03:00

types.go

Add new URL extraction endpoint and search feature

2026-06-04 02:22:38 +03:00