zlei6/openserp
1
0
Fork 0
mirror of https://github.com/karust/openserp.git synced 2026-08-05 16:53:54 +08:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 29c7b0fbe0 expose proxy-attempts + use-profile CORS headers; simplify DDG url builders main v0.8.12 Rustem Kamalov 2026-07-22 15:17:16 +03:00
  • 5d5d135fbf feat: update DuckDuckGo search logic, use "more results" button for next page results (#41) Parash Subedi 2026-07-22 02:56:20 +05:45
  • 2a57bd4248 fix: /extract/batch per-URL errors, param parity, proxy headers. Update readme Rustem Kamalov 2026-07-19 04:18:50 +03:00
  • 01223e35d3 Merge pull request #39 from AIWintermuteAI/main Rustem Kamalov 2026-07-18 21:44:46 +03:00
  • 00edd86c1c fix: openapi yaml parse error + /extract/batch timeout exemption #39 Rustem Kamalov 2026-07-18 21:31:46 +03:00
  • e430584324 refactor: use errInvalidParam helper and add per-URL took_ms to batch extract AIWintermuteAI 2026-07-18 09:56:20 +02:00
  • aec0d9c42a cleanup AIWintermuteAI 2026-07-18 09:49:38 +02:00
  • 58fdf2b7a6 docs: add /extract/batch endpoint to OpenAPI spec AIWintermuteAI 2026-07-18 00:19:15 +02:00
  • c3934bb75b feat: add POST /extract/batch endpoint for WebUI integration AIWintermuteAI 2026-07-18 00:18:05 +02:00
  • e7827cc03d refactor(browser): native CDP fingerprinting, drop patch.js + localized profiles. Update docker chrome Rustem Kamalov 2026-07-13 06:07:37 +03:00
  • cf21bf5150 fix google: detect /sorry/ block pages; scope proxy sessions to credentials. Update default config Rustem Kamalov 2026-07-09 19:30:21 +03:00
  • 9f68086d47 refactor(engines): unify captcha/block/no-results detection across raw and browser paths; Fix google proxy block diagnostics Rustem Kamalov 2026-07-02 00:47:21 +03:00
  • 3d5eddfeed fix(engines): better classify captcha/blocked/no-results pages instead of returning empty results, also enable it to <engine>/parse endpoints. Enable allow_request_proxy_url by default Rustem Kamalov 2026-07-01 01:38:03 +03:00
  • e7af939599 fix: strip features when disabled and normalize feature output. Improve google+bing SERP features extraction v0.8.6 Rustem Kamalov 2026-06-29 10:36:46 +03:00
  • 15bab0295f refactor: extract shared RankState, unify rod/goquery parse paths Rustem Kamalov 2026-06-27 18:04:25 +03:00
  • 4a81ab774c core/http: adopt tls-client for raw+extract fingerprinting. Update docs Rustem Kamalov 2026-06-27 06:10:11 +03:00
  • ba27fcf1f4 remove dead code, pin golangci linters Rustem Kamalov 2026-06-25 17:06:01 +03:00
  • 9cc69da758 feat(cli): clean search, add extract/format flags; harden engines & proxy rotation; fix bugs; update docs v0.8.4 Rustem Kamalov 2026-06-16 03:51:37 +03:00
  • ca3143ccd1 Merge pull request #32 from karust/stability-safety-improvements v0.8.3 Rustem Kamalov 2026-06-12 19:14:29 +03:00
  • 976ceeadf4 fix: report ErrSearchTimeout when results never hydrate; raise integration selector timeout to 15s #32 stability-safety-improvements Rustem Kamalov 2026-06-12 19:06:46 +03:00
  • 04db5347a8 fix(core): harden extract and stabilize request protection Rustem Kamalov 2026-06-12 18:09:40 +03:00
  • 665f09266a fix: derive a per-request deadline from the retry budget. Rustem Kamalov 2026-06-12 04:40:31 +03:00
  • d20a7c53cd fix: centralize engine panic recovery in resilient layer Rustem Kamalov 2026-06-12 04:24:06 +03:00
  • c9e548eb3a Add release build job Rustem Kamalov 2026-06-12 04:00:12 +03:00
  • 59d076616c Add docker image build job Rustem Kamalov 2026-06-12 03:29:57 +03:00
  • 0c7edcd7b6 fix integration tests, dedupe engine smoke tests Rustem Kamalov 2026-06-10 15:42:26 +03:00
  • 45287112df fix docs + google: gate organic results by matched selector, harden answer-box parse Rustem Kamalov 2026-06-10 15:15:42 +03:00
  • b31e84316c Add contributor onboarding kit Rustem Kamalov 2026-06-10 14:54:45 +03:00
  • ffd3d4250c Add OpenSERP SDK usage examples Rustem Kamalov 2026-06-09 04:14:35 +03:00
  • 11d02731b6 Fix extraction limits and strategy Rustem Kamalov 2026-06-09 02:28:54 +03:00
  • 5be448e220 Add client SDKs and integrations Rustem Kamalov 2026-06-05 19:48:27 +03:00
  • aa397eb2c1 Add new URL extraction endpoint and search feature Rustem Kamalov 2026-06-04 02:22:38 +03:00
  • 2b4a80fcb2 fix default search limits Rustem Kamalov 2026-06-02 21:44:58 +03:00
  • 1573642de8 extract region/UULE resolution into dependency-free core/region subpackage v0.7.15 Rustem Kamalov 2026-06-02 05:02:51 +03:00
  • d0006e30ff dedup feature rendering, align default limit, simplify CSS guard Rustem Kamalov 2026-06-02 04:21:56 +03:00
  • 327b65869b Fix yandex search limits Rustem Kamalov 2026-06-02 04:01:14 +03:00
  • 7ed0780192 Add google uule query param support for regional search Rustem Kamalov 2026-06-02 03:54:55 +03:00
  • 2b96a8330f SERP features: AI summary, answer boxes, related searches/questions, etc - for supporting engines + other fixesa and improvements Rustem Kamalov 2026-05-28 01:36:52 +03:00
  • cec16a08ed Normalize query inputs and cache keys v0.7.13 dev Rustem Kamalov 2026-05-24 02:29:04 +03:00
  • 25f4ff942b feat(query): add region parameter for per-engine geo targeting (google, yandex, bing, duck) Rustem Kamalov 2026-05-21 20:45:10 +03:00
  • 82abe57aae Improve SERP result classification and ad positioning Rustem Kamalov 2026-05-19 00:32:11 +03:00
  • b3ca4e0803 feat(api): v2 response shape - absolute rank, ad/organic split, slimmer fields Rustem Kamalov 2026-05-13 01:30:54 +03:00
  • 00630a5d31 refactor: centralize engine prelude, page cleanup, and rate limiter Rustem Kamalov 2026-05-11 11:35:09 +03:00
  • 88337cd7ce refactor: Speed up Baidu. Fix raw client + reuse HTML parsers for raw search Rustem Kamalov 2026-05-08 00:00:33 +03:00
  • 471e5ad7fe refactor: speed up SERP parsing and centralize selectors Rustem Kamalov 2026-05-06 04:12:15 +03:00
  • ed23af7acc feat: add POST /{engine}/parse HTML parser endpoints. One source of truth for browser and raw mode selectors Rustem Kamalov 2026-05-05 05:07:59 +03:00
  • 3eaa30118e fix(ecosia): wire proxy policy, validation, raw mode, and OpenAPI docs Rustem Kamalov 2026-05-05 02:47:47 +03:00
  • 718fad0542 Merge pull request #26 from miku/miku/ecosia Rustem Kamalov 2026-05-04 02:51:08 +03:00
  • 3964653e45 Add search engine ecosia #26 Martin Czygan 2026-04-28 10:31:05 +02:00
  • 5d48690eb3 feat(mega): add mode fast/any/balanced with CB latency-based fast path Rustem Kamalov 2026-05-02 16:30:56 +03:00
  • 0864de9887 Rework browser profiles. Add x-use-profile header. Selectors fixes Rustem Kamalov 2026-04-30 23:32:39 +03:00
  • 063fb74f23 Add browser profile ID in logs and response headers Rustem Kamalov 2026-04-30 20:46:08 +03:00
  • 4d760fab55 fix: browser request blocking cleanup panic Rustem Kamalov 2026-04-29 05:03:30 +03:00
  • f9890ae10f feat: add network bytes telemetry, mega timeout, and per-engine error details Rustem Kamalov 2026-04-29 02:45:16 +03:00
  • e8fb0c24fa feat(proxy): support X-Proxy-URL via per-process browser pool Rustem Kamalov 2026-04-28 03:46:08 +03:00
  • 7a0fb21daf feat: propagate query locale to accept-language header and browser profile v0.7.2 Rustem Kamalov 2026-04-27 04:28:53 +03:00
  • 2b10aca4ac feat: enhance query handling with locale support and date filtering for Bing, DuckDuckGo, Google, and Yandex Rustem Kamalov 2026-04-27 04:07:28 +03:00
  • 94ef0b20b4 docs: update readme to match new api format and features, update architecture doc Rustem Kamalov 2026-04-26 03:50:48 +03:00
  • d47bf08523 fix api response format issues Rustem Kamalov 2026-04-26 02:40:08 +03:00
  • 1bdb103b23 docs: rewrite OpenAPI spec to v1 schema Rustem Kamalov 2026-04-24 05:28:12 +03:00
  • ee42231a09 feat: output format support via ?format= param Rustem Kamalov 2026-04-24 05:23:49 +03:00
  • 16d3a844ad feat: v1 response envelope, normalized Result struct, clusters, and enrichment Rustem Kamalov 2026-04-24 05:21:11 +03:00
  • 6992ad585d feat: typed 400 validation errors with stable reason codes Rustem Kamalov 2026-04-24 05:14:18 +03:00
  • 0ccb13c36e fix(proxy): isolate proxy health from captcha/parser errors, replace re-enable thrash with quarantine Rustem Kamalov 2026-04-24 04:33:41 +03:00
  • e4a84d8914 feat(browser): make configurable resource/tracker blocking Rustem Kamalov 2026-04-24 04:02:23 +03:00
  • 24f9bdab30 perf(browser): smart waits, fix captcha detection selectors + selectors single source of truth Rustem Kamalov 2026-04-23 22:04:28 +03:00
  • d052c30bd5 feat(browser): replace stealth with custom profile functionality Rustem Kamalov 2026-04-23 03:06:49 +03:00
  • e02b374699 Add fingerprints debug tests and endpoint Rustem Kamalov 2026-04-23 00:53:30 +03:00
  • cfd8c418dc feat(browser): reuse persistent rod connection with isolated browser contexts per request Rustem Kamalov 2026-04-22 22:31:20 +03:00
  • 5d15335501 Fix CI Rustem Kamalov 2026-04-22 05:32:59 +03:00
  • 47b5ad3b09 feat: graceful shutdown with drain signal and browser cleanup Rustem Kamalov 2026-04-22 04:25:56 +03:00
  • 0d4e2da960 Improve logging: add structured logs, enrich logs with useful info. Rustem Kamalov 2026-04-22 03:39:30 +03:00
  • d12a301cf8 Enhance error handling and logging across search engines Rustem Kamalov 2026-04-21 03:48:52 +03:00
  • 3a67241cbe feat: refactor docker setup, use chromedp/headless Rustem Kamalov 2026-04-21 02:25:29 +03:00
  • 08edec5779 fix(captcha): exit non-zero on misconfig, tighten solver gate tests Rustem Kamalov 2026-04-20 20:12:19 +03:00
  • 1842c4bb07 feat: implement DrainAndCloseResponse for safe HTTP response handling and update search handlers Rustem Kamalov 2026-04-20 19:39:27 +03:00
  • e89b1a3a50 feat: propagate request context across search, retry, limiter, and browser navigation Rustem Kamalov 2026-04-20 05:53:13 +03:00
  • 0b7fbd3a45 docs: add godoc for public api and readme response examples Rustem Kamalov 2026-04-20 01:20:52 +03:00
  • a9986fd8fe docs: add architecture, OpenAPI spec, Swagger UI, and contributing guide Rustem Kamalov 2026-04-15 03:25:06 +03:00
  • e1142ac23b Improve tests and error handling for search engines Rustem Kamalov 2026-04-15 02:53:11 +03:00
  • e5e0c96303 Add URL builder edge-case tests and server endpoint coverage #24 tests Rustem Kamalov 2026-04-15 02:50:52 +03:00
  • 3af8612ce5 Fingerprint checks during browser integration tests Rustem Kamalov 2026-04-15 02:36:55 +03:00
  • ecacfab4d6 Add integration tests for multiple search engines and enhance error handling Rustem Kamalov 2026-04-14 02:05:58 +03:00
  • de59d07d47 Fix linter errors. Enhance error handling in search functions across multiple engines Rustem Kamalov 2026-04-14 01:12:17 +03:00
  • bc59de46fb Add CI and integration workflows Rustem Kamalov 2026-04-14 01:04:32 +03:00
  • 9e22f68c6f Add sanitized real html pages (google,yandex,baidu) for tests. Raw search HTML parser tests. Rustem Kamalov 2026-04-14 00:41:35 +03:00
  • 518ccdbdbd Revise README for clarity and project details Rustem Kamalov 2026-04-07 22:44:20 +03:00
  • f4c6bf128d Clarify OpenSerp's open-source status and affiliations Rustem Kamalov 2026-04-07 18:34:12 +03:00
  • 10decd5740 Fix config argument, update deault config. v0.6.0 Rustem Kamalov 2026-04-04 19:32:23 +03:00
  • 78a9f1e264 Merge pull request #22 from karust/dev Rustem Kamalov 2026-04-04 18:57:56 +03:00
  • 9f84a648f4 Update config and readme #22 Rustem Kamalov 2026-04-04 18:54:10 +03:00
  • 3c07c7789a Runtime proxy override Rustem Kamalov 2026-04-01 17:38:13 +03:00
  • 3daa48e6a3 Proxy policy wiring and fail-closed execution Rustem Kamalov 2026-04-01 00:54:21 +03:00
  • 8bec5578c0 Implement proxy support with configuration, pooling, and integration tests Rustem Kamalov 2026-03-30 22:46:03 +03:00
  • 0146891076 Add bounded TTL cache for dedicated and mega endpoints Rustem Kamalov 2026-03-30 00:31:49 +03:00
  • f219c78d84 Add retry/circuit breaker, configurable fallback and CORS. Rustem Kamalov 2026-03-25 23:31:41 +03:00
  • 0fcfc06baa Add healthcheck endpoint Rustem Kamalov 2026-03-25 04:09:37 +03:00
  • a4d459761e Add custom browser path support Rustem Kamalov 2026-03-17 02:18:51 +03:00
  • 7cdd358cad Add filter param to Google. Add start param for supporting engines Rustem Kamalov 2026-03-17 01:54:25 +03:00
  • 6c8e205af2 Fix duckduck date and limit filtering. Deduplicate results v0.5.4 Rustem Kamalov 2025-10-08 03:33:48 +03:00