Rustem Kamalov
|
9cc69da758
|
feat(cli): clean search, add extract/format flags; harden engines & proxy rotation; fix bugs; update docs
- Add structured `search [engine] [query]` CLI: --limit/--lang/--region/--site/--file, --format (json|text|markdown|ndjson), --extract N, --search-timeout; Envelope and route logs to stderr with a --quiet default (fixes stdout pollution)
- Unify engines behind a single engineSpec registry (CLI + serve share it)
- Unify the extract knob to bool-or-int `extract=N` (drop extract_top); CLI and HTTP share core batch extraction, raw/rendered fetch, and clamp helpers
- Engines: Ecosia CF captcha detection (raw + browser), Yandex progressive-result wait, Google PAA poll + Has() existence probes, Bing title/desc attribute fallbacks
- Proxy: rotate challenged proxies out of the tag pool for one retry (X-Proxy-Attempts); browser health-ping skip window; opt-in WaitStable
|
2026-06-16 03:51:37 +03:00 |
|
Rustem Kamalov
|
c9e548eb3a
|
Add release build job
|
2026-06-12 04:00:12 +03:00 |
|
Rustem Kamalov
|
59d076616c
|
Add docker image build job
|
2026-06-12 03:29:57 +03:00 |
|
Rustem Kamalov
|
ffd3d4250c
|
Add OpenSERP SDK usage examples
|
2026-06-09 04:14:35 +03:00 |
|
Rustem Kamalov
|
5be448e220
|
Add client SDKs and integrations
|
2026-06-05 19:48:27 +03:00 |
|
Rustem Kamalov
|
aa397eb2c1
|
Add new URL extraction endpoint and search feature
|
2026-06-04 02:22:38 +03:00 |
|
Rustem Kamalov
|
2b4a80fcb2
|
fix default search limits
|
2026-06-02 21:44:58 +03:00 |
|
Rustem Kamalov
|
7ed0780192
|
Add google uule query param support for regional search
|
2026-06-02 03:54:55 +03:00 |
|
Rustem Kamalov
|
2b96a8330f
|
SERP features: AI summary, answer boxes, related searches/questions, etc - for supporting engines + other fixesa and improvements
|
2026-05-28 01:36:52 +03:00 |
|
Rustem Kamalov
|
cec16a08ed
|
Normalize query inputs and cache keys
|
2026-05-24 02:29:04 +03:00 |
|
Rustem Kamalov
|
25f4ff942b
|
feat(query): add region parameter for per-engine geo targeting (google, yandex, bing, duck)
|
2026-05-21 20:45:10 +03:00 |
|
Rustem Kamalov
|
82abe57aae
|
Improve SERP result classification and ad positioning
|
2026-05-19 00:32:11 +03:00 |
|
Rustem Kamalov
|
b3ca4e0803
|
feat(api): v2 response shape - absolute rank, ad/organic split, slimmer fields
|
2026-05-13 01:30:54 +03:00 |
|
Rustem Kamalov
|
00630a5d31
|
refactor: centralize engine prelude, page cleanup, and rate limiter
|
2026-05-11 11:35:09 +03:00 |
|
Rustem Kamalov
|
3eaa30118e
|
fix(ecosia): wire proxy policy, validation, raw mode, and OpenAPI docs
|
2026-05-05 02:47:47 +03:00 |
|
Rustem Kamalov
|
5d48690eb3
|
feat(mega): add mode fast/any/balanced with CB latency-based fast path
|
2026-05-02 16:30:56 +03:00 |
|
Rustem Kamalov
|
94ef0b20b4
|
docs: update readme to match new api format and features, update architecture doc
|
2026-04-26 03:50:48 +03:00 |
|
Rustem Kamalov
|
5d15335501
|
Fix CI
|
2026-04-22 05:32:59 +03:00 |
|
Rustem Kamalov
|
d12a301cf8
|
Enhance error handling and logging across search engines
|
2026-04-21 03:48:52 +03:00 |
|
Rustem Kamalov
|
e89b1a3a50
|
feat: propagate request context across search, retry, limiter, and browser navigation
|
2026-04-20 05:53:13 +03:00 |
|
Rustem Kamalov
|
0b7fbd3a45
|
docs: add godoc for public api and readme response examples
|
2026-04-20 01:20:52 +03:00 |
|
Rustem Kamalov
|
ecacfab4d6
|
Add integration tests for multiple search engines and enhance error handling
- Implement integration tests for Baidu, Bing, DuckDuckGo, Google, and Yandex.
- Refactor test utility functions to avoid core import cycles.
|
2026-04-14 02:05:58 +03:00 |
|
Rustem Kamalov
|
518ccdbdbd
|
Revise README for clarity and project details
Updated project description and clarified affiliation.
|
2026-04-07 22:44:20 +03:00 |
|
Rustem Kamalov
|
f4c6bf128d
|
Clarify OpenSerp's open-source status and affiliations
Added clarification about OpenSerp's open-source status and third-party affiliations.
|
2026-04-07 18:34:12 +03:00 |
|
Rustem Kamalov
|
9f84a648f4
|
Update config and readme
|
2026-04-04 18:54:10 +03:00 |
|
Rustem Kamalov
|
7cdd358cad
|
Add filter param to Google. Add start param for supporting engines
|
2026-03-17 01:54:25 +03:00 |
|
Rustem Kamalov
|
6c8e205af2
|
Fix duckduck date and limit filtering. Deduplicate results
|
2025-10-08 03:33:48 +03:00 |
|
Rustem Kamalov
|
b4ef23a913
|
Add megasearch API response example
|
2025-10-01 04:56:40 +03:00 |
|
Rustem Kamalov
|
0a347edc77
|
New megasearch and megaimage functionality. Update readme
|
2025-10-01 04:34:41 +03:00 |
|
Pachakutiq
|
2f77dd6fe5
|
doc: Add proxy guide in README.md
|
2025-04-09 02:55:59 +08:00 |
|
Pachakutiq
|
ec03439b2f
|
style: Format README.md using prettier
|
2025-04-09 02:11:22 +08:00 |
|
Rustem Kamalov
|
0a3c07b149
|
Collects google ads/answers + captcha solver test
|
2024-05-06 01:13:07 +03:00 |
|
Rustem Kamalov
|
b040b24a70
|
Readme update
|
2023-08-06 15:09:26 +03:00 |
|
Rustem Kamalov
|
dd5e0a2069
|
Default ratelimeter
|
2023-06-28 22:20:19 +03:00 |
|
Rustem Kamalov
|
c175d0c386
|
Default config fix, manual bot test
|
2023-06-26 15:30:24 +03:00 |
|
Rustem Kamalov
|
6c4eb8db1a
|
Radme and default configs fix
|
2023-06-25 20:39:14 +03:00 |
|
Rustem Kamalov
|
826f4d7861
|
Readme and default config change
|
2023-06-24 22:25:43 +03:00 |
|
Rustem Kamalov
|
d8b9bae18f
|
typo
|
2023-06-23 04:25:11 +03:00 |
|
Rustem Kamalov
|
8b87e7b4ab
|
Init
|
2023-06-23 04:08:00 +03:00 |
|
Rustem Kamalov
|
dbcb116e48
|
Initial commit
|
2023-06-23 03:03:09 +03:00 |
|