Rustem Kamalov
0ccb13c36e
fix(proxy): isolate proxy health from captcha/parser errors, replace re-enable thrash with quarantine
2026-04-24 04:33:41 +03:00
Rustem Kamalov
e4a84d8914
feat(browser): make configurable resource/tracker blocking
2026-04-24 04:02:23 +03:00
Rustem Kamalov
24f9bdab30
perf(browser): smart waits, fix captcha detection selectors + selectors single source of truth
2026-04-23 22:04:28 +03:00
Rustem Kamalov
d052c30bd5
feat(browser): replace stealth with custom profile functionality
2026-04-23 03:06:49 +03:00
Rustem Kamalov
e02b374699
Add fingerprints debug tests and endpoint
2026-04-23 00:53:30 +03:00
Rustem Kamalov
cfd8c418dc
feat(browser): reuse persistent rod connection with isolated browser contexts per request
2026-04-22 22:31:20 +03:00
Rustem Kamalov
5d15335501
Fix CI
2026-04-22 05:32:59 +03:00
Rustem Kamalov
47b5ad3b09
feat: graceful shutdown with drain signal and browser cleanup
2026-04-22 04:25:56 +03:00
Rustem Kamalov
0d4e2da960
Improve logging: add structured logs, enrich logs with useful info.
2026-04-22 03:39:30 +03:00
Rustem Kamalov
d12a301cf8
Enhance error handling and logging across search engines
2026-04-21 03:48:52 +03:00
Rustem Kamalov
3a67241cbe
feat: refactor docker setup, use chromedp/headless
2026-04-21 02:25:29 +03:00
Rustem Kamalov
08edec5779
fix(captcha): exit non-zero on misconfig, tighten solver gate tests
2026-04-20 20:12:19 +03:00
Rustem Kamalov
1842c4bb07
feat: implement DrainAndCloseResponse for safe HTTP response handling and update search handlers
2026-04-20 19:39:27 +03:00
Rustem Kamalov
e89b1a3a50
feat: propagate request context across search, retry, limiter, and browser navigation
2026-04-20 05:53:13 +03:00
Rustem Kamalov
0b7fbd3a45
docs: add godoc for public api and readme response examples
2026-04-20 01:20:52 +03:00
Rustem Kamalov
a9986fd8fe
docs: add architecture, OpenAPI spec, Swagger UI, and contributing guide
2026-04-15 03:25:06 +03:00
Rustem Kamalov
e5e0c96303
Add URL builder edge-case tests and server endpoint coverage
2026-04-15 02:50:52 +03:00
Rustem Kamalov
3af8612ce5
Fingerprint checks during browser integration tests
2026-04-15 02:36:55 +03:00
Rustem Kamalov
9e22f68c6f
Add sanitized real html pages (google,yandex,baidu) for tests. Raw search HTML parser tests.
2026-04-14 00:41:35 +03:00
Rustem Kamalov
3c07c7789a
Runtime proxy override
2026-04-01 17:38:13 +03:00
Rustem Kamalov
3daa48e6a3
Proxy policy wiring and fail-closed execution
...
- replace proxy wiring with global and per-engine tag policies
- split stats endpoints and lock fail-closed proxy behavior with tests
2026-04-01 00:54:21 +03:00
Rustem Kamalov
8bec5578c0
Implement proxy support with configuration, pooling, and integration tests
...
- Added ProxyConfig and ProxyPool structures to manage proxy settings and rotation.
- Implemented normalization functions for proxy URLs and configurations.
- Created a new ProxyPool that supports failure tracking and round-robin selection.
- Integrated proxy handling into the ResilientSearcher for search queries.
- Added integration tests for various proxy scenarios including SOCKS5 and HTTP proxies.
- Updated server and resilience stats to include proxy information.
- Refactored search functions to utilize the new proxy client.
- Removed direct proxy handling from search_raw.go and yandex/search_raw.go, using the new core proxy client instead.
- Added unit tests for proxy configuration and pool behavior.
2026-03-30 22:46:03 +03:00
Rustem Kamalov
0146891076
Add bounded TTL cache for dedicated and mega endpoints
2026-03-30 00:31:49 +03:00
Rustem Kamalov
f219c78d84
Add retry/circuit breaker, configurable fallback and CORS.
...
Based in part on work from PR #21 by @Sai-Prashanth123, adapted and integrated with project-specific fixes.
2026-03-25 23:31:41 +03:00
Rustem Kamalov
0fcfc06baa
Add healthcheck endpoint
2026-03-25 04:09:37 +03:00
Rustem Kamalov
a4d459761e
Add custom browser path support
2026-03-17 02:18:51 +03:00
Rustem Kamalov
7cdd358cad
Add filter param to Google. Add start param for supporting engines
2026-03-17 01:54:25 +03:00
Rustem Kamalov
0a347edc77
New megasearch and megaimage functionality. Update readme
2025-10-01 04:34:41 +03:00
Rustem Kamalov
de0a6a80d4
DuckDuck fixes. Non-stealth antibot fixes
2025-10-01 04:30:58 +03:00
Rustem Kamalov
74fc15a6e2
Add DuckDuckGo. Add custom logger. Fix arg priority and other issues
2025-09-30 05:27:54 +03:00
Rustem Kamalov
49e9837878
Fix build issues
2025-08-29 03:44:38 +03:00
Rustem Kamalov
d8c3700252
Stealth browser as option. Update default config
2025-08-18 22:49:45 +03:00
Rustem Kamalov
7f0f32ac4e
Handle failed navigation
2025-07-03 02:29:12 +03:00
Pachakutiq
6691ebaadd
fix: Remove duplicated results for all search engines and both modes
2025-04-10 16:59:31 +08:00
Pachakutiq
b2ffcf8477
feat: Support http and socks5 proxy (support authentication) for chrome driver mode
2025-04-08 23:51:44 +08:00
Pachakutiq
84e2d46c4b
feat: Support http and socks5 proxy with auth for raw search
2025-04-08 16:06:41 +08:00
Rustem Kamalov
0a3c07b149
Collects google ads/answers + captcha solver test
2024-05-06 01:13:07 +03:00
Rustem Kamalov
482f725c10
Remove random UA generator
2024-05-06 00:53:57 +03:00
Rustem Kamalov
a3455b592d
Add image API
2023-07-23 04:37:01 +03:00
Rustem Kamalov
38183b804a
Google images scroll parsing
2023-07-23 04:35:28 +03:00
Rustem Kamalov
df972585c1
Fix default ratelimiter
2023-06-30 22:04:26 +03:00
Rustem Kamalov
dd5e0a2069
Default ratelimeter
2023-06-28 22:20:19 +03:00
Rustem Kamalov
72bddf7fc9
SearchTimeout error handling and proper tabs close
2023-06-27 23:13:10 +03:00
Rustem Kamalov
c175d0c386
Default config fix, manual bot test
2023-06-26 15:30:24 +03:00
Rustem Kamalov
3f84503ce3
Add captcha check and error
2023-06-25 20:41:47 +03:00
Rustem Kamalov
46758db428
Check and log errors
2023-06-24 22:27:54 +03:00
Rustem Kamalov
8b87e7b4ab
Init
2023-06-23 04:08:00 +03:00
