Commit Graph

34 Commits

Author SHA1 Message Date
Rustem Kamalov
08edec5779 fix(captcha): exit non-zero on misconfig, tighten solver gate tests 2026-04-20 20:12:19 +03:00
Rustem Kamalov
1842c4bb07 feat: implement DrainAndCloseResponse for safe HTTP response handling and update search handlers 2026-04-20 19:39:27 +03:00
Rustem Kamalov
e89b1a3a50 feat: propagate request context across search, retry, limiter, and browser navigation 2026-04-20 05:53:13 +03:00
Rustem Kamalov
0b7fbd3a45 docs: add godoc for public api and readme response examples 2026-04-20 01:20:52 +03:00
Rustem Kamalov
e5e0c96303 Add URL builder edge-case tests and server endpoint coverage 2026-04-15 02:50:52 +03:00
Rustem Kamalov
ecacfab4d6 Add integration tests for multiple search engines and enhance error handling
- Implement integration tests for Baidu, Bing, DuckDuckGo, Google, and Yandex.
- Refactor test utility functions to avoid core import cycles.
2026-04-14 02:05:58 +03:00
Rustem Kamalov
de59d07d47 Fix linter errors. Enhance error handling in search functions across multiple engines 2026-04-14 01:12:17 +03:00
Rustem Kamalov
9e22f68c6f Add sanitized real html pages (google,yandex,baidu) for tests. Raw search HTML parser tests. 2026-04-14 00:41:35 +03:00
Rustem Kamalov
8bec5578c0 Implement proxy support with configuration, pooling, and integration tests
- Added ProxyConfig and ProxyPool structures to manage proxy settings and rotation.
- Implemented normalization functions for proxy URLs and configurations.
- Created a new ProxyPool that supports failure tracking and round-robin selection.
- Integrated proxy handling into the ResilientSearcher for search queries.
- Added integration tests for various proxy scenarios including SOCKS5 and HTTP proxies.
- Updated server and resilience stats to include proxy information.
- Refactored search functions to utilize the new proxy client.
- Removed direct proxy handling from search_raw.go and yandex/search_raw.go, using the new core proxy client instead.
- Added unit tests for proxy configuration and pool behavior.
2026-03-30 22:46:03 +03:00
Rustem Kamalov
7cdd358cad Add filter param to Google. Add start param for supporting engines 2026-03-17 01:54:25 +03:00
Rustem Kamalov
74fc15a6e2 Add DuckDuckGo. Add custom logger. Fix arg priority and other issues 2025-09-30 05:27:54 +03:00
Rustem Kamalov
49e9837878 Fix build issues 2025-08-29 03:44:38 +03:00
Pachakutiq
8fdefb6ed5 fix(google)!: Fix missing datas 2025-08-28 16:44:22 +08:00
Pachakutiq
81fc057c83 feat(raw search)!: Use utls to mimic chrome TLS clienthello fingerprint 2025-08-28 16:43:39 +08:00
Rustem Kamalov
7f0f32ac4e Handle failed navigation 2025-07-03 02:29:12 +03:00
Pachakutiq
6691ebaadd fix: Remove duplicated results for all search engines and both modes 2025-04-10 16:59:31 +08:00
Pachakutiq
8099dae3ce fix: Remove duplicated results in google/search.go 2025-04-10 15:35:54 +08:00
Pachakutiq
21f12c5996 fix: Google updated DOM of search result page 2025-04-08 18:48:07 +08:00
Pachakutiq
84e2d46c4b feat: Support http and socks5 proxy with auth for raw search 2025-04-08 16:06:41 +08:00
Pachakutiq
205f722ddc fix: Fix search crash (slice bounds out of range [4:1]) 2024-12-01 23:35:11 +08:00
Rustem Kamalov
aeb0616249 Fix google images selector + baidu images ads tag 2024-05-12 02:57:39 +03:00
Rustem Kamalov
0a3c07b149 Collects google ads/answers + captcha solver test 2024-05-06 01:13:07 +03:00
Rustem Kamalov
923b7c2443 Additional google query params 2024-05-06 00:51:35 +03:00
Rustem Kamalov
e2bdad75dd Google: Fix total results bug, Fix captcha detection 2024-02-07 01:30:57 +03:00
Rustem Kamalov
b040b24a70 Readme update 2023-08-06 15:09:26 +03:00
Rustem Kamalov
38183b804a Google images scroll parsing 2023-07-23 04:35:28 +03:00
Rustem Kamalov
e12fff8313 Google image search test 2023-07-12 02:17:04 +03:00
Rustem Kamalov
df972585c1 Fix default ratelimiter 2023-06-30 22:04:26 +03:00
Rustem Kamalov
dd5e0a2069 Default ratelimeter 2023-06-28 22:20:19 +03:00
Rustem Kamalov
72bddf7fc9 SearchTimeout error handling and proper tabs close 2023-06-27 23:13:10 +03:00
Rustem Kamalov
3f84503ce3 Add captcha check and error 2023-06-25 20:41:47 +03:00
Rustem Kamalov
46758db428 Check and log errors 2023-06-24 22:27:54 +03:00
Rustem Kamalov
801e3ddfd3 Fix package paths 2023-06-23 04:16:45 +03:00
Rustem Kamalov
8b87e7b4ab Init 2023-06-23 04:08:00 +03:00