0003f6444b
fix(parser): keep filtering on blank class_ and escape CSS string values ( #417 )
2026-08-19 22:13:14 +03:00
39ecbf0f9a
docs: update stars history
2026-08-19 22:04:12 +03:00
c0326263b5
fix(stealth): solve Cloudflare challenges regardless of locale + retry cap + fix crashing mid-solve
...
The solver matched English challenge strings, so any non-default locale left the challenge unsolved.
The real cause was Playwright's context locale option patching the main thread only, while Web Workers kept the browser language, a mismatch Cloudflare rejects. Locale is now applied via browser launch flags, so the page, workers, and the Accept-Language header stay consistent, and the solver checks the language-free challenge markers with a retry cap.
Also catch patchright errors in the page-content retry so stealth pages stop crashing mid-solve.
Co-Authored-By: Parash Subedi <parash.subedi@grepsr.com >
2026-08-19 21:59:34 +03:00
9376a3d8c4
Merge branch 'main' into dev
2026-08-19 20:23:42 +03:00
cb00f1bba8
docs: adding a new sponsor
2026-08-19 20:06:03 +03:00
e90875f31f
docs: fix missing parts from the updates
...
Missing from #414
2026-08-19 02:03:32 +03:00
029d098c06
fix: require authentication by default for the HTTP transport ( #414 )
...
Co-authored-by: MJ <kaalu@MJs-MacBook-Air.local >
2026-08-19 01:56:23 +03:00
0e1e085aa7
build: correcting dep version
2026-08-19 01:54:05 +03:00
1cd938e040
build: pump version and deps
2026-08-19 01:13:30 +03:00
316b6d238c
fix(parser): find/find_all with class_ silently miss multi-class elements ( #410 )
2026-08-19 00:18:12 +03:00
69a2985ada
fix(parser): match multi-class elements in find/find_all class_ filter
2026-08-12 00:02:23 -04:00
5d213a2d47
v0.4.14 ( #409 )
2026-08-11 01:27:00 +03:00
90c30446ff
Merge branch 'main' into dev
2026-08-11 01:09:42 +03:00
2b9d0e2933
style: image size adjustment
2026-08-11 01:07:32 +03:00
2c371e0f2e
docs: add stars history manually because of Github API changes
...
Ref.: https://www.star-history.com/blog/github-stargazer-api-restriction
2026-08-11 01:03:00 +03:00
4e0ac98d8c
build: pump version and deps
2026-08-11 00:58:50 +03:00
3f32fa9050
docs: re-adding a sponsor
...
Revert: https://github.com/D4Vinci/Scrapling/commit/253d316a89c4207b6959d08484fcbd4243bb879f#diff-d0a2065f1a22f388fa5e96f04ebba0efa783c45613b500d78b3b2f1a2341d9cb
2026-08-11 00:37:19 +03:00
9af7e2796a
docs: adding a new sponsor
2026-08-11 00:30:14 +03:00
64bc7007b0
v0.4.13 ( #406 )
2026-08-09 22:06:36 +03:00
10c6c8951e
perf(mcp): Add more specific instruction to the server-level instructions
2026-08-09 22:05:58 +03:00
b2106e6054
docs: add an AI policy for contributions
2026-08-09 21:20:49 +03:00
b498fe7ee0
docs: update benchmarks results with the latest numbers
2026-08-09 21:14:53 +03:00
fad6893d66
docs: add the new templates to the docs
2026-08-09 20:56:29 +03:00
6e41f335f9
fix(xml template): Be specific about the node type hint
2026-08-09 20:49:28 +03:00
9bbd7c8b25
feat(spiders): Add XML/CSV feed templates + docs
2026-08-09 20:44:12 +03:00
f8893d9b58
fix(ai): size the MCP bulk page pools within the validator bounds ( #393 )
2026-08-09 20:18:53 +03:00
0f2397c769
feat(mcp): add a scrapling-mcp console shortcut for easier MCP registration
2026-08-09 19:19:52 +03:00
902b617a15
fix(mcp): point the server card website_url at the MCP docs page
2026-08-09 19:06:08 +03:00
0e16c4d471
feat(mcp): add tool annotations, server card metadata, and a tools/list cache hint
2026-08-09 19:01:39 +03:00
e90367b7ab
feat(mcp): Make tools description shorter and add server-level instructions
2026-08-09 18:36:20 +03:00
346fe9c25c
build: pump version and deps
2026-08-09 16:45:55 +03:00
e978f8616d
fix:(mcp): upgrade mcp server to v2
...
Fixes #392
2026-08-09 16:29:16 +03:00
2fb5e429f2
fix(browser version): extract current chrome version from playwright package data
...
Fixes #394 #396 #400
2026-08-09 00:41:05 +03:00
39847bd2da
docs: removing a sponsor
2026-08-06 16:00:32 +03:00
bc0cf7dede
docs: typo fix
2026-07-30 17:31:34 +03:00
efc0de2936
docs: adding new sponsor
2026-07-30 17:30:17 +03:00
80d78cc362
docs: typo fix
2026-07-27 14:01:05 +03:00
87e010a2e8
docs: fix
2026-07-27 12:38:38 +03:00
ebb0dbfdc3
ci: fixes
2026-07-27 12:34:46 +03:00
fc96fcc386
v0.4.12 ( #388 )
2026-07-26 23:23:21 +03:00
1166ce3368
ci: lock workflows to be triggered by the repo owner alone
2026-07-26 23:19:51 +03:00
0a7fec8f86
feat(spiders): Add exporters to CSV/XML
2026-07-26 23:13:35 +03:00
347db4c76b
docs: add the auto throttle option
2026-07-26 23:04:28 +03:00
ca51962421
feat(spiders): Auto throttle based on website speed/protection
2026-07-26 22:54:36 +03:00
9526bac808
agent: update the skill with the latest updates
2026-07-26 19:04:48 +03:00
563b134f9e
feat(mcp): Add auth to the mcp server and the option to set allowed host
2026-07-26 19:02:16 +03:00
0ca4aeabae
docs: Update main pages with the recently added features
2026-07-26 16:40:49 +03:00
9ecffdb42f
fix(cdp): Make browsers accept CDP urls with http protocol
2026-07-26 16:23:00 +03:00
f293d83fda
ci(docker): tag images with the release version on merge ( #384 )
2026-07-26 16:03:22 +03:00
d08aa90d9e
Merge branch 'main' into dev
2026-07-26 16:01:45 +03:00
Mrityunjay SIngh