mirror of
https://github.com/gosom/google-maps-scraper.git
synced 2026-09-19 07:27:12 +08:00
963e86bc20
* port custom fixes to new scrapemate.BrowserPage API Integrates our 5 custom fixes (originally written against playwright.Page) into the upstream scrapemate.BrowserPage interface introduced ineef673b. Changes: - job.go: ignore WaitForURL errors instead of returning (proxy latency fix) - job.go: increase div[role='feed'] WaitForSelector timeout 700ms → 10s - place.go: ignore WaitForURL errors instead of returning - place.go: lower ExtraReviews threshold >8 → >0 (fetch reviews for all places) - emailjob.go: add normalizeGoogleURL() to unwrap Google redirect URLs (/url?q=http://...) before creating the email extraction job Dropped: playwright-specific debug infrastructure (setupPageListeners, saveDebugInfo) — not compatible with scrapemate.BrowserPage. Dropped: f9db0ea JS key search and ae900fb nil-check — already superseded by upstream'seef673bimplementation. * Add extended review fields: review_id, source, language, translation, reply data, timestamps * Fix wsl linter: add blank lines around cuddled assignments --------- Co-authored-by: Georgios Komninos <454718+gosom@users.noreply.github.com>