Files
knoellp 963e86bc20 gmaps: Add extended review fields (source, language, timestamps, reply) (#272)
* port custom fixes to new scrapemate.BrowserPage API

Integrates our 5 custom fixes (originally written against playwright.Page)
into the upstream scrapemate.BrowserPage interface introduced in eef673b.

Changes:
- job.go: ignore WaitForURL errors instead of returning (proxy latency fix)
- job.go: increase div[role='feed'] WaitForSelector timeout 700ms → 10s
- place.go: ignore WaitForURL errors instead of returning
- place.go: lower ExtraReviews threshold >8 → >0 (fetch reviews for all places)
- emailjob.go: add normalizeGoogleURL() to unwrap Google redirect URLs
  (/url?q=http://...) before creating the email extraction job

Dropped: playwright-specific debug infrastructure (setupPageListeners,
saveDebugInfo) — not compatible with scrapemate.BrowserPage.
Dropped: f9db0ea JS key search and ae900fb nil-check — already superseded
by upstream's eef673b implementation.

* Add extended review fields: review_id, source, language, translation, reply data, timestamps

* Fix wsl linter: add blank lines around cuddled assignments

---------

Co-authored-by: Georgios Komninos <454718+gosom@users.noreply.github.com>
2026-05-30 10:16:44 +03:00
..