3b0f0b6b7d
Golang1.24.3 ( #144 )
...
* chore: Uses latest golang version 1.24.3
* chore: Updates dependencies versions
* chore: Exits with code 0 when job finish
* chore: Updates README to include the required golang version
* chore: go mod tidy
2025-05-10 09:06:07 +03:00
dd79da9af7
go mod tidy
2025-04-29 07:45:12 +03:00
e5951085be
chore: Update dependencies
2025-04-29 07:40:29 +03:00
7502590446
chore: Updates packages with vulnerabilities and uses go 1.24 tools ( #133 )
2025-03-29 15:44:13 +02:00
00699ead78
chore: go mod tidy
2025-02-12 00:07:05 +02:00
c649a579a5
chore: Fixes wrong browser issue
...
The previous version of scrapemate required chrome but the project
uses chromium. This lead to an error in the Docker container or
systems were chrome was not available.
2025-02-12 00:05:20 +02:00
5378ff3604
chore: Bumps versions ( #126 )
...
Updates go modules and Dockerfile go version
2025-02-08 18:17:10 +02:00
727b6c6416
impr: Improves perfomance by reusing the browser page
2025-01-19 14:55:52 +02:00
281f72dd10
bump: Bumps scrapemate to v0.8.5 ( #114 )
2025-01-18 15:21:24 +02:00
d4d1358f57
fixes go.sum
2025-01-01 11:09:34 +02:00
a3f7ac2000
Bumps scrapemate version to v0.8.4
2025-01-01 11:04:59 +02:00
00bb13a087
Add FastMode to fetch results much faster ( #102 )
...
Utilizing scrapemate's stealth mode to try to fetch directly the results
without JS rendering. This version is much faster.
However the version is still in BETA.
Results are not extracted in full and there is the possibility of the
client being blocked
2024-12-15 13:06:01 +02:00
8480e2473d
aws lambda execution runtime ( #96 )
...
reduction of docker image size
better playwright settings
2024-11-03 15:31:57 +02:00
1ea5769279
support for HTTP/HTTPS/SOCKS5 proxies ( #94 )
2024-11-02 11:32:59 +02:00
aaa999e699
Bumps scrapemate to v0.7.1
2024-10-20 13:26:10 +03:00
0b8797b8ee
SOCKS5 proxy support ( #84 )
...
* SOCKS5 proxy support
* fixes pipeline
* fixes go.sum
2024-10-20 12:14:29 +03:00
c15ecb8024
Bump v0.6.1 scrapemate ( #83 )
...
* Fix exit due to inactivity
* Bumps scrapemate version to 0.6.1
* go mod tidy
2024-10-20 08:34:00 +03:00
4cb322b000
Webapp ( #80 )
...
* inital web app
* ui improvement
* Web UI added
* Fix code scanning alert no. 1: Uncontrolled data used in path expression
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* adds validations
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2024-10-16 18:55:49 +03:00
7bba0a0d92
Add telementry support to collect anonymous statistics
2024-10-13 17:38:14 +03:00
60012f6859
uses go123
2024-09-21 16:04:13 +03:00
510c59e745
perfomance improvements
2024-05-01 11:07:40 +03:00
08f515f92c
Adds extraction of emails from the business website
2023-11-24 19:30:32 +02:00
4f9bc31282
fix in popular times
2023-09-16 16:02:07 +03:00
27ef055f79
uses scrapemate v0.5.2
2023-09-08 20:57:04 +03:00
f09017d459
extracts more datapoints & adds csv export support
2023-09-08 20:50:47 +03:00
83b0ffbec4
updates scrapemate
2023-09-02 14:18:54 +03:00
8c469b9ab5
go mod tidy
2023-09-01 18:27:24 +03:00
570f7f3ccb
adds capability to exit application when crawler is inactive for a period of time
2023-09-01 18:24:16 +03:00
ed2870c301
updates gosum
2023-05-14 15:04:39 +03:00
f3037a21d0
updates scrapemate
2023-05-14 15:02:33 +03:00
b867226004
Adds database provider for distributed crawling
2023-05-14 15:01:48 +03:00
fbe3d93964
pass linters and uses new scrapemate version with improved perfomance
2023-05-13 17:08:42 +03:00
302aa4ff6a
Adds support for multiple languages
2023-05-07 09:31:41 +03:00
85783abb7c
initial commit
2023-04-22 17:37:57 +03:00
Georgios Komninos