Commit Graph

4 Commits (55d08e76757ba31f263fa1ab7cf0288bc4ac9756)

Author SHA1 Message Date
Raphaël Vinot cde3d29892 new: Add option to use User agents of the Lookyloo users for scraping 2020-06-25 16:43:58 +02:00
Raphaël Vinot ab4b83c9b5 new: Add more recent user agents list 2020-02-28 12:52:58 +01:00
Raphaël Vinot 5cfe5306b2 fix: Skip UA fetch on cloudflare website until the lib is updated 2019-12-17 14:29:58 +01:00
Raphaël Vinot 320105aca1 fix: Get most common user agents from willshouse.com behind cloudflare 2019-05-27 15:34:26 +02:00