Commit Graph

25 Commits (7a34095d9c18f2efde8b16c9f1a09d6038ca2786)

Author SHA1 Message Date
Raphaël Vinot 7a34095d9c new: Config option for Flask IP and Port, reorganize config loading 2020-09-21 16:41:30 +02:00
Raphaël Vinot c75b9e65fe chg: Remove known content from SaneJS module 2020-08-25 15:51:08 +02:00
Raphaël Vinot 5ae7f0f7e4 new: Initial version of cookies indexing 2020-07-08 15:42:13 +02:00
Raphaël Vinot 05de56022f chg: Use capture UUID as a reference everywhere 2020-06-29 12:01:31 +02:00
Raphaël Vinot 98495c40a9 chg: Make mypy happy 2020-06-25 17:08:11 +02:00
Raphaël Vinot cde3d29892 new: Add option to use User agents of the Lookyloo users for scraping 2020-06-25 16:43:58 +02:00
Raphaël Vinot 3a3be0cb46 new: Add handles for cookies 2020-05-26 17:45:04 +02:00
Raphaël Vinot 466cb5fcd5 chg: Improve typing 2020-05-18 18:32:59 +02:00
Raphaël Vinot 754ae9354d new: Add email notification feature 2020-05-11 19:01:06 +02:00
Raphaël Vinot 487222b81e fix: Do not fail when getting the UA breaks 2020-05-02 01:41:29 +02:00
Raphaël Vinot e62d56e555 chg: Bump har2tree, cleanup 2020-04-01 14:33:35 +02:00
Raphaël Vinot 17c3473d95 new: Add config files, initial support for 3rd party modules 2020-03-31 14:12:57 +02:00
Raphaël Vinot 949ad58667 chg: Refactoring of the redirects, rename report -> capture 2020-03-26 01:56:24 +01:00
Raphaël Vinot f26a02ef86 new: Add link redirects on index 2020-03-23 12:45:57 +01:00
Raphaël Vinot c9cbf27acc chg: Fix typing 2020-01-24 11:25:53 +01:00
Raphaël Vinot f1309ce5e3 new: Upload optional cookie file 2020-01-24 10:17:41 +01:00
Raphaël Vinot f1d83d29cf new: Add support for user defined cookies, bump deps 2020-01-23 10:52:50 +01:00
Raphaël Vinot d34233ad5c chg: Use poetry instead of pipenv 2020-01-21 17:39:18 +01:00
Raphaël Vinot dec6920cb8 chg: Add typing 2020-01-06 15:32:38 +01:00
Raphaël Vinot 5cfe5306b2 fix: Skip UA fetch on cloudflare website until the lib is updated 2019-12-17 14:29:58 +01:00
Raphaël Vinot 320105aca1 fix: Get most common user agents from willshouse.com behind cloudflare 2019-05-27 15:34:26 +02:00
Raphaël Vinot 36c856ef9b new: Add initial support for user-agent 2019-03-29 20:11:44 +01:00
Raphaël Vinot 9f2b7f7b93 new: Add error page 2019-02-18 13:52:48 +01:00
Raphaël Vinot 6bc316ebcf new: Initial commit for client and async scraping 2019-01-29 18:37:13 +01:00
Raphaël Vinot bbb8c5343f chg: Cleanup, use pipfile 2019-01-23 15:13:29 +01:00