Commit Graph

1403 Commits (e94b1e05b8fa656d237905665c117a636adcee45)

Author SHA1 Message Date
Raphaël Vinot bda2e2c473 chg: Bump deps, fix handling of HTTP status code 0 2021-09-06 13:19:58 +02:00
Raphaël Vinot 60f4a09d28 fix: Avoid "None" in URL field if no predefined URL is given. 2021-09-03 17:07:48 +02:00
Raphaël Vinot e213cb5ae8 fix: make mypy happy. 2021-09-03 17:05:26 +02:00
Raphaël Vinot dcfd9cc6a9 new: Re-capture a URL and change parameters. 2021-09-03 16:57:48 +02:00
Raphaël Vinot 51ae62f257 chg: Bump pillow 2021-09-03 15:26:24 +02:00
Raphaël Vinot 66816ba205 chg: Bump flask-restx 2021-09-02 15:08:49 +02:00
Raphaël Vinot 7ea37ec617 fix: Avoid exception if capture finishes between two calls. 2021-09-01 16:57:20 +02:00
Raphaël Vinot c09adec333 chg: Improve logging. 2021-09-01 14:08:25 +02:00
Raphaël Vinot 25d5beaaaf chg: Improve monitoring 2021-09-01 12:45:36 +02:00
Raphaël Vinot 72d85c62e3 fix: Use redis ConnectionError to avoid exception on shutdown 2021-09-01 12:44:57 +02:00
Raphaël Vinot 797de9ddb3 fix: remove datefmt from logging.basicConfig, it was a bad idea. 2021-09-01 10:40:59 +02:00
Raphaël Vinot 5f41902fe6 chg: Bump deps 2021-08-31 17:22:47 +02:00
Raphaël Vinot 6db708bb93 chg: Avoid exception if the backend is already down 2021-08-31 15:43:55 +02:00
Raphaël Vinot 11dd288bc4 chg: Improve monitoring script 2021-08-31 15:38:03 +02:00
Raphaël Vinot 0535614c32 new: Monitoring script (CLI) 2021-08-31 14:57:12 +02:00
Raphaël Vinot 9042b73e69 chg: Remove dead code, proper use of exceptions. 2021-08-31 13:48:19 +02:00
Raphaël Vinot 7870e918de chg: Bump datatables 2021-08-30 15:26:50 +02:00
Raphaël Vinot 1f8b99d511 chg: Bump deps, version. 2021-08-30 15:17:03 +02:00
Raphaël Vinot 2e5a5f3aff fix: unlink indexes pointing to unknown directories 2021-08-30 14:45:44 +02:00
Raphaël Vinot 4c4b01547a chg: Bump deps 2021-08-30 13:55:07 +02:00
Raphaël Vinot e56c70d1a1 chg: out of safety, do not remove a capture dir. 2021-08-30 12:54:17 +02:00
Raphaël Vinot 117500b777 chg: Make archiver an index generator 2021-08-30 12:48:13 +02:00
Raphaël Vinot 1bff8f1529 fix: cast capture dir to string for redis 2021-08-28 20:36:50 +02:00
Raphaël Vinot 324736f62c fix: Use proper exception on redis start 2021-08-27 18:08:34 +02:00
Raphaël Vinot ae76cb77be fix: Uncomment website start 2021-08-27 17:49:27 +02:00
Raphaël Vinot 8a51383d7a chg: Move the process managment methods to the proper class 2021-08-27 17:28:26 +02:00
Raphaël Vinot 85e43fc677 chg: Make the website start a normal start script 2021-08-27 16:45:16 +02:00
Raphaël Vinot 8918b11a7f chg: The Tech Blog UAs can only be fetched manually, moving it to tools 2021-08-27 15:22:39 +02:00
Raphaël Vinot 9ee6771158 new: bump top user agents 2021-08-27 15:07:27 +02:00
Raphaël Vinot 5bd0ae850f chg: improve lookup_dirs cleanup 2021-08-27 14:27:38 +02:00
Raphaël Vinot 11b3654b10 chg: Bump deps 2021-08-27 14:26:51 +02:00
Raphaël Vinot 6edb0c5d56 chg: Bump deps 2021-08-26 15:54:30 +02:00
Raphaël Vinot d41b7735dd chg: Improve storage, support both modes. 2021-08-26 15:49:19 +02:00
Raphaël Vinot 407e78ae7f chg: More cleanup, support clean shutdown of multiple async captures 2021-08-25 16:40:51 +02:00
Raphaël Vinot bc5e41a1ca fix: Properly re-set the cache if the tree was not built 2021-08-25 15:00:26 +02:00
Raphaël Vinot 83969ab8bb chg: Bump deps 2021-08-25 13:39:04 +02:00
Raphaël Vinot bf700e7a7b chg: Major refactoring, move capture code to external script. 2021-08-25 13:36:48 +02:00
Raphaël Vinot d8416f0f47 fix: Make python as python3 in docker 2021-08-24 18:50:05 +02:00
Raphaël Vinot c732e38395 chg: Add logging in BG processing 2021-08-24 18:44:00 +02:00
Raphaël Vinot 81390d5ea0 chg: cleanup in the mail lookyloo class 2021-08-24 18:32:54 +02:00
Raphaël Vinot 8433cbcc1b chg: Cleanup archiver, initialize index captures in start 2021-08-24 17:10:14 +02:00
Raphaël Vinot ece30a33eb chg: Fix typo in archiver 2021-08-23 16:56:17 +02:00
Raphaël Vinot fb1685cedc add: reset recent captures in archiving process 2021-08-23 16:19:50 +02:00
Raphaël Vinot 8f28335010 fix: properly match cut time 2021-08-23 15:51:06 +02:00
Raphaël Vinot 2c1971311a chg: Make the cut-off date for archiving the 1st of the month 2021-08-23 15:36:59 +02:00
Raphaël Vinot 5c9b88a3ca fix: Make sure all the archived UUIDs are removed 2021-08-23 15:29:21 +02:00
Raphaël Vinot 67e6571145 chg: Force init the archived indexes 2021-08-23 15:14:08 +02:00
Raphaël Vinot 53ceb9c329 chg: Cleanup when dir is moved, digit months on 2 values 2021-08-23 14:53:19 +02:00
Raphaël Vinot b8109c6462 fix: Make mypy happy 2021-08-23 14:20:26 +02:00
Raphaël Vinot d359bc7521 chg: Better use of cache, sanity checks 2021-08-23 12:17:44 +02:00