Commit Graph

79 Commits (ee1ad48b254ee38e337afedcf2c5411dea9f8928)

Author SHA1 Message Date
Raphaël Vinot ee1ad48b25 chg: Use new annotations 2024-01-12 17:15:41 +01:00
Raphaël Vinot 1b987c38b7 chg: avoid issue if ipasnhistory is down, improve IDNA rendering 2023-11-10 21:19:22 +01:00
Raphaël Vinot 8152e3260c fix: Avoid exception if ipasnhistory is loading 2023-11-09 11:10:42 +01:00
Raphaël Vinot 21965758f2 fix: Avoid encoding issue with titles 2023-10-26 00:05:50 +02:00
Raphaël Vinot 4143d5f249 chg: avoid trying to load a tree that is currenly being built 2023-10-13 20:08:58 +02:00
Raphaël Vinot 0daff9ef77 chg: settings tweaks, logging 2023-10-11 15:02:11 +02:00
Raphaël Vinot 1f517b1562 chg: Cosmetic changes to support upcomming ete4 2023-08-10 17:31:19 +02:00
Raphaël Vinot e256a7fe6b chg: Proper use of shutil.move, speedup initialization of CaptureCache 2023-08-08 12:41:21 +02:00
Raphaël Vinot 182e7af188 chg: Attempt to keep index up-to-date with cached captures 2023-07-28 14:40:33 +02:00
Raphaël Vinot c0f601e5db chg: remove incomplete_redirects from cache, was always 0/False 2023-07-28 14:05:28 +02:00
Raphaël Vinot ea2ded9beb fix: properly handle missing title in cache 2023-07-27 15:21:06 +02:00
Raphaël Vinot ebfc2f00a5 fix: Exception when a formerly broken capture is re-processed and works 2023-07-27 14:56:39 +02:00
Raphaël Vinot ef3432cbed fix: Few more improvments on lockfile and broken captures. 2023-07-25 20:16:48 +02:00
Raphaël Vinot 8cd6f5490a fix: Properly cache URL, fix mypy issue
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 13:15:13 +02:00
Raphaël Vinot 36f9d3dc60 chg: Improve error reporting
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 12:48:57 +02:00
Raphaël Vinot 6bb660ed82 fix: incorrect pickle rebuild, causing the index to get stuck 2023-07-03 17:04:55 +02:00
Raphaël Vinot 474ab91dcd chg: Use URL from capture settings file 2023-06-05 15:21:22 +02:00
Raphaël Vinot c7d3e54edf fix: Cloudflare module always returning True 2023-04-12 14:05:05 +02:00
Raphaël Vinot 9281d73675 fix: Properly handle recursion error when storing pickle 2023-03-30 16:30:27 +02:00
Raphaël Vinot 8122b9904c fix: remove gziped pickle too on error. 2023-03-30 15:50:13 +02:00
Raphaël Vinot a0a23dca20 chg: Bump har2tree 2023-03-16 17:32:14 +01:00
Raphaël Vinot d970c924f8 chg: Simplify tracing the exceptions related to a specific capture. 2023-03-16 13:49:22 +01:00
Raphaël Vinot afd383cfc3 fix: Better error handling with unpickling, improve logging 2023-03-16 12:45:58 +01:00
Raphaël Vinot 9497060028 fix: Cleanup prints, improve archiver. 2023-03-16 12:28:28 +01:00
Raphaël Vinot 0b678e2db0 new: Optimize pickle, store as gzip to reduce space. 2023-03-15 18:02:33 +01:00
Raphaël Vinot 4a33e10cc9 chg: force protocol 5 for pickles 2023-03-08 16:55:18 +02:00
Raphaël Vinot 36d39f6076 new: Add PID in lock file, allows to check if the locking process is still there 2023-02-26 17:20:17 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot ecb4623b86 new: Cloudflare lookup feature to flag IPs appropriately 2023-01-30 16:07:01 +01:00
Raphaël Vinot fdf1069c76 fix: Properly load IPs in old format. 2023-01-16 17:22:23 +01:00
Raphaël Vinot a3c62d1682 fix: Issue when loading IPs 2023-01-16 17:00:11 +01:00
Raphaël Vinot 1e563ff345 chg: Improve DNS resolution 2023-01-16 15:50:10 +01:00
Raphaël Vinot ae59b59071 fix: improper concat for sets 2023-01-16 15:16:40 +01:00
Raphaël Vinot 6624aec1bd new: run DNS lookups on AAAA too 2023-01-16 15:10:10 +01:00
Raphaël Vinot 55d727792a fix: Add logger in capture cache 2022-12-31 12:19:42 +01:00
Raphaël Vinot c7aba15ee2 fix: Avoid exception if the redirects key in cache is empty 2022-12-31 12:16:50 +01:00
Raphaël Vinot 01b9f8d1be fix: remove print, replace with logging 2022-12-27 01:55:18 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot ca7ec64ffe fix: avoid exception if the tree cannot be build 2022-12-19 17:42:14 +01:00
Raphaël Vinot d2b5605182 fix: Force UA so we dont try to re-cache in a loop. 2022-12-07 15:14:33 +01:00
Raphaël Vinot 94b3b487f3 chg: Add more entries to the cache, use it in the modules. 2022-12-07 13:03:15 +01:00
Raphaël Vinot 2d0b7224cc new: Timeout if a tree takes too long to generate 2022-11-27 00:09:40 +01:00
Raphaël Vinot c71a79fb14 chg: clear cache on update 2022-09-28 11:44:15 +02:00
Raphaël Vinot a27683f090 fix: Match compressed HAR as valid for rebuild 2022-09-28 11:23:44 +02:00
Raphaël Vinot 33d30a3f4c chg: More cleanup 2022-09-27 02:39:10 +02:00
Raphaël Vinot df4a37ea12 fix: Properly catch broken captures 2022-09-26 17:16:04 +02:00
Raphaël Vinot 31261e84c2 fix: Better handling of half broken captures without HAR files 2022-09-26 14:58:30 +02:00
Raphaël Vinot 50e59bdf31 fix: Not having a HAR file is valid now. 2022-09-25 22:52:42 +02:00
Raphaël Vinot 137c05648b fix: Always make sure to build the tree when we set the cache 2022-07-29 19:31:56 +02:00
Raphaël Vinot a80a5425fa fix: wrong delete call 2022-07-29 19:08:56 +02:00