CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
2,181 Commits
8 Branches
29 Tags
68 MiB
Commit Graph

88 Commits (e818aa2a8b789c4137ef26fc572d83ce3e012b92)

Author SHA1 Message Date
Raphaël Vinot e818aa2a8b chg: remove empty capture dirs 2024-04-23 14:57:45 +03:00
Raphaël Vinot 926c0da23e chg: Disable index cache for backgroupd processes 2024-03-12 12:02:10 +01:00
Raphaël Vinot e40796c92e chg: merge index and reindex methods. 2024-03-11 00:14:07 +01:00
Raphaël Vinot d2df33aa5c fix: use a more direct way to index 2024-03-09 15:33:10 +01:00
Raphaël Vinot 24cc00fe96 chg: clear cache when it is not needed 2024-03-08 15:50:47 +01:00
Raphaël Vinot e45b7c4346 new: Indexer for *all* the captures 2024-03-05 20:51:21 +01:00
Raphaël Vinot 5368151ce0 chg: Bump deps 2024-02-05 16:33:46 +01:00
Raphaël Vinot c67f01c775 chg: Improve strict typing 2024-01-26 15:03:36 +01:00
Raphaël Vinot bd6a0f2d22 chg: cleanup with annotations 2024-01-13 01:45:45 +01:00
Raphaël Vinot ee1ad48b25 chg: Use new annotations 2024-01-12 17:15:41 +01:00
Raphaël Vinot 1b987c38b7 chg: avoid issue if ipasnhistory is down, improve IDNA rendering 2023-11-10 21:19:22 +01:00
Raphaël Vinot 8152e3260c fix: Avoid exception if ipasnhistory is loading 2023-11-09 11:10:42 +01:00
Raphaël Vinot 21965758f2 fix: Avoid encoding issue with titles 2023-10-26 00:05:50 +02:00
Raphaël Vinot 4143d5f249 chg: avoid trying to load a tree that is currenly being built 2023-10-13 20:08:58 +02:00
Raphaël Vinot 0daff9ef77 chg: settings tweaks, logging 2023-10-11 15:02:11 +02:00
Raphaël Vinot 1f517b1562 chg: Cosmetic changes to support upcomming ete4 2023-08-10 17:31:19 +02:00
Raphaël Vinot e256a7fe6b chg: Proper use of shutil.move, speedup initialization of CaptureCache 2023-08-08 12:41:21 +02:00
Raphaël Vinot 182e7af188 chg: Attempt to keep index up-to-date with cached captures 2023-07-28 14:40:33 +02:00
Raphaël Vinot c0f601e5db chg: remove incomplete_redirects from cache, was always 0/False 2023-07-28 14:05:28 +02:00
Raphaël Vinot ea2ded9beb fix: properly handle missing title in cache 2023-07-27 15:21:06 +02:00
Raphaël Vinot ebfc2f00a5 fix: Exception when a formerly broken capture is re-processed and works 2023-07-27 14:56:39 +02:00
Raphaël Vinot ef3432cbed fix: Few more improvments on lockfile and broken captures. 2023-07-25 20:16:48 +02:00
Raphaël Vinot 8cd6f5490a fix: Properly cache URL, fix mypy issue 
Related https://github.com/Lookyloo/PyLookyloo/issues/32
 2023-07-24 13:15:13 +02:00
Raphaël Vinot 36f9d3dc60 chg: Improve error reporting 
Related https://github.com/Lookyloo/PyLookyloo/issues/32
 2023-07-24 12:48:57 +02:00
Raphaël Vinot 6bb660ed82 fix: incorrect pickle rebuild, causing the index to get stuck 2023-07-03 17:04:55 +02:00
Raphaël Vinot 474ab91dcd chg: Use URL from capture settings file 2023-06-05 15:21:22 +02:00
Raphaël Vinot c7d3e54edf fix: Cloudflare module always returning True 2023-04-12 14:05:05 +02:00
Raphaël Vinot 9281d73675 fix: Properly handle recursion error when storing pickle 2023-03-30 16:30:27 +02:00
Raphaël Vinot 8122b9904c fix: remove gziped pickle too on error. 2023-03-30 15:50:13 +02:00
Raphaël Vinot a0a23dca20 chg: Bump har2tree 2023-03-16 17:32:14 +01:00
Raphaël Vinot d970c924f8 chg: Simplify tracing the exceptions related to a specific capture. 2023-03-16 13:49:22 +01:00
Raphaël Vinot afd383cfc3 fix: Better error handling with unpickling, improve logging 2023-03-16 12:45:58 +01:00
Raphaël Vinot 9497060028 fix: Cleanup prints, improve archiver. 2023-03-16 12:28:28 +01:00
Raphaël Vinot 0b678e2db0 new: Optimize pickle, store as gzip to reduce space. 2023-03-15 18:02:33 +01:00
Raphaël Vinot 4a33e10cc9 chg: force protocol 5 for pickles 2023-03-08 16:55:18 +02:00
Raphaël Vinot 36d39f6076 new: Add PID in lock file, allows to check if the locking process is still there 2023-02-26 17:20:17 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot ecb4623b86 new: Cloudflare lookup feature to flag IPs appropriately 2023-01-30 16:07:01 +01:00
Raphaël Vinot fdf1069c76 fix: Properly load IPs in old format. 2023-01-16 17:22:23 +01:00
Raphaël Vinot a3c62d1682 fix: Issue when loading IPs 2023-01-16 17:00:11 +01:00
Raphaël Vinot 1e563ff345 chg: Improve DNS resolution 2023-01-16 15:50:10 +01:00
Raphaël Vinot ae59b59071 fix: improper concat for sets 2023-01-16 15:16:40 +01:00
Raphaël Vinot 6624aec1bd new: run DNS lookups on AAAA too 2023-01-16 15:10:10 +01:00
Raphaël Vinot 55d727792a fix: Add logger in capture cache 2022-12-31 12:19:42 +01:00
Raphaël Vinot c7aba15ee2 fix: Avoid exception if the redirects key in cache is empty 2022-12-31 12:16:50 +01:00
Raphaël Vinot 01b9f8d1be fix: remove print, replace with logging 2022-12-27 01:55:18 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot ca7ec64ffe fix: avoid exception if the tree cannot be build 2022-12-19 17:42:14 +01:00
Raphaël Vinot d2b5605182 fix: Force UA so we dont try to re-cache in a loop. 2022-12-07 15:14:33 +01:00
Raphaël Vinot 94b3b487f3 chg: Add more entries to the cache, use it in the modules. 2022-12-07 13:03:15 +01:00