Commit Graph

532 Commits (8c12c39bcb7a10c6383d4b8734d47bdb5bf2b7d9)

Author SHA1 Message Date
Raphaël Vinot 7a96ae9767 new: Fetch the exiting collection names from the monitoring interface 2023-03-02 20:51:46 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot 09f788d511 Merge branch 'main' into monitoring 2023-02-26 17:32:35 +01:00
Raphaël Vinot 36d39f6076 new: Add PID in lock file, allows to check if the locking process is still there 2023-02-26 17:20:17 +01:00
Raphaël Vinot 11fed3f46a fix: Remove print 2023-02-23 18:49:59 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot 1558f65c8e new: try to get contact info from security.txt file if available. 2023-02-14 13:32:00 +01:00
Raphaël Vinot 2f2fd6024b fix: Some nodes do not have IPs, can't always use it for comparaison 2023-02-09 15:39:40 +01:00
Raphaël Vinot aae3d56ddc new: Aggregate all emails by URL 2023-02-03 11:32:13 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot 01a4b4d632 chg: Optionally not-defang the URLs in the email notification 2023-02-02 15:18:39 +01:00
Raphaël Vinot 599ae9f9f3 new: Compare ressources URLs 2023-01-31 11:24:16 +01:00
Raphaël Vinot 9273b80602 fix: Cleanup cloudflare module. 2023-01-30 16:26:46 +01:00
Raphaël Vinot ecb4623b86 new: Cloudflare lookup feature to flag IPs appropriately 2023-01-30 16:07:01 +01:00
Raphaël Vinot 0cb58d17d9 new: Add status code in comparator 2023-01-24 15:59:47 +01:00
Raphaël Vinot eab4b17070 fix: Avoid exceptions when the submission is a file 2023-01-24 15:59:06 +01:00
Raphaël Vinot f335b4a58d fix: Use publicsuffixlist instead of publicsuffix2 2023-01-20 15:23:11 +01:00
Raphaël Vinot d449edeb23 new: Allow API user to force re-caching the captures on URL/Hostname request 2023-01-20 11:15:33 +01:00
Raphaël Vinot 190d5a7118 new: Very basic capture comparator, API only. 2023-01-18 16:31:12 +01:00
Raphaël Vinot fdf1069c76 fix: Properly load IPs in old format. 2023-01-16 17:22:23 +01:00
Raphaël Vinot a3c62d1682 fix: Issue when loading IPs 2023-01-16 17:00:11 +01:00
Raphaël Vinot 1e563ff345 chg: Improve DNS resolution 2023-01-16 15:50:10 +01:00
Raphaël Vinot ae59b59071 fix: improper concat for sets 2023-01-16 15:16:40 +01:00
Raphaël Vinot 6624aec1bd new: run DNS lookups on AAAA too 2023-01-16 15:10:10 +01:00
Raphaël Vinot 55d727792a fix: Add logger in capture cache 2022-12-31 12:19:42 +01:00
Raphaël Vinot c7aba15ee2 fix: Avoid exception if the redirects key in cache is empty 2022-12-31 12:16:50 +01:00
Raphaël Vinot 5200402e06 chg: Another quick deps bump, prepare v1.17.0 2022-12-29 14:07:27 +01:00
Raphaël Vinot 01b9f8d1be fix: remove print, replace with logging 2022-12-27 01:55:18 +01:00
Raphaël Vinot 02497e167c fix: Catch QuotaExceededError in VT module 2022-12-26 23:30:00 +01:00
Raphaël Vinot 1abd97f37a new: switch to return emails only on whois query 2022-12-26 23:01:44 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot ca7ec64ffe fix: avoid exception if the tree cannot be build 2022-12-19 17:42:14 +01:00
Raphaël Vinot 0a9003f58e chg: Use cache whenever possible 2022-12-08 11:57:45 +01:00
Raphaël Vinot 1ae76ddea7 chg: Use cache instead of pickle for meta info 2022-12-08 10:49:26 +01:00
Raphaël Vinot 2c6d6b2556 chg: Get UUIDs sorted from most recent to oldest. 2022-12-07 21:18:38 +01:00
Raphaël Vinot 8083c8cabc fix: Major improvement in index display when you break the cache... 2022-12-07 21:05:27 +01:00
Raphaël Vinot 8c77b9372b fix: do not re-cache captures with errors. 2022-12-07 15:30:19 +01:00
Raphaël Vinot d2b5605182 fix: Force UA so we dont try to re-cache in a loop. 2022-12-07 15:14:33 +01:00
Raphaël Vinot 3e7f1c3de9 chg: use cache instead of get_info everywhere. 2022-12-07 14:32:13 +01:00
Raphaël Vinot 94b3b487f3 chg: Add more entries to the cache, use it in the modules. 2022-12-07 13:03:15 +01:00
Raphaël Vinot 52076925b8 fix: Avoid exception on non-empty directory 2022-12-06 11:00:01 +01:00
Raphaël Vinot 6871c36848 fix: Skip urlhaus module if no reports 2022-12-05 18:22:47 +01:00
Raphaël Vinot eecff2cd9b fix: Do not pass the user_agent if a device_name is set
Fix https://github.com/Lookyloo/lookyloo/issues/556
2022-12-02 09:57:56 +01:00
Raphaël Vinot 9653fc2cc7 new: Avoid dangling keys in running, sync AbstractManager with pandora 2022-12-01 15:52:21 +01:00
Raphaël Vinot af9515c123 new: URL Haus module
Related: #505
2022-11-30 18:38:41 +01:00
Raphaël Vinot 56ed06eb84 new: Show error message in bulk capture 2022-11-29 15:30:16 +01:00
Raphaël Vinot 3092b46f5d chg: More logging improvements 2022-11-28 12:23:40 +01:00
Raphaël Vinot 2d0b7224cc new: Timeout if a tree takes too long to generate 2022-11-27 00:09:40 +01:00
Raphaël Vinot 298c091068 chg: Reduce logging in indexing 2022-11-23 17:19:05 +01:00