Commit Graph

543 Commits (0b1ad8bd0b111667811acc70b5ddcae46664d305)

Author SHA1 Message Date
Raphaël Vinot 046417c058 chg: Bump pysecurity.txt, pass Lookyloos UA 2023-03-21 11:28:08 +01:00
Raphaël Vinot a0a23dca20 chg: Bump har2tree 2023-03-16 17:32:14 +01:00
Raphaël Vinot d970c924f8 chg: Simplify tracing the exceptions related to a specific capture. 2023-03-16 13:49:22 +01:00
Raphaël Vinot afd383cfc3 fix: Better error handling with unpickling, improve logging 2023-03-16 12:45:58 +01:00
Raphaël Vinot 9497060028 fix: Cleanup prints, improve archiver. 2023-03-16 12:28:28 +01:00
Raphaël Vinot 0b678e2db0 new: Optimize pickle, store as gzip to reduce space. 2023-03-15 18:02:33 +01:00
Raphaël Vinot 07c365e3bb chg: Improve logging 2023-03-12 19:25:16 +01:00
Raphaël Vinot 25433b5707 chg: always use LookylooException 2023-03-12 19:25:16 +01:00
Raphaël Vinot 3927b97584 fix: let the module figure out the mimetype for the attachment 2023-03-09 13:17:10 +02:00
Raphaël Vinot 53d9a6ba7a new: Add contacts as attachmetn to notification mail 2023-03-09 12:55:45 +02:00
Raphaël Vinot 4a33e10cc9 chg: force protocol 5 for pickles 2023-03-08 16:55:18 +02:00
Raphaël Vinot 7a96ae9767 new: Fetch the exiting collection names from the monitoring interface 2023-03-02 20:51:46 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot 09f788d511 Merge branch 'main' into monitoring 2023-02-26 17:32:35 +01:00
Raphaël Vinot 36d39f6076 new: Add PID in lock file, allows to check if the locking process is still there 2023-02-26 17:20:17 +01:00
Raphaël Vinot 11fed3f46a fix: Remove print 2023-02-23 18:49:59 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot 1558f65c8e new: try to get contact info from security.txt file if available. 2023-02-14 13:32:00 +01:00
Raphaël Vinot 2f2fd6024b fix: Some nodes do not have IPs, can't always use it for comparaison 2023-02-09 15:39:40 +01:00
Raphaël Vinot aae3d56ddc new: Aggregate all emails by URL 2023-02-03 11:32:13 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot 01a4b4d632 chg: Optionally not-defang the URLs in the email notification 2023-02-02 15:18:39 +01:00
Raphaël Vinot 599ae9f9f3 new: Compare ressources URLs 2023-01-31 11:24:16 +01:00
Raphaël Vinot 9273b80602 fix: Cleanup cloudflare module. 2023-01-30 16:26:46 +01:00
Raphaël Vinot ecb4623b86 new: Cloudflare lookup feature to flag IPs appropriately 2023-01-30 16:07:01 +01:00
Raphaël Vinot 0cb58d17d9 new: Add status code in comparator 2023-01-24 15:59:47 +01:00
Raphaël Vinot eab4b17070 fix: Avoid exceptions when the submission is a file 2023-01-24 15:59:06 +01:00
Raphaël Vinot f335b4a58d fix: Use publicsuffixlist instead of publicsuffix2 2023-01-20 15:23:11 +01:00
Raphaël Vinot d449edeb23 new: Allow API user to force re-caching the captures on URL/Hostname request 2023-01-20 11:15:33 +01:00
Raphaël Vinot 190d5a7118 new: Very basic capture comparator, API only. 2023-01-18 16:31:12 +01:00
Raphaël Vinot fdf1069c76 fix: Properly load IPs in old format. 2023-01-16 17:22:23 +01:00
Raphaël Vinot a3c62d1682 fix: Issue when loading IPs 2023-01-16 17:00:11 +01:00
Raphaël Vinot 1e563ff345 chg: Improve DNS resolution 2023-01-16 15:50:10 +01:00
Raphaël Vinot ae59b59071 fix: improper concat for sets 2023-01-16 15:16:40 +01:00
Raphaël Vinot 6624aec1bd new: run DNS lookups on AAAA too 2023-01-16 15:10:10 +01:00
Raphaël Vinot 55d727792a fix: Add logger in capture cache 2022-12-31 12:19:42 +01:00
Raphaël Vinot c7aba15ee2 fix: Avoid exception if the redirects key in cache is empty 2022-12-31 12:16:50 +01:00
Raphaël Vinot 5200402e06 chg: Another quick deps bump, prepare v1.17.0 2022-12-29 14:07:27 +01:00
Raphaël Vinot 01b9f8d1be fix: remove print, replace with logging 2022-12-27 01:55:18 +01:00
Raphaël Vinot 02497e167c fix: Catch QuotaExceededError in VT module 2022-12-26 23:30:00 +01:00
Raphaël Vinot 1abd97f37a new: switch to return emails only on whois query 2022-12-26 23:01:44 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot ca7ec64ffe fix: avoid exception if the tree cannot be build 2022-12-19 17:42:14 +01:00
Raphaël Vinot 0a9003f58e chg: Use cache whenever possible 2022-12-08 11:57:45 +01:00
Raphaël Vinot 1ae76ddea7 chg: Use cache instead of pickle for meta info 2022-12-08 10:49:26 +01:00
Raphaël Vinot 2c6d6b2556 chg: Get UUIDs sorted from most recent to oldest. 2022-12-07 21:18:38 +01:00
Raphaël Vinot 8083c8cabc fix: Major improvement in index display when you break the cache... 2022-12-07 21:05:27 +01:00
Raphaël Vinot 8c77b9372b fix: do not re-cache captures with errors. 2022-12-07 15:30:19 +01:00
Raphaël Vinot d2b5605182 fix: Force UA so we dont try to re-cache in a loop. 2022-12-07 15:14:33 +01:00