Commit Graph

587 Commits (db639d9dde9b46e338427513f9a607078a3248e2)

Author SHA1 Message Date
Raphaël Vinot db639d9dde chg: Improve logging for errors in cookies, bump har2tree 2023-07-27 12:43:52 +02:00
Raphaël Vinot 855485984f fix: handle gracefully empty lists in hset, and duplicates UUIDs 2023-07-26 22:16:00 +02:00
Raphaël Vinot fd9325bb0d chg: Improve logging, add lock on indexer. 2023-07-26 12:37:12 +02:00
Raphaël Vinot ebd2b29993 fix: export compress HAR 2023-07-26 11:28:32 +02:00
Raphaël Vinot ef3432cbed fix: Few more improvments on lockfile and broken captures. 2023-07-25 20:16:48 +02:00
Raphaël Vinot 484aec5ddd fix: Properly handle lock file. 2023-07-25 19:29:53 +02:00
Raphaël Vinot 0c7b3d9106 fix: indexer getting stuck when we had more than one at a time 2023-07-25 17:08:00 +02:00
Raphaël Vinot 18b5a51c86 fix: Exception when none of the captures are cached. 2023-07-24 22:41:11 +02:00
Raphaël Vinot 0604ccfdee new: Improve the HHH details page 2023-07-24 14:53:00 +02:00
Raphaël Vinot 8cd6f5490a fix: Properly cache URL, fix mypy issue
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 13:15:13 +02:00
Raphaël Vinot 36f9d3dc60 chg: Improve error reporting
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 12:48:57 +02:00
Raphaël Vinot 177474e874 new: Basic support for HHHash 2023-07-21 15:48:20 +02:00
Raphaël Vinot b3000d02dd fix: 🤷 2023-07-13 16:59:52 +02:00
Raphaël Vinot f3095c7ccf chg: Add logging when comparing is impossible due to a missing pickle 2023-07-10 12:27:43 +02:00
Raphaël Vinot 3193763c8a fix: logic issue in last commit 2023-07-06 14:59:24 +02:00
Raphaël Vinot 79c9b95faf fix: Avoid issue if a cature is somewhat broken and we want to send a notification 2023-07-06 14:50:38 +02:00
Raphaël Vinot 2c5c30006c fix: index page stuck building captures for no good reason 2023-07-04 11:22:36 +02:00
Raphaël Vinot 6bb660ed82 fix: incorrect pickle rebuild, causing the index to get stuck 2023-07-03 17:04:55 +02:00
Raphaël Vinot 95a17f5770 fix: Handling of captures with errors
Related https://github.com/Lookyloo/monitoring/issues/15
2023-06-21 15:41:14 +02:00
Raphaël Vinot 475b424878 chg: retry a few times if remote lacus isn't available immediately 2023-06-16 12:47:50 +02:00
Raphaël Vinot 324c85cac8 new: Support for STARTTLS in the notification 2023-06-14 16:19:46 +02:00
Raphaël Vinot 0505edff0e new: Global proxy setting.
Overwrites any proxy given by the user. Still uses the tor proxy when
needed.

Related: https://github.com/Lookyloo/lookyloo/issues/318
2023-06-13 12:07:26 +02:00
Raphaël Vinot 97a668aa91 chg: do not export pickle 2023-06-12 16:01:30 +02:00
Raphaël Vinot 4ff9b7651d new: Support for TZ, Geo, locale, color scheme 2023-06-07 15:05:40 +02:00
Raphaël Vinot 474ab91dcd chg: Use URL from capture settings file 2023-06-05 15:21:22 +02:00
Raphaël Vinot b3b7d4f5c6 new: Add lookyloo permaurls in comparator response 2023-05-17 12:14:24 +02:00
Raphaël Vinot f8acca5e51 fix: properly ignore resources if only hostname matches 2023-05-17 11:14:53 +02:00
Raphaël Vinot 386aa6e91b fix: make the sets into tuples so endswith works 2023-05-17 09:53:20 +02:00
Raphaël Vinot 95f05a3da1 new: Display proxy if passed to the CaptureSettings
Fix #695
2023-05-15 16:33:49 +02:00
Raphaël Vinot 582b5956e9 new: Store capture settings, use TypedDict whenever possible. 2023-05-15 16:08:19 +02:00
Raphaël Vinot a504facf5e new: Flag to quickly say if two captures are different or not 2023-05-11 15:07:37 +02:00
Raphaël Vinot 14d4e0f2db fix: MISP lookup from Lookyloo. 2023-05-04 10:20:54 +02:00
Raphaël Vinot 6a9bcc0050 new: Automatic reporting via API
Related to #678
2023-04-28 17:19:53 +02:00
Raphaël Vinot c62032fee2 new: Endpoint to get comparables from a capture 2023-04-24 16:25:29 +02:00
Raphaël Vinot b33ef171a4 new: Method to get comparable stuff out of tree 2023-04-21 23:57:23 +02:00
Raphaël Vinot 88997e7c99 fix: Incorrect call to new PSL lib 2023-04-20 16:23:56 +03:00
Raphaël Vinot 6754400e25 fix: [URLHaus] Do not store responses if the URL is invalid 2023-04-13 16:17:58 +02:00
Raphaël Vinot c7d3e54edf fix: Cloudflare module always returning True 2023-04-12 14:05:05 +02:00
Raphaël Vinot 4ceae60db7 chg: Avoid stopping the captures before they're done 2023-04-09 13:58:34 +02:00
Raphaël Vinot 2ceda75eab chg: Fairly big refactoring/cleanup to support LacusCore 1.4.0 2023-04-08 13:49:18 +02:00
Raphaël Vinot 9995371916 chg: Normalize logging on the config file settings 2023-04-05 16:23:46 +02:00
Raphaël Vinot 9281d73675 fix: Properly handle recursion error when storing pickle 2023-03-30 16:30:27 +02:00
Raphaël Vinot 8122b9904c fix: remove gziped pickle too on error. 2023-03-30 15:50:13 +02:00
Raphaël Vinot c48bf2f4de new: Pass compare settings (WiP) 2023-03-24 15:47:41 +01:00
Raphaël Vinot 046417c058 chg: Bump pysecurity.txt, pass Lookyloos UA 2023-03-21 11:28:08 +01:00
Raphaël Vinot a0a23dca20 chg: Bump har2tree 2023-03-16 17:32:14 +01:00
Raphaël Vinot d970c924f8 chg: Simplify tracing the exceptions related to a specific capture. 2023-03-16 13:49:22 +01:00
Raphaël Vinot afd383cfc3 fix: Better error handling with unpickling, improve logging 2023-03-16 12:45:58 +01:00
Raphaël Vinot 9497060028 fix: Cleanup prints, improve archiver. 2023-03-16 12:28:28 +01:00
Raphaël Vinot 0b678e2db0 new: Optimize pickle, store as gzip to reduce space. 2023-03-15 18:02:33 +01:00