Commit Graph

389 Commits (5db34010799b592eb98e640545a426843bb5d079)

Author SHA1 Message Date
Raphaël Vinot 2920f796fe fix: Speedup generating pickles in BG 2023-10-09 10:26:37 +02:00
Raphaël Vinot 1220f5926d fix: reduce calls to stat on archived dirs, improve logging 2023-09-29 15:00:40 +02:00
Raphaël Vinot 68204c2686 new: Support for rendered nodes with HTML and downloaded file 2023-09-26 18:08:04 +02:00
Raphaël Vinot 0365c9d6c9 fix: Strip all non-URL characters from capture. 2023-09-11 16:54:50 +02:00
Raphaël Vinot 00bf8fb551 fix: Improve getting MISP instances 2023-08-29 17:30:45 +02:00
Raphaël Vinot 6034d10834 new: (WiP) Add support for multiple MISPs 2023-08-29 14:03:01 +02:00
Raphaël Vinot 72ba77377d chg: Catch empty file hash and return empry file immediately 2023-08-24 15:12:38 +02:00
Raphaël Vinot ff15f3a60a Avoid exceptions when trying to get a datablob 2023-08-24 14:55:32 +02:00
Raphaël Vinot 8b316ad185 fix: Properly search hash in embedded resources 2023-08-24 14:37:03 +02:00
Raphaël Vinot 2a843ac828 chg: Delist less captures, avoid edge case causing an exception for MISP export 2023-08-23 17:22:46 +02:00
Raphaël Vinot 447229ced3 chg: Compress HARs by default, update codebase accordingly 2023-08-11 13:16:59 +02:00
Raphaël Vinot 206e5957b5 new: Support for favicons fetching and display
Related https://github.com/Lookyloo/PlaywrightCapture/issues/45
2023-08-09 16:50:33 +02:00
Raphaël Vinot 54674f6c5b avoid exception if pickle needs to be rebuild 2023-08-04 13:16:05 +02:00
Raphaël Vinot 35218900ed fix: MISP export when the capture is a file. 2023-07-30 17:48:16 +02:00
Raphaël Vinot c0f601e5db chg: remove incomplete_redirects from cache, was always 0/False 2023-07-28 14:05:28 +02:00
Raphaël Vinot ebfc2f00a5 fix: Exception when a formerly broken capture is re-processed and works 2023-07-27 14:56:39 +02:00
Raphaël Vinot ebd2b29993 fix: export compress HAR 2023-07-26 11:28:32 +02:00
Raphaël Vinot 18b5a51c86 fix: Exception when none of the captures are cached. 2023-07-24 22:41:11 +02:00
Raphaël Vinot 0604ccfdee new: Improve the HHH details page 2023-07-24 14:53:00 +02:00
Raphaël Vinot 8cd6f5490a fix: Properly cache URL, fix mypy issue
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 13:15:13 +02:00
Raphaël Vinot 36f9d3dc60 chg: Improve error reporting
Related https://github.com/Lookyloo/PyLookyloo/issues/32
2023-07-24 12:48:57 +02:00
Raphaël Vinot 177474e874 new: Basic support for HHHash 2023-07-21 15:48:20 +02:00
Raphaël Vinot b3000d02dd fix: 🤷 2023-07-13 16:59:52 +02:00
Raphaël Vinot 3193763c8a fix: logic issue in last commit 2023-07-06 14:59:24 +02:00
Raphaël Vinot 79c9b95faf fix: Avoid issue if a cature is somewhat broken and we want to send a notification 2023-07-06 14:50:38 +02:00
Raphaël Vinot 2c5c30006c fix: index page stuck building captures for no good reason 2023-07-04 11:22:36 +02:00
Raphaël Vinot 475b424878 chg: retry a few times if remote lacus isn't available immediately 2023-06-16 12:47:50 +02:00
Raphaël Vinot 324c85cac8 new: Support for STARTTLS in the notification 2023-06-14 16:19:46 +02:00
Raphaël Vinot 0505edff0e new: Global proxy setting.
Overwrites any proxy given by the user. Still uses the tor proxy when
needed.

Related: https://github.com/Lookyloo/lookyloo/issues/318
2023-06-13 12:07:26 +02:00
Raphaël Vinot 97a668aa91 chg: do not export pickle 2023-06-12 16:01:30 +02:00
Raphaël Vinot 4ff9b7651d new: Support for TZ, Geo, locale, color scheme 2023-06-07 15:05:40 +02:00
Raphaël Vinot 95f05a3da1 new: Display proxy if passed to the CaptureSettings
Fix #695
2023-05-15 16:33:49 +02:00
Raphaël Vinot 582b5956e9 new: Store capture settings, use TypedDict whenever possible. 2023-05-15 16:08:19 +02:00
Raphaël Vinot 6a9bcc0050 new: Automatic reporting via API
Related to #678
2023-04-28 17:19:53 +02:00
Raphaël Vinot c7d3e54edf fix: Cloudflare module always returning True 2023-04-12 14:05:05 +02:00
Raphaël Vinot 2ceda75eab chg: Fairly big refactoring/cleanup to support LacusCore 1.4.0 2023-04-08 13:49:18 +02:00
Raphaël Vinot 046417c058 chg: Bump pysecurity.txt, pass Lookyloos UA 2023-03-21 11:28:08 +01:00
Raphaël Vinot d970c924f8 chg: Simplify tracing the exceptions related to a specific capture. 2023-03-16 13:49:22 +01:00
Raphaël Vinot 07c365e3bb chg: Improve logging 2023-03-12 19:25:16 +01:00
Raphaël Vinot 3927b97584 fix: let the module figure out the mimetype for the attachment 2023-03-09 13:17:10 +02:00
Raphaël Vinot 53d9a6ba7a new: Add contacts as attachmetn to notification mail 2023-03-09 12:55:45 +02:00
Raphaël Vinot 7a96ae9767 new: Fetch the exiting collection names from the monitoring interface 2023-03-02 20:51:46 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot 11fed3f46a fix: Remove print 2023-02-23 18:49:59 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 1558f65c8e new: try to get contact info from security.txt file if available. 2023-02-14 13:32:00 +01:00
Raphaël Vinot aae3d56ddc new: Aggregate all emails by URL 2023-02-03 11:32:13 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot 01a4b4d632 chg: Optionally not-defang the URLs in the email notification 2023-02-02 15:18:39 +01:00
Raphaël Vinot d449edeb23 new: Allow API user to force re-caching the captures on URL/Hostname request 2023-01-20 11:15:33 +01:00