Commit Graph

1202 Commits (d05b1edf489d4b61b6c1f164561e4a59bbf79f8b)

Author SHA1 Message Date
Raphaël Vinot d05b1edf48 new: Add logging in Indexing 2021-09-24 16:27:46 +02:00
Raphaël Vinot 6e9e3990c4 fix: Indexes not updated on tree rebuild, better handling of tree cache 2021-09-24 16:16:41 +02:00
Raphaël Vinot 48fc807e7d new: Add monitoring for pickle cache status 2021-09-24 12:02:28 +02:00
Raphaël Vinot 1d3bb55343 chg: Rebuild trees when captures are moved. 2021-09-23 16:40:39 +02:00
Raphaël Vinot 27836b5bdd fix: Skip phishtank if URLs and IPs are unknown (modules) 2021-09-23 14:22:21 +02:00
Raphaël Vinot 22315ac9b6 fix: Typo in module template 2021-09-23 14:14:14 +02:00
Raphaël Vinot 52f6d91fba fix: Skip block if urls not on phishtank. 2021-09-23 14:08:39 +02:00
Raphaël Vinot bf94dd6578 fix: missing endlist on template 2021-09-23 14:05:56 +02:00
Raphaël Vinot 87c6925c7b new: IPs lookup against phishtank 2021-09-23 13:58:40 +02:00
Raphaël Vinot e6e61089b6 chg: Speedup cache initialization 2021-09-23 10:29:02 +02:00
Raphaël Vinot aa7173d27d fix: a broken/missing pickle is handled elsewhere 2021-09-23 09:17:34 +02:00
Raphaël Vinot 19c8c54b0b fix: force-rebuild pickle if needed. 2021-09-22 22:23:20 +02:00
Raphaël Vinot 7afd150570 chg: Bump deps 2021-09-22 17:13:25 +02:00
Raphaël Vinot 32ee474be2 chg: Improve tree creation and cache 2021-09-22 17:09:04 +02:00
Raphaël Vinot 01fff00cad chg: Slight cleanup 2021-09-21 18:04:22 +02:00
Raphaël Vinot 7f6a59a441 chg: Bump SRI for d3js 2021-09-20 22:42:51 +02:00
Raphaël Vinot c08b192242 chg: Bump deps 2021-09-20 22:37:00 +02:00
Raphaël Vinot bfcb4feb9a chg: Remove import 2021-09-17 15:10:21 +02:00
Raphaël Vinot 275b4aee93 fix: Avoid None in urlscan.io result. 2021-09-17 12:58:05 +02:00
Raphaël Vinot 404f9a3112 fix: Avoid exception if none key 2021-09-17 10:06:59 +02:00
Raphaël Vinot e7d9c1cb1a fix: return error message if urlscan isn't able to run the capture. 2021-09-17 09:51:52 +02:00
Raphaël Vinot 963af434dd chg: Improve wording for Phishtank in modules 2021-09-16 17:35:45 +02:00
Raphaël Vinot 7a8ca54104 chg: Bump charset-normalizer 2021-09-16 16:57:54 +02:00
Raphaël Vinot cefb3fddbf new: Phishtank lookup. 2021-09-16 16:33:44 +02:00
Raphaël Vinot 9c552f1032 chg: Move modules into files 2021-09-16 11:22:02 +02:00
Raphaël Vinot 77a94e017e chg: Bump datatables 2021-09-16 10:10:31 +02:00
Raphaël Vinot 1d40dd44ae new: Add urlscan permanent URL to MISP export 2021-09-15 15:42:02 +02:00
Raphaël Vinot d6982392ef chg: cleanup get_user_agents
Related: #262
2021-09-13 22:32:02 +02:00
Raphaël Vinot 258ccde937 chg: Bump pylookyloo 2021-09-11 17:10:56 +02:00
Raphaël Vinot 2f88d16073 fix: Bump scrapy splash wrapper 2021-09-11 16:40:22 +02:00
Raphaël Vinot 22d8672131 chg: Catch timeouts when pushing to MISP 2021-09-10 15:25:37 +02:00
Raphaël Vinot d1f673f3a7 chg: Cleanup passing listing key to and from bool in redis 2021-09-10 14:20:58 +02:00
Raphaël Vinot b59e73258d chg: Bump deps 2021-09-10 12:18:21 +02:00
Raphaël Vinot 9c7929569e fix: The captures are visible on the index by default. 2021-09-08 20:43:56 +02:00
Raphaël Vinot 5abc264159 fix: Better initialization of cache, avoid missing the error message. 2021-09-08 16:34:54 +02:00
Raphaël Vinot 39c7d14264 fix: make mypy happy 2021-09-08 12:50:56 +02:00
Raphaël Vinot 6076b2890d chg: Bump beautifulsoup4 2021-09-08 12:49:29 +02:00
Raphaël Vinot cc4beeef35 fix: Pass listing (y/n) and proper referer to subsequent captures 2021-09-08 12:24:00 +02:00
Raphaël Vinot 48b632aa1e fix: Incorrect matching for listing key in capture (always false) 2021-09-08 10:53:31 +02:00
Raphaël Vinot 902c8f81b6 chg: Improve error message if the capture fails
Fix #257
2021-09-07 18:16:01 +02:00
Raphaël Vinot 07dd01a80b chg: Add link to API doc 2021-09-07 16:44:49 +02:00
Raphaël Vinot 97ffefc80e chg: Better wording in monitor 2021-09-07 16:28:50 +02:00
Raphaël Vinot 048e44ce91 fix: Avoid exception in _set_capture_cache in case of critical error 2021-09-07 16:00:07 +02:00
Raphaël Vinot dfbe40a52e chg: reorder imports 2021-09-07 16:00:07 +02:00
Raphaël Vinot 22ed413d13
Merge pull request #258 from dssecret/patch-1
Update README.md - Fix links
2021-09-07 09:51:31 +02:00
dssecret f6eed9f3b6
Update README.md - Fix links
Table of Content links and LICENSE link in README.md were modified to be properly anchored with the correct root.
2021-09-07 00:02:31 -07:00
Raphaël Vinot 7d76d96ff7 fix: Avoid 500 error on the website if unable to dump pickle. 2021-09-06 16:30:43 +02:00
Raphaël Vinot 074bb675f6 fix: Handling of status code 0, export capture UUID 2021-09-06 16:12:41 +02:00
Raphaël Vinot 827c466004 fix: Bump har2tree, debug was enabled. 2021-09-06 13:32:23 +02:00
Raphaël Vinot bda2e2c473 chg: Bump deps, fix handling of HTTP status code 0 2021-09-06 13:19:58 +02:00