Commit Graph

1261 Commits (799fc491288c0770b775d5672795c4b707d95110)

Author SHA1 Message Date
Raphaël Vinot 1a0fe677ab fix: Copy bodies before sending them over.
send_file in flask close the BytesIO, causing issue if we need to
re-access it.
2021-09-29 15:00:10 +02:00
Raphaël Vinot deb9a0e341 chg: Bump pysanejs 2021-09-28 18:19:04 +02:00
Raphaël Vinot 570e7e6e8a chg: Bump datatables (security fix) 2021-09-28 17:56:16 +02:00
Raphaël Vinot 2f682eeccc chg: Bump version 2021-09-28 17:54:26 +02:00
Raphaël Vinot 88020028ac chg: Improve phishtank results rendering 2021-09-28 15:30:41 +02:00
Raphaël Vinot 2496b951e2 chg: Bump har2tree, require python <3.11 because that's how we can get numpy updates 2021-09-28 14:58:51 +02:00
Raphaël Vinot 0da28cef28 chg: Move MISP export to module, add phishtank permaURL 2021-09-27 16:04:00 +02:00
Raphaël Vinot 708ff8194a chg: Bump d3js 2021-09-27 11:46:17 +02:00
Raphaël Vinot 681e136ef4 chg: More cleanup to use the new caching system as it should be. 2021-09-27 11:36:27 +02:00
Raphaël Vinot d05b1edf48 new: Add logging in Indexing 2021-09-24 16:27:46 +02:00
Raphaël Vinot 6e9e3990c4 fix: Indexes not updated on tree rebuild, better handling of tree cache 2021-09-24 16:16:41 +02:00
Raphaël Vinot 48fc807e7d new: Add monitoring for pickle cache status 2021-09-24 12:02:28 +02:00
Raphaël Vinot 1d3bb55343 chg: Rebuild trees when captures are moved. 2021-09-23 16:40:39 +02:00
Raphaël Vinot 27836b5bdd fix: Skip phishtank if URLs and IPs are unknown (modules) 2021-09-23 14:22:21 +02:00
Raphaël Vinot 22315ac9b6 fix: Typo in module template 2021-09-23 14:14:14 +02:00
Raphaël Vinot 52f6d91fba fix: Skip block if urls not on phishtank. 2021-09-23 14:08:39 +02:00
Raphaël Vinot bf94dd6578 fix: missing endlist on template 2021-09-23 14:05:56 +02:00
Raphaël Vinot 87c6925c7b new: IPs lookup against phishtank 2021-09-23 13:58:40 +02:00
Raphaël Vinot e6e61089b6 chg: Speedup cache initialization 2021-09-23 10:29:02 +02:00
Raphaël Vinot aa7173d27d fix: a broken/missing pickle is handled elsewhere 2021-09-23 09:17:34 +02:00
Raphaël Vinot 19c8c54b0b fix: force-rebuild pickle if needed. 2021-09-22 22:23:20 +02:00
Raphaël Vinot 7afd150570 chg: Bump deps 2021-09-22 17:13:25 +02:00
Raphaël Vinot 32ee474be2 chg: Improve tree creation and cache 2021-09-22 17:09:04 +02:00
Raphaël Vinot 01fff00cad chg: Slight cleanup 2021-09-21 18:04:22 +02:00
Raphaël Vinot 7f6a59a441 chg: Bump SRI for d3js 2021-09-20 22:42:51 +02:00
Raphaël Vinot c08b192242 chg: Bump deps 2021-09-20 22:37:00 +02:00
Raphaël Vinot bfcb4feb9a chg: Remove import 2021-09-17 15:10:21 +02:00
Raphaël Vinot 275b4aee93 fix: Avoid None in urlscan.io result. 2021-09-17 12:58:05 +02:00
Raphaël Vinot 404f9a3112 fix: Avoid exception if none key 2021-09-17 10:06:59 +02:00
Raphaël Vinot e7d9c1cb1a fix: return error message if urlscan isn't able to run the capture. 2021-09-17 09:51:52 +02:00
Raphaël Vinot 963af434dd chg: Improve wording for Phishtank in modules 2021-09-16 17:35:45 +02:00
Raphaël Vinot 7a8ca54104 chg: Bump charset-normalizer 2021-09-16 16:57:54 +02:00
Raphaël Vinot cefb3fddbf new: Phishtank lookup. 2021-09-16 16:33:44 +02:00
Raphaël Vinot 9c552f1032 chg: Move modules into files 2021-09-16 11:22:02 +02:00
Raphaël Vinot 77a94e017e chg: Bump datatables 2021-09-16 10:10:31 +02:00
Raphaël Vinot 1d40dd44ae new: Add urlscan permanent URL to MISP export 2021-09-15 15:42:02 +02:00
Raphaël Vinot d6982392ef chg: cleanup get_user_agents
Related: #262
2021-09-13 22:32:02 +02:00
Raphaël Vinot 258ccde937 chg: Bump pylookyloo 2021-09-11 17:10:56 +02:00
Raphaël Vinot 2f88d16073 fix: Bump scrapy splash wrapper 2021-09-11 16:40:22 +02:00
Raphaël Vinot 22d8672131 chg: Catch timeouts when pushing to MISP 2021-09-10 15:25:37 +02:00
Raphaël Vinot d1f673f3a7 chg: Cleanup passing listing key to and from bool in redis 2021-09-10 14:20:58 +02:00
Raphaël Vinot b59e73258d chg: Bump deps 2021-09-10 12:18:21 +02:00
Raphaël Vinot 9c7929569e fix: The captures are visible on the index by default. 2021-09-08 20:43:56 +02:00
Raphaël Vinot 5abc264159 fix: Better initialization of cache, avoid missing the error message. 2021-09-08 16:34:54 +02:00
Raphaël Vinot 39c7d14264 fix: make mypy happy 2021-09-08 12:50:56 +02:00
Raphaël Vinot 6076b2890d chg: Bump beautifulsoup4 2021-09-08 12:49:29 +02:00
Raphaël Vinot cc4beeef35 fix: Pass listing (y/n) and proper referer to subsequent captures 2021-09-08 12:24:00 +02:00
Raphaël Vinot 48b632aa1e fix: Incorrect matching for listing key in capture (always false) 2021-09-08 10:53:31 +02:00
Raphaël Vinot 902c8f81b6 chg: Improve error message if the capture fails
Fix #257
2021-09-07 18:16:01 +02:00
Raphaël Vinot 07dd01a80b chg: Add link to API doc 2021-09-07 16:44:49 +02:00