Commit Graph

257 Commits (154d2d1e31251f13dad7d5d96227000b8a1811e3)

Author SHA1 Message Date
Raphaël Vinot 5f4a97e11b fix: Typing meta 2020-10-29 14:19:17 +01:00
Raphaël Vinot 06a4c2cc87 fix: Speedup sorted cache 2020-10-29 14:06:38 +01:00
Raphaël Vinot da85aa0fb7 fix: Pre-sort entries on index 2020-10-29 13:29:13 +01:00
Raphaël Vinot 2802cfd46c new: Add captures categorization 2020-10-28 18:49:15 +01:00
Raphaël Vinot 451553e60d fix: Do not overwrite the urlnodes 2020-10-27 01:52:28 +01:00
Raphaël Vinot 068c92d5a4 new: API to query hostnames 2020-10-27 01:42:00 +01:00
Raphaël Vinot 39f88e9121 new: API to query URLs 2020-10-27 00:02:18 +01:00
Raphaël Vinot bdc0488e38 new: Hash lookup method 2020-10-23 20:51:15 +02:00
Raphaël Vinot c6c4da981c chg: Improve start/stop 2020-10-22 16:41:00 +02:00
Raphaël Vinot f062895801 fix: Add max size to lru_cache 2020-10-13 13:03:57 +02:00
Raphaël Vinot 4f52804361 chg: Make new version of mypy happy 2020-10-12 12:15:07 +02:00
Raphaël Vinot 90a9ff9bb5 chg: Refactoring, add get_hashes 2020-10-09 18:05:25 +02:00
Raphaël Vinot be2cd18d2b chg: Cleanup mypy config 2020-10-01 11:48:00 +02:00
Raphaël Vinot 9ce06b8821 chg: Add resolved IP on hostnode page 2020-09-29 14:24:18 +02:00
Raphaël Vinot ef6eb1c253 new: Initial support for CNAME lookups 2020-09-25 17:23:10 +02:00
Raphaël Vinot 3ce4f85118 fix: Avoid 500 when sanejs is unreachable 2020-09-25 12:02:40 +02:00
Raphaël Vinot 9663c5de87 fix: Properly load the config files when needed. 2020-09-21 16:54:07 +02:00
Raphaël Vinot a7ecaee8c4 chg: If apikey is None in the modules, break immediately. 2020-09-21 16:47:49 +02:00
Raphaël Vinot 7a34095d9c new: Config option for Flask IP and Port, reorganize config loading 2020-09-21 16:41:30 +02:00
Raphaël Vinot b06f02e101 new: Expose rendered content on hostnode page 2020-09-09 15:04:21 +02:00
Raphaël Vinot 2b237a7416 new: Use rendered HTML 2020-09-08 19:18:55 +02:00
Raphaël Vinot 457829a23f chg: cleanup and improve views 2020-09-04 18:40:51 +02:00
Raphaël Vinot 9f4c77d5d2 chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
Raphaël Vinot 407a9a5511 new: Download ressource from ressources page 2020-09-03 14:39:38 +02:00
Raphaël Vinot 6d22085ceb fix: do not crash on empty malicious file 2020-09-01 18:39:49 +02:00
Raphaël Vinot ecbbceb781 fix: Typing 2020-09-01 17:54:54 +02:00
Raphaël Vinot b16a5768ea chg: Refactoring and normalizing the known hashes lookups 2020-09-01 17:33:36 +02:00
Raphaël Vinot aee62136ab fix: cache unknown hashes in sanejs 2020-09-01 00:51:44 +02:00
Raphaël Vinot 4a9a50e289 chg: Add icon for hostnodes with empty content. 2020-08-31 15:21:41 +02:00
Raphaël Vinot a5c210a5de new: Add checkmark for legitimate nodes. 2020-08-28 19:11:19 +02:00
Raphaël Vinot 6866b49c87 chg: Add support for legitimate content context 2020-08-28 18:24:14 +02:00
Raphaël Vinot 97b5b2d77f chg: Working prototype for user-defined context 2020-08-28 18:03:52 +02:00
Raphaël Vinot 611b2a8ff5 fix: Crash if there are no ressources 2020-08-27 16:15:07 +02:00
Raphaël Vinot 9eb08beb3c chg: Add load/dump of known legit captures 2020-08-27 15:48:56 +02:00
Raphaël Vinot 60b767d08f chg: Normalize ressources details display, refactoring 2020-08-27 12:57:10 +02:00
Raphaël Vinot 11598fc3ba chg: Major refactoring of the contextualization of the body contents 2020-08-26 16:52:59 +02:00
Raphaël Vinot 1b0cdde84e chg: Normalize known content lookup 2020-08-25 18:00:16 +02:00
Raphaël Vinot 4d6237aae5 fix: Make mypy happy 2020-08-25 15:52:54 +02:00
Raphaël Vinot c75b9e65fe chg: Remove known content from SaneJS module 2020-08-25 15:51:08 +02:00
Raphaël Vinot bdb726ca9e new: Add malicious listing on hostnode 2020-08-24 15:31:53 +02:00
Raphaël Vinot c5aabcf4a3 new: Initial commit to mark body responses as legitimate/malicious 2020-08-20 19:39:03 +02:00
Raphaël Vinot fa57435433 chg: Sanity check in email send 2020-08-20 15:05:27 +02:00
Raphaël Vinot 339d0dd7e0 fix: Make mypy happy 2020-08-10 20:11:26 +02:00
Raphaël Vinot 83d8f49be9 fix: Missing change for last commit 2020-08-10 20:05:47 +02:00
Raphaël Vinot 2873773ee7 new: trigger to hide a capture from the front page (admin only) 2020-08-10 12:35:16 +02:00
Raphaël Vinot f17acbce60 fix: Referer cannot be None 2020-07-20 23:04:11 +02:00
Raphaël Vinot 1c5f4f5710 fix: Do not index private captures on public instance 2020-07-20 13:39:08 +02:00
Raphaël Vinot c7db7829a7 chg: More macros 2020-07-15 18:04:34 +02:00
Raphaël Vinot 0468317a20 chg: Improve rendering, bump deps. 2020-07-15 01:35:55 +02:00
Raphaël Vinot 89725b8ed0 new: Download embedded resource 2020-07-11 02:10:56 +02:00
Raphaël Vinot e5e4e4972e new: Add visualisation for embedded resources. 2020-07-10 18:57:16 +02:00
Raphaël Vinot db0d5b3f2d chg: Remove unused parameter. 2020-07-08 15:52:26 +02:00
Raphaël Vinot 0c5501016c fix: Rebuild caches when tree doesn't exists 2020-07-08 15:52:26 +02:00
Raphaël Vinot 23419a31b9 fix: cleanup 2020-07-08 15:52:26 +02:00
Raphaël Vinot 4851436999 chg: More improvements in body hash display 2020-07-08 15:51:45 +02:00
Raphaël Vinot bfa39223c8 chg: Improve hash lookup rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 34a5dff055 chg: Refactoring, use capture UUID insted of path as reference for public methods 2020-07-08 15:51:45 +02:00
Raphaël Vinot 95a08f5655 fix: Make mypy happy 2020-07-08 15:51:45 +02:00
Raphaël Vinot a4bc2b2818 new: Improve hostnode popup, center tree on node 2020-07-08 15:51:45 +02:00
Raphaël Vinot 29c78d3485 chg: Cleanup and improve index rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 7772706262 new: Display body hashes matches on hostnode page 2020-07-08 15:51:01 +02:00
Raphaël Vinot 6e13622d88 fix: Typing 2020-07-08 15:51:01 +02:00
Raphaël Vinot 6bb26c4358 new: Initial support for body hashes index 2020-07-08 15:51:01 +02:00
Raphaël Vinot e6aded6c12 chg: Add domains aggregation by cookies names 2020-07-08 15:51:01 +02:00
Raphaël Vinot 67b41ca8fb chg: Improve intergration of cookies indexing 2020-07-08 15:51:01 +02:00
Raphaël Vinot e6c9f6dada new: Add capture meta on the related cookies page 2020-07-08 15:42:13 +02:00
Raphaël Vinot 5ae7f0f7e4 new: Initial version of cookies indexing 2020-07-08 15:42:13 +02:00
Raphaël Vinot d18f5f4f88 fix: Docker, capture form, error message. 2020-07-08 02:25:15 +02:00
Raphaël Vinot 33fb74ae83 new: Add referer to initial URL 2020-07-08 00:37:29 +02:00
Raphaël Vinot 4cfe91392a chg: Docker, default to env variable for splash URL 2020-07-07 13:51:09 +02:00
Raphaël Vinot 316338a213 chg: Better error handling 2020-07-06 15:33:00 +02:00
Raphaël Vinot 605dc00989 fix: Properly handle json dumps 2020-07-06 14:16:17 +02:00
Raphaël Vinot 1d77a2001e chg: Bump deps, improve error handling 2020-07-03 18:25:16 +02:00
Raphaël Vinot 41acc544ef chg: depth from UI is a string... 2020-06-29 19:23:16 +02:00
Raphaël Vinot ce6deabdad fix: convert max_depth from config to int 2020-06-29 19:21:38 +02:00
Raphaël Vinot afe95c28f6 new: Add max depth for scraping. 2020-06-29 18:00:56 +02:00
Raphaël Vinot 05de56022f chg: Use capture UUID as a reference everywhere 2020-06-29 12:01:31 +02:00
Raphaël Vinot 98495c40a9 chg: Make mypy happy 2020-06-25 17:08:11 +02:00
Raphaël Vinot b818055f32 fix: Skip unparsable UAs 2020-06-25 16:50:57 +02:00
Raphaël Vinot cde3d29892 new: Add option to use User agents of the Lookyloo users for scraping 2020-06-25 16:43:58 +02:00
Raphaël Vinot f4bf64a485 fix: Do not fail if the meta file is missing. 2020-06-24 11:49:10 +02:00
Raphaël Vinot 6871912e64 chg: Expose the picklized tree in lookyloo 2020-06-12 11:18:54 +02:00
Raphaël Vinot 9873d3ebc3 fix: Incorrect typing 2020-06-11 15:32:43 +02:00
Raphaël Vinot 1c408af3b0 chg: Improve cookies in hostnode view 2020-06-11 15:13:31 +02:00
Raphaël Vinot 0ed7dbb5cb chg: Cleanup deps, use tagged versions 2020-06-10 18:41:03 +02:00
Raphaël Vinot 285a0cf727 new: Phishing Initiative module 2020-06-09 15:06:35 +02:00
Raphaël Vinot 6a8bafd9dc chg: Cleanup, move to Lookyloo organization 2020-06-08 16:37:59 +02:00
Raphaël Vinot 0751321e9b new: Cookies investigation 2020-06-04 18:23:36 +02:00
Raphaël Vinot bed6b4e39e chg: Add initial URL in email notification 2020-05-27 15:39:06 +02:00
Raphaël Vinot 5ebb35c161 new: Add redirects in notifications, optional reply-to 2020-05-27 15:15:45 +02:00
Raphaël Vinot 3a3be0cb46 new: Add handles for cookies 2020-05-26 17:45:04 +02:00
Raphaël Vinot 5baab51951 fix: Proper fallback for the user agent. 2020-05-24 15:35:30 +02:00
Raphaël Vinot ea1df97524 chg: Add 1px files 2020-05-24 03:26:16 +02:00
Raphaël Vinot 16c2f63cac chg: Bump dependencies 2020-05-24 01:56:42 +02:00
Raphaël Vinot 876352c2f7 chg: Improve pop-up, cleanup old code. 2020-05-23 03:37:24 +02:00
Raphaël Vinot d04db67d2d Improve hostname popup 2020-05-22 17:36:22 +02:00
Raphaël Vinot 83aef5d680 chg: Fix typing 2020-05-21 23:46:35 +02:00
Raphaël Vinot 3b631f2c92 chg: Improve popup, remove session. 2020-05-20 19:11:15 +02:00
Raphaël Vinot c3bf87beca chg: Improve popup, make sanejs a module, cache 2020-05-19 17:47:55 +02:00
Raphaël Vinot 466cb5fcd5 chg: Improve typing 2020-05-18 18:32:59 +02:00