Commit Graph

458 Commits (lacus)

Author SHA1 Message Date
Raphaël Vinot b09aec5b84 fix: un-break json dump 2021-02-12 12:06:26 +01:00
Raphaël Vinot d711fd3644 fix: Make get legacy user config quiet 2021-02-05 15:24:11 +01:00
Raphaël Vinot 39dd2021dd chg: Complete rework of the login system, add UI for MISP Push 2021-02-04 19:51:43 +01:00
Raphaël Vinot 610ffef43a new: Add VT objects to MISP export 2021-02-02 15:23:38 +01:00
Raphaël Vinot a68400dac7 chg: Add comments in MISP export 2021-02-02 15:23:38 +01:00
Raphaël Vinot fca3290ef0 fix: Make sure to skip last year's final week in the stats 2021-02-02 15:23:38 +01:00
Raphaël Vinot a7484e6cc4 chg: Improve MISP export
* IPs of redirects
* default tags
* auto publish
2021-02-01 18:09:32 +01:00
Raphaël Vinot 54ba67bb87 chg: Make lookyloo link org only in MISP export for private instances 2021-02-01 14:58:06 +01:00
Raphaël Vinot f017ef5bef chg: Add support to timeout in the MISP module 2021-02-01 13:01:44 +01:00
Raphaël Vinot 60ad0dc7ce fix: add warning if MISP module is enabled, but instance unreachable. 2021-01-29 16:33:56 +01:00
Raphaël Vinot c358c08640 fix: Make mypy happy. 2021-01-28 19:28:54 +01:00
Raphaël Vinot acfb0d1c26 new: Add push to MISP feature 2021-01-28 18:37:47 +01:00
Raphaël Vinot d8d2c59f8b chg: Make mypy happy. 2021-01-25 13:14:33 +01:00
Raphaël Vinot f9d8081efa fix: hidden view 2021-01-18 13:26:02 +01:00
Raphaël Vinot 8bd874e2b0 new: Add variable width thumbnail method 2021-01-18 12:30:07 +01:00
Raphaël Vinot 72463cc898 chg: Slight cleanups and improvments 2021-01-14 17:28:59 +01:00
Raphaël Vinot 6149df06eb chg: Make the cache entries a dataclass
Fix #99
2021-01-14 17:12:23 +01:00
Raphaël Vinot 61baab1fbe fix: make mypy happy 2021-01-13 15:16:36 +01:00
Raphaël Vinot 4686b560dc chg: Better handling of insanely long webpages. 2021-01-13 14:33:20 +01:00
Raphaël Vinot 0d68844c90 chg: Refactoring and documenting 2021-01-12 17:22:51 +01:00
Raphaël Vinot 33326c2463 new: Extract URLs from rendered pages 2021-01-08 13:03:23 +01:00
Raphaël Vinot 2e0671fd96 fix: Properly handle new year in week stats 2021-01-04 12:34:00 +01:00
Raphaël Vinot 7241ae2ea1 fix: Do not fail on MISP export if there are no redirects 2020-12-24 15:43:56 +01:00
Raphaël Vinot 9b18370fe1 fix: Properly generate meta keys related to the User Agents 2020-12-22 19:16:46 +01:00
Raphaël Vinot fcae1d42d0 new: Show images in tooltip in hostnode popup 2020-12-22 18:23:39 +01:00
Raphaël Vinot 62cb5a9eb7 fix: Failure on new install 2020-12-11 10:26:42 +01:00
Raphaël Vinot ed6a53d211 chg: small visual improvments 2020-12-09 21:08:34 +01:00
Raphaël Vinot 3c6eca3567 new: Add screenshot thumbnail on tree, move links to the end of the node 2020-12-09 19:11:19 +01:00
Raphaël Vinot b73a3b7533 chg: Add attachements to MISP export 2020-12-08 14:59:34 +01:00
Raphaël Vinot fbbfa3082d chg: Fix typing 2020-12-07 20:54:33 +01:00
Raphaël Vinot 8eab287721 new: Initial implementation of MISP export 2020-12-07 20:50:46 +01:00
Raphaël Vinot 9b3d338d3c chg: Rename analisys->submission, add unique urls on stats graph 2020-12-07 13:55:03 +01:00
Raphaël Vinot 7bba854e0a fix: Properly call logger 2020-12-04 01:33:58 +01:00
Raphaël Vinot 5897f8024d chg: Do not fail when sanejs is too slow to answer 2020-12-04 00:31:53 +01:00
Raphaël Vinot d353463548 chg: Simplify modules activation 2020-12-03 12:33:35 +01:00
Raphaël Vinot 820c7c5a4d fix: remove broken pickles if needed 2020-12-01 17:00:44 +01:00
Raphaël Vinot 1a7a74cccd chg: Cleanup stats page 2020-11-27 16:27:29 +01:00
Fafner [_KeyZee_] 0e3d007bf5
fixing typo (again) 2020-11-25 12:22:45 +01:00
Fafner [_KeyZee_] 7bf13db3f2
fixing ttypo 2020-11-25 12:05:08 +01:00
Raphaël Vinot d964549e56 fix: Typing, dump to json 2020-11-24 21:01:30 +01:00
Fafner [_KeyZee_] d77dfb1cac
updating output for stats 2020-11-24 18:55:13 +01:00
Raphaël Vinot c54d29601d chg: Fix typing 2020-11-24 18:19:53 +01:00
Fafner [_KeyZee_] bedbb8eb45
adding get_stats() 2020-11-24 16:46:01 +01:00
Fafner [_KeyZee_] 2ae7d87420
Adding uniq_domains 2020-11-24 16:44:43 +01:00
Raphaël Vinot 9c382890f5 fix: Improve lokking on error in capture 2020-11-10 20:27:01 +01:00
Raphaël Vinot 354f269218 new: Integrate categorization in indexing 2020-11-09 16:02:54 +01:00
Raphaël Vinot 9243f84295 fix: No exception if body_hash is not indexed 2020-11-06 15:59:13 +01:00
Raphaël Vinot 99c939fd7f chg: Rename scrape -> capture everywhere
Related to #118
2020-11-03 16:34:52 +01:00
Raphaël Vinot 69d34b803c fix: Duplicates on index. 2020-11-03 12:21:14 +01:00
Raphaël Vinot 8b1e3585ea chg: Improve initial caching. 2020-10-29 23:25:20 +01:00
Raphaël Vinot 69f65c9a87 chg: Update cache on tree visualization 2020-10-29 17:55:43 +01:00
Raphaël Vinot 5f4a97e11b fix: Typing meta 2020-10-29 14:19:17 +01:00
Raphaël Vinot 06a4c2cc87 fix: Speedup sorted cache 2020-10-29 14:06:38 +01:00
Raphaël Vinot da85aa0fb7 fix: Pre-sort entries on index 2020-10-29 13:29:13 +01:00
Raphaël Vinot 2802cfd46c new: Add captures categorization 2020-10-28 18:49:15 +01:00
Raphaël Vinot 451553e60d fix: Do not overwrite the urlnodes 2020-10-27 01:52:28 +01:00
Raphaël Vinot 068c92d5a4 new: API to query hostnames 2020-10-27 01:42:00 +01:00
Raphaël Vinot 39f88e9121 new: API to query URLs 2020-10-27 00:02:18 +01:00
Raphaël Vinot bdc0488e38 new: Hash lookup method 2020-10-23 20:51:15 +02:00
Raphaël Vinot c6c4da981c chg: Improve start/stop 2020-10-22 16:41:00 +02:00
Raphaël Vinot f062895801 fix: Add max size to lru_cache 2020-10-13 13:03:57 +02:00
Raphaël Vinot 4f52804361 chg: Make new version of mypy happy 2020-10-12 12:15:07 +02:00
Raphaël Vinot 90a9ff9bb5 chg: Refactoring, add get_hashes 2020-10-09 18:05:25 +02:00
Raphaël Vinot be2cd18d2b chg: Cleanup mypy config 2020-10-01 11:48:00 +02:00
Raphaël Vinot 9ce06b8821 chg: Add resolved IP on hostnode page 2020-09-29 14:24:18 +02:00
Raphaël Vinot ef6eb1c253 new: Initial support for CNAME lookups 2020-09-25 17:23:10 +02:00
Raphaël Vinot 3ce4f85118 fix: Avoid 500 when sanejs is unreachable 2020-09-25 12:02:40 +02:00
Raphaël Vinot 9663c5de87 fix: Properly load the config files when needed. 2020-09-21 16:54:07 +02:00
Raphaël Vinot a7ecaee8c4 chg: If apikey is None in the modules, break immediately. 2020-09-21 16:47:49 +02:00
Raphaël Vinot 7a34095d9c new: Config option for Flask IP and Port, reorganize config loading 2020-09-21 16:41:30 +02:00
Raphaël Vinot b06f02e101 new: Expose rendered content on hostnode page 2020-09-09 15:04:21 +02:00
Raphaël Vinot 2b237a7416 new: Use rendered HTML 2020-09-08 19:18:55 +02:00
Raphaël Vinot 457829a23f chg: cleanup and improve views 2020-09-04 18:40:51 +02:00
Raphaël Vinot 9f4c77d5d2 chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
Raphaël Vinot 407a9a5511 new: Download ressource from ressources page 2020-09-03 14:39:38 +02:00
Raphaël Vinot 6d22085ceb fix: do not crash on empty malicious file 2020-09-01 18:39:49 +02:00
Raphaël Vinot ecbbceb781 fix: Typing 2020-09-01 17:54:54 +02:00
Raphaël Vinot b16a5768ea chg: Refactoring and normalizing the known hashes lookups 2020-09-01 17:33:36 +02:00
Raphaël Vinot aee62136ab fix: cache unknown hashes in sanejs 2020-09-01 00:51:44 +02:00
Raphaël Vinot 4a9a50e289 chg: Add icon for hostnodes with empty content. 2020-08-31 15:21:41 +02:00
Raphaël Vinot a5c210a5de new: Add checkmark for legitimate nodes. 2020-08-28 19:11:19 +02:00
Raphaël Vinot 6866b49c87 chg: Add support for legitimate content context 2020-08-28 18:24:14 +02:00
Raphaël Vinot 97b5b2d77f chg: Working prototype for user-defined context 2020-08-28 18:03:52 +02:00
Raphaël Vinot 611b2a8ff5 fix: Crash if there are no ressources 2020-08-27 16:15:07 +02:00
Raphaël Vinot 9eb08beb3c chg: Add load/dump of known legit captures 2020-08-27 15:48:56 +02:00
Raphaël Vinot 60b767d08f chg: Normalize ressources details display, refactoring 2020-08-27 12:57:10 +02:00
Raphaël Vinot 11598fc3ba chg: Major refactoring of the contextualization of the body contents 2020-08-26 16:52:59 +02:00
Raphaël Vinot 1b0cdde84e chg: Normalize known content lookup 2020-08-25 18:00:16 +02:00
Raphaël Vinot 4d6237aae5 fix: Make mypy happy 2020-08-25 15:52:54 +02:00
Raphaël Vinot c75b9e65fe chg: Remove known content from SaneJS module 2020-08-25 15:51:08 +02:00
Raphaël Vinot bdb726ca9e new: Add malicious listing on hostnode 2020-08-24 15:31:53 +02:00
Raphaël Vinot c5aabcf4a3 new: Initial commit to mark body responses as legitimate/malicious 2020-08-20 19:39:03 +02:00
Raphaël Vinot fa57435433 chg: Sanity check in email send 2020-08-20 15:05:27 +02:00
Raphaël Vinot 339d0dd7e0 fix: Make mypy happy 2020-08-10 20:11:26 +02:00
Raphaël Vinot 83d8f49be9 fix: Missing change for last commit 2020-08-10 20:05:47 +02:00
Raphaël Vinot 2873773ee7 new: trigger to hide a capture from the front page (admin only) 2020-08-10 12:35:16 +02:00
Raphaël Vinot f17acbce60 fix: Referer cannot be None 2020-07-20 23:04:11 +02:00
Raphaël Vinot 1c5f4f5710 fix: Do not index private captures on public instance 2020-07-20 13:39:08 +02:00
Raphaël Vinot c7db7829a7 chg: More macros 2020-07-15 18:04:34 +02:00
Raphaël Vinot 0468317a20 chg: Improve rendering, bump deps. 2020-07-15 01:35:55 +02:00
Raphaël Vinot 89725b8ed0 new: Download embedded resource 2020-07-11 02:10:56 +02:00
Raphaël Vinot e5e4e4972e new: Add visualisation for embedded resources. 2020-07-10 18:57:16 +02:00
Raphaël Vinot db0d5b3f2d chg: Remove unused parameter. 2020-07-08 15:52:26 +02:00
Raphaël Vinot 0c5501016c fix: Rebuild caches when tree doesn't exists 2020-07-08 15:52:26 +02:00
Raphaël Vinot 23419a31b9 fix: cleanup 2020-07-08 15:52:26 +02:00
Raphaël Vinot 4851436999 chg: More improvements in body hash display 2020-07-08 15:51:45 +02:00
Raphaël Vinot bfa39223c8 chg: Improve hash lookup rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 34a5dff055 chg: Refactoring, use capture UUID insted of path as reference for public methods 2020-07-08 15:51:45 +02:00
Raphaël Vinot 95a08f5655 fix: Make mypy happy 2020-07-08 15:51:45 +02:00
Raphaël Vinot a4bc2b2818 new: Improve hostnode popup, center tree on node 2020-07-08 15:51:45 +02:00
Raphaël Vinot 29c78d3485 chg: Cleanup and improve index rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 7772706262 new: Display body hashes matches on hostnode page 2020-07-08 15:51:01 +02:00
Raphaël Vinot 6e13622d88 fix: Typing 2020-07-08 15:51:01 +02:00
Raphaël Vinot 6bb26c4358 new: Initial support for body hashes index 2020-07-08 15:51:01 +02:00
Raphaël Vinot e6aded6c12 chg: Add domains aggregation by cookies names 2020-07-08 15:51:01 +02:00
Raphaël Vinot 67b41ca8fb chg: Improve intergration of cookies indexing 2020-07-08 15:51:01 +02:00
Raphaël Vinot e6c9f6dada new: Add capture meta on the related cookies page 2020-07-08 15:42:13 +02:00
Raphaël Vinot 5ae7f0f7e4 new: Initial version of cookies indexing 2020-07-08 15:42:13 +02:00
Raphaël Vinot d18f5f4f88 fix: Docker, capture form, error message. 2020-07-08 02:25:15 +02:00
Raphaël Vinot 33fb74ae83 new: Add referer to initial URL 2020-07-08 00:37:29 +02:00
Raphaël Vinot 4cfe91392a chg: Docker, default to env variable for splash URL 2020-07-07 13:51:09 +02:00
Raphaël Vinot 316338a213 chg: Better error handling 2020-07-06 15:33:00 +02:00
Raphaël Vinot 605dc00989 fix: Properly handle json dumps 2020-07-06 14:16:17 +02:00
Raphaël Vinot 1d77a2001e chg: Bump deps, improve error handling 2020-07-03 18:25:16 +02:00
Raphaël Vinot 41acc544ef chg: depth from UI is a string... 2020-06-29 19:23:16 +02:00
Raphaël Vinot ce6deabdad fix: convert max_depth from config to int 2020-06-29 19:21:38 +02:00
Raphaël Vinot afe95c28f6 new: Add max depth for scraping. 2020-06-29 18:00:56 +02:00
Raphaël Vinot 05de56022f chg: Use capture UUID as a reference everywhere 2020-06-29 12:01:31 +02:00
Raphaël Vinot 98495c40a9 chg: Make mypy happy 2020-06-25 17:08:11 +02:00
Raphaël Vinot b818055f32 fix: Skip unparsable UAs 2020-06-25 16:50:57 +02:00
Raphaël Vinot cde3d29892 new: Add option to use User agents of the Lookyloo users for scraping 2020-06-25 16:43:58 +02:00
Raphaël Vinot f4bf64a485 fix: Do not fail if the meta file is missing. 2020-06-24 11:49:10 +02:00
Raphaël Vinot 6871912e64 chg: Expose the picklized tree in lookyloo 2020-06-12 11:18:54 +02:00
Raphaël Vinot 9873d3ebc3 fix: Incorrect typing 2020-06-11 15:32:43 +02:00
Raphaël Vinot 1c408af3b0 chg: Improve cookies in hostnode view 2020-06-11 15:13:31 +02:00
Raphaël Vinot 0ed7dbb5cb chg: Cleanup deps, use tagged versions 2020-06-10 18:41:03 +02:00
Raphaël Vinot 285a0cf727 new: Phishing Initiative module 2020-06-09 15:06:35 +02:00
Raphaël Vinot 6a8bafd9dc chg: Cleanup, move to Lookyloo organization 2020-06-08 16:37:59 +02:00
Raphaël Vinot 0751321e9b new: Cookies investigation 2020-06-04 18:23:36 +02:00
Raphaël Vinot bed6b4e39e chg: Add initial URL in email notification 2020-05-27 15:39:06 +02:00
Raphaël Vinot 5ebb35c161 new: Add redirects in notifications, optional reply-to 2020-05-27 15:15:45 +02:00
Raphaël Vinot 3a3be0cb46 new: Add handles for cookies 2020-05-26 17:45:04 +02:00
Raphaël Vinot 5baab51951 fix: Proper fallback for the user agent. 2020-05-24 15:35:30 +02:00
Raphaël Vinot ea1df97524 chg: Add 1px files 2020-05-24 03:26:16 +02:00
Raphaël Vinot 16c2f63cac chg: Bump dependencies 2020-05-24 01:56:42 +02:00
Raphaël Vinot 876352c2f7 chg: Improve pop-up, cleanup old code. 2020-05-23 03:37:24 +02:00
Raphaël Vinot d04db67d2d Improve hostname popup 2020-05-22 17:36:22 +02:00
Raphaël Vinot 83aef5d680 chg: Fix typing 2020-05-21 23:46:35 +02:00
Raphaël Vinot 3b631f2c92 chg: Improve popup, remove session. 2020-05-20 19:11:15 +02:00
Raphaël Vinot c3bf87beca chg: Improve popup, make sanejs a module, cache 2020-05-19 17:47:55 +02:00
Raphaël Vinot 466cb5fcd5 chg: Improve typing 2020-05-18 18:32:59 +02:00
Raphaël Vinot 1882c9d71a fix: Please mypy 2020-05-15 11:39:16 +02:00
Raphaël Vinot d3971cc47c new: Add stats 2020-05-13 17:31:27 +02:00
Raphaël Vinot cd972076b5 new: Add url to do a full export, and get the page 2020-05-12 16:53:10 +02:00
Raphaël Vinot 754ae9354d new: Add email notification feature 2020-05-11 19:01:06 +02:00
Raphaël Vinot 70c642b0f6 fix: Do not display the full path to the capture 2020-05-07 15:46:45 +02:00
Raphaël Vinot 487222b81e fix: Do not fail when getting the UA breaks 2020-05-02 01:41:29 +02:00
Raphaël Vinot 996bd74e30 fix: Missing f-string 2020-04-24 15:57:16 +02:00
Raphaël Vinot ae49fd2c11 new: Add support to pass more parameters via the API 2020-04-21 18:41:57 +02:00
Raphaël Vinot b1034739ad chg: Fix mypy, bump deps 2020-04-20 16:52:46 +02:00
Raphaël Vinot a0c906d3dc new: Initial view for 3rd party modules 2020-04-20 16:41:42 +02:00
Raphaël Vinot de7f50c3b0 chg: Improve logging 2020-04-03 17:51:58 +02:00
Raphaël Vinot 1c2cdad38b new: Allow admin to rebuild cache 2020-04-01 17:44:06 +02:00
Raphaël Vinot e62d56e555 chg: Bump har2tree, cleanup 2020-04-01 14:33:35 +02:00
Raphaël Vinot 17c3473d95 new: Add config files, initial support for 3rd party modules 2020-03-31 14:12:57 +02:00
Raphaël Vinot c322bc1b23 fix: Pass proper path to the pickled dump 2020-03-26 14:55:01 +01:00
Raphaël Vinot 949ad58667 chg: Refactoring of the redirects, rename report -> capture 2020-03-26 01:56:24 +01:00
Raphaël Vinot f26a02ef86 new: Add link redirects on index 2020-03-23 12:45:57 +01:00
Raphaël Vinot c97537fbe9 fix: Strip tabs/spaces around URL 2020-03-19 14:05:19 +01:00
Raphaël Vinot 1fd48df470 fix: Refang the URL at the right place 2020-03-19 11:05:29 +01:00
Raphaël Vinot 971877954e new: Add support for last redirect 2020-03-18 21:14:48 +01:00
Fafner [_KeyZee_] 3a8b7e6077
Fixing Unknown domain if only_global_lookups is set 2020-03-17 16:32:39 +01:00
Fafner [_KeyZee_] 5c5577b97d
Fixing Unknown domain if only_global_lookups is set 2020-03-17 16:26:31 +01:00
Raphaël Vinot 9aa995092e chg: Improve error notification 2020-03-17 15:27:04 +01:00
Raphaël Vinot af98c2b075 chg: Better handling of error messages, display them. 2020-03-17 14:17:18 +01:00
Raphaël Vinot 75cb4d3246 new: refang urls when needed 2020-03-16 13:51:21 +01:00
Raphaël Vinot 9b4bbb2450 fix: Missing cast 2020-02-16 23:51:04 +01:00
Raphaël Vinot 7d2f50174d chg: Bump dependencies, Improve HTTP errors handling
Fix https://github.com/CIRCL/lookyloo/issues/66
2020-02-16 23:38:42 +01:00
Raphaël Vinot 09b3b16910 fix: Properly check keys in cache 2020-02-11 17:26:01 +01:00
Raphaël Vinot 794d9745ab fix: wrong variable in last commit 2020-02-11 17:09:15 +01:00
Raphaël Vinot e7b97d23b7 fix: Better handling of cache issues 2020-02-11 17:03:25 +01:00
Raphaël Vinot 4234e44470 new: Add initial redirects columns 2020-02-03 22:25:48 +01:00
Raphaël Vinot 89edef68ab new: Improve index 2020-02-03 18:30:41 +01:00
Raphaël Vinot c9cbf27acc chg: Fix typing 2020-01-24 11:25:53 +01:00
Raphaël Vinot f1309ce5e3 new: Upload optional cookie file 2020-01-24 10:17:41 +01:00
Raphaël Vinot f1d83d29cf new: Add support for user defined cookies, bump deps 2020-01-23 10:52:50 +01:00
Raphaël Vinot d34233ad5c chg: Use poetry instead of pipenv 2020-01-21 17:39:18 +01:00
Raphaël Vinot 2d82303ef6 chg: Support cookies from/to splash (no UI yet) 2020-01-21 11:47:36 +01:00
Raphaël Vinot 0aaa814224 new: Initial commit for cookies tracking. No update on the view yet. 2020-01-10 17:28:15 +01:00
Raphaël Vinot dec6920cb8 chg: Add typing 2020-01-06 15:32:38 +01:00
Raphaël Vinot 5cfe5306b2 fix: Skip UA fetch on cloudflare website until the lib is updated 2019-12-17 14:29:58 +01:00
Raphaël Vinot 4c86b65c56 fix: Avoid bypass with "http://user:pwd@host.tld" 2019-07-05 18:42:18 +02:00
Raphaël Vinot a6693535de fix: Allow to disable scraping private IPs. 2019-07-05 16:27:23 +02:00
Raphaël Vinot 8165913206 fix: Initialize cache only once 2019-06-25 18:08:52 +02:00
Raphaël Vinot 320105aca1 fix: Get most common user agents from willshouse.com behind cloudflare 2019-05-27 15:34:26 +02:00
Raphaël Vinot 66545c26a5 new: keep track of metadata about OS and Browser when scraping 2019-04-07 23:54:16 +02:00
Raphaël Vinot 12b8e4f949 chg: Improve async processing 2019-04-05 16:12:54 +02:00
Raphaël Vinot da3d1fe392 fix: Avoid loading the cache multiple times 2019-04-05 15:07:22 +02:00
Raphaël Vinot 6b10e74470 fix: do not initialize the redis cache more than once. 2019-04-05 14:48:25 +02:00
Raphaël Vinot 0d937b02c9 fix: Properly remove files if the scraping failed 2019-04-04 00:41:15 +02:00
Raphaël Vinot 36c856ef9b new: Add initial support for user-agent 2019-03-29 20:11:44 +01:00
Raphaël Vinot 49654b6b11 fix: Automatically remove failed runs. 2019-03-27 10:21:37 +01:00
Raphaël Vinot fdcc566e05 chg: Slight cleanup 2019-02-18 14:29:15 +01:00
Raphaël Vinot 747ce7e52d Merge branch 'anonyme' of https://github.com/Th4nat0s/lookyloo into Th4nat0s-anonyme 2019-02-18 13:53:04 +01:00
Raphaël Vinot 9f2b7f7b93 new: Add error page 2019-02-18 13:52:48 +01:00
Th4nat0s 8afcc30840 clarifie index enable/disable 2019-02-17 21:45:23 +00:00
thanat0s f029b5d324 Add noindex button 2019-02-17 17:43:25 +00:00
Raphaël Vinot 189b78e20f chg: pre-load the existing reports 2019-02-01 16:11:16 +01:00
Raphaël Vinot 1d244ef456 chg: Refactor code organisation 2019-01-30 14:30:01 +01:00
Raphaël Vinot e5de1a9958 fix: Make sure sanejs is optional 2019-01-30 13:14:16 +01:00
Raphaël Vinot 6bc316ebcf new: Initial commit for client and async scraping 2019-01-29 18:37:13 +01:00
Raphaël Vinot e14a0150a0 chg: Assign a UUID for each scraped page, allow permalinks 2019-01-29 11:42:56 +01:00
Raphaël Vinot 945511d6b3 chg: Use PySaneJS to query SaneJS 2019-01-27 17:17:31 +01:00
Raphaël Vinot bbb8c5343f chg: Cleanup, use pipfile 2019-01-23 15:13:29 +01:00
Raphaël Vinot 2825096dc7 fix: Do not fail if SaneJS is not available 2018-07-20 11:36:54 +02:00
Raphaël Vinot 3c9b28b704 new: Add integration with SaneJS 2018-07-19 18:18:22 +02:00
Raphaël Vinot 5202630278 fix: Improve URL overlay 2018-06-29 14:03:52 +08:00
Raphaël Vinot c8fb313d28 new: Download screenshot of the page. 2018-05-10 09:48:48 +02:00
Raphaël Vinot 6329e7747f fix: Wrong URL path 2018-04-09 11:16:22 +02:00
Raphaël Vinot f6345e47e1 new: allow to download the URLs list in a text file 2018-04-06 18:06:41 +02:00
Raphaël Vinot d7cf92db21 new: Close button for the overlays 2018-04-05 22:59:45 +02:00
Raphaël Vinot 72759850ac chg: Use d3v5, cleanup. 2018-04-05 11:17:26 +02:00
Raphaël Vinot fb195971e8 chg: use pathlib everywhere, remove old tmpfiles 2018-03-22 18:33:42 +01:00
Raphaël Vinot 247a4a26b0 chg: Change cookie name, update legend, remove old pickled trees
Fix #18
2018-03-22 17:22:19 +01:00
Raphaël Vinot 32ba719d5c new: Add Icons 2018-03-15 09:33:38 +01:00
Raphaël Vinot 22f1474120 new: Link to URL overlay 2018-02-23 18:45:12 +01:00
Raphaël Vinot 510c35b57f chg: Store iframe info and PNG 2018-02-09 18:30:19 +01:00
Raphaël Vinot 92ffd1b7da new: Allow to download the bodies 2018-02-06 01:23:00 +01:00
Raphaël Vinot f3ee006047 new: Generic generator for icon list 2018-02-01 23:58:26 +01:00
Raphaël Vinot 6f31c2bce0 chg: make methods. 2018-02-01 01:16:20 +01:00
Raphaël Vinot 8955c9c7f7 chg: Slight refactoring 2018-01-30 15:41:35 +01:00
Raphaël Vinot 40569a3a73 new: Improve the URL box.
Remove all tabs.
2018-01-22 10:49:45 +01:00
Raphaël Vinot 34c1be7695 Get ready for building URL tree. 2018-01-16 18:06:43 +01:00
Raphaël Vinot ab37ced391 chg: Dragable box for URLs of a domain 2018-01-16 17:48:11 +01:00
Raphaël Vinot 19b0cb25f8 up: UI improvments 2017-10-10 11:16:16 +02:00
Raphaël Vinot 629370fc74 Cleanup 2017-10-05 17:38:35 +02:00
Raphaël Vinot 8b353e3e76 Properly use click event 2017-10-04 17:09:00 +02:00
Raphaël Vinot 5102546789 Cleanup, set favicon 2017-10-04 16:39:03 +02:00
Raphaël Vinot 0ac38a0f2c Add tooltip for URLs 2017-10-04 15:13:42 +02:00
Raphaël Vinot 85b8fd2c0a Cleanup and improve tree view 2017-09-29 17:30:01 +02:00
Raphaël Vinot 2b9213eb1f Only import tree.js in the tree view page 2017-09-29 14:48:37 +02:00
Raphaël Vinot 8d9122b36c Make the svg size generic. 2017-09-29 14:43:40 +02:00
Raphaël Vinot b9c3d0b276 Add favicon 2017-09-29 14:43:08 +02:00
Raphaël Vinot 9cb772eb79 Add infoboxes on the tree view 2017-09-25 14:11:01 +01:00
Raphaël Vinot 6900e08dc4 Make the node length dynamic 2017-09-25 11:13:45 +01:00
Raphaël Vinot 17e6b6cce5 Add background pattern 2017-09-25 10:23:32 +01:00
Raphaël Vinot d22b6a9312 Initial commit 2017-09-23 23:54:38 +01:00
Raphaël Vinot 2755855c43 Reverse order index page 2017-09-13 09:38:25 +02:00
Raphaël Vinot 9e207290eb Fix template 2017-09-07 16:22:16 +02:00
Raphaël Vinot 7f6902d910 Fix last commit 2017-09-07 13:44:32 +02:00