Commit Graph

67 Commits (200565f366b561829ac242c4fb130bded68ed1b5)

Author SHA1 Message Date
Raphaël Vinot 4c86b65c56 fix: Avoid bypass with "http://user:pwd@host.tld" 2019-07-05 18:42:18 +02:00
Raphaël Vinot a6693535de fix: Allow to disable scraping private IPs. 2019-07-05 16:27:23 +02:00
Raphaël Vinot 8165913206 fix: Initialize cache only once 2019-06-25 18:08:52 +02:00
Raphaël Vinot 320105aca1 fix: Get most common user agents from willshouse.com behind cloudflare 2019-05-27 15:34:26 +02:00
Raphaël Vinot 66545c26a5 new: keep track of metadata about OS and Browser when scraping 2019-04-07 23:54:16 +02:00
Raphaël Vinot 12b8e4f949 chg: Improve async processing 2019-04-05 16:12:54 +02:00
Raphaël Vinot da3d1fe392 fix: Avoid loading the cache multiple times 2019-04-05 15:07:22 +02:00
Raphaël Vinot 6b10e74470 fix: do not initialize the redis cache more than once. 2019-04-05 14:48:25 +02:00
Raphaël Vinot 0d937b02c9 fix: Properly remove files if the scraping failed 2019-04-04 00:41:15 +02:00
Raphaël Vinot 36c856ef9b new: Add initial support for user-agent 2019-03-29 20:11:44 +01:00
Raphaël Vinot 49654b6b11 fix: Automatically remove failed runs. 2019-03-27 10:21:37 +01:00
Raphaël Vinot fdcc566e05 chg: Slight cleanup 2019-02-18 14:29:15 +01:00
Raphaël Vinot 747ce7e52d Merge branch 'anonyme' of https://github.com/Th4nat0s/lookyloo into Th4nat0s-anonyme 2019-02-18 13:53:04 +01:00
Raphaël Vinot 9f2b7f7b93 new: Add error page 2019-02-18 13:52:48 +01:00
Th4nat0s 8afcc30840 clarifie index enable/disable 2019-02-17 21:45:23 +00:00
thanat0s f029b5d324 Add noindex button 2019-02-17 17:43:25 +00:00
Raphaël Vinot 189b78e20f chg: pre-load the existing reports 2019-02-01 16:11:16 +01:00
Raphaël Vinot 1d244ef456 chg: Refactor code organisation 2019-01-30 14:30:01 +01:00
Raphaël Vinot e5de1a9958 fix: Make sure sanejs is optional 2019-01-30 13:14:16 +01:00
Raphaël Vinot 6bc316ebcf new: Initial commit for client and async scraping 2019-01-29 18:37:13 +01:00
Raphaël Vinot e14a0150a0 chg: Assign a UUID for each scraped page, allow permalinks 2019-01-29 11:42:56 +01:00
Raphaël Vinot 945511d6b3 chg: Use PySaneJS to query SaneJS 2019-01-27 17:17:31 +01:00
Raphaël Vinot bbb8c5343f chg: Cleanup, use pipfile 2019-01-23 15:13:29 +01:00
Raphaël Vinot 2825096dc7 fix: Do not fail if SaneJS is not available 2018-07-20 11:36:54 +02:00
Raphaël Vinot 3c9b28b704 new: Add integration with SaneJS 2018-07-19 18:18:22 +02:00
Raphaël Vinot 5202630278 fix: Improve URL overlay 2018-06-29 14:03:52 +08:00
Raphaël Vinot c8fb313d28 new: Download screenshot of the page. 2018-05-10 09:48:48 +02:00
Raphaël Vinot 6329e7747f fix: Wrong URL path 2018-04-09 11:16:22 +02:00
Raphaël Vinot f6345e47e1 new: allow to download the URLs list in a text file 2018-04-06 18:06:41 +02:00
Raphaël Vinot d7cf92db21 new: Close button for the overlays 2018-04-05 22:59:45 +02:00
Raphaël Vinot 72759850ac chg: Use d3v5, cleanup. 2018-04-05 11:17:26 +02:00
Raphaël Vinot fb195971e8 chg: use pathlib everywhere, remove old tmpfiles 2018-03-22 18:33:42 +01:00
Raphaël Vinot 247a4a26b0 chg: Change cookie name, update legend, remove old pickled trees
Fix #18
2018-03-22 17:22:19 +01:00
Raphaël Vinot 32ba719d5c new: Add Icons 2018-03-15 09:33:38 +01:00
Raphaël Vinot 22f1474120 new: Link to URL overlay 2018-02-23 18:45:12 +01:00
Raphaël Vinot 510c35b57f chg: Store iframe info and PNG 2018-02-09 18:30:19 +01:00
Raphaël Vinot 92ffd1b7da new: Allow to download the bodies 2018-02-06 01:23:00 +01:00
Raphaël Vinot f3ee006047 new: Generic generator for icon list 2018-02-01 23:58:26 +01:00
Raphaël Vinot 6f31c2bce0 chg: make methods. 2018-02-01 01:16:20 +01:00
Raphaël Vinot 8955c9c7f7 chg: Slight refactoring 2018-01-30 15:41:35 +01:00
Raphaël Vinot 40569a3a73 new: Improve the URL box.
Remove all tabs.
2018-01-22 10:49:45 +01:00
Raphaël Vinot 34c1be7695 Get ready for building URL tree. 2018-01-16 18:06:43 +01:00
Raphaël Vinot ab37ced391 chg: Dragable box for URLs of a domain 2018-01-16 17:48:11 +01:00
Raphaël Vinot 19b0cb25f8 up: UI improvments 2017-10-10 11:16:16 +02:00
Raphaël Vinot 629370fc74 Cleanup 2017-10-05 17:38:35 +02:00
Raphaël Vinot 8b353e3e76 Properly use click event 2017-10-04 17:09:00 +02:00
Raphaël Vinot 5102546789 Cleanup, set favicon 2017-10-04 16:39:03 +02:00
Raphaël Vinot 0ac38a0f2c Add tooltip for URLs 2017-10-04 15:13:42 +02:00
Raphaël Vinot 85b8fd2c0a Cleanup and improve tree view 2017-09-29 17:30:01 +02:00
Raphaël Vinot 2b9213eb1f Only import tree.js in the tree view page 2017-09-29 14:48:37 +02:00