CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
2,407 Commits
8 Branches
32 Tags
17 MiB
Commit Graph

730 Commits (e54c580ccef263559964e613f73c6234efe8b6fa)

Author SHA1 Message Date
Raphaël Vinot e213cb5ae8 fix: make mypy happy. 2021-09-03 17:05:26 +02:00
Raphaël Vinot dcfd9cc6a9 new: Re-capture a URL and change parameters. 2021-09-03 16:57:48 +02:00
Raphaël Vinot 7ea37ec617 fix: Avoid exception if capture finishes between two calls. 2021-09-01 16:57:20 +02:00
Raphaël Vinot c09adec333 chg: Improve logging. 2021-09-01 14:08:25 +02:00
Raphaël Vinot 7870e918de chg: Bump datatables 2021-08-30 15:26:50 +02:00
Raphaël Vinot d41b7735dd chg: Improve storage, support both modes. 2021-08-26 15:49:19 +02:00
Raphaël Vinot bf700e7a7b chg: Major refactoring, move capture code to external script. 2021-08-25 13:36:48 +02:00
Raphaël Vinot 81390d5ea0 chg: cleanup in the mail lookyloo class 2021-08-24 18:32:54 +02:00
Raphaël Vinot 725a43cc44 new: Trigger a capture with a GET request from a browser. 
Fix #248
 2021-08-18 10:53:32 +02:00
Raphaël Vinot 48d81815a0 chg: Bump d3js 2021-08-17 12:22:10 +02:00
Raphaël Vinot 021f53716b new: Submit a capture in a HTTP GET request 
Fix #246
 2021-08-17 12:12:23 +02:00
Raphaël Vinot 09a69622c0 fix: urlscan dislikes URLs without scheme. 2021-08-16 11:01:00 +02:00
Raphaël Vinot 9ff2bf8157 fix: avoid exception if submission is missing 2021-08-13 16:24:34 +02:00
Raphaël Vinot 50dbbd6eba new: [API] Trigger modules for a capture 2021-08-13 13:50:26 +02:00
Raphaël Vinot 92a466d78b fix: Improve legend 
Fix #161
 2021-08-12 16:31:53 +02:00
Raphaël Vinot 3436f5bd4e chg: Improve urlscan support, get results. 2021-08-11 15:26:12 +02:00
Raphaël Vinot 7933670941 new: Integration with urlscan.io 2021-08-10 17:38:47 +02:00
Raphaël Vinot 8668a15cd8 chg: use d3js v7 2021-07-21 11:56:38 +02:00
Raphaël Vinot 28e3162187 Merge branch 'restx' 2021-07-21 11:05:25 +02:00
Raphaël Vinot 9f580fc223 chg: Bump datatables 2021-07-14 10:55:52 +02:00
Raphaël Vinot cc2e5a4159 Merge branch 'main' into restx 2021-07-05 09:54:37 +02:00
Raphaël Vinot 6abdd2db9a new: Add referer on details view 2021-06-29 11:18:10 -07:00
felalex 6a7787d8af fix: error in case of invalid proxy + username/password support 2021-06-29 18:00:44 +02:00
felalex 1c89a80c7e fix: expected format & passing proxy in _capture 2021-06-25 16:36:57 +02:00
Raphaël Vinot 26cbf94977 Merge branch 'main' into restx 2021-06-22 16:55:41 -07:00
Raphaël Vinot 20fb7a70f9 new: Add referer on details view 2021-06-22 16:47:03 -07:00
felalex a04d224c79 new: trying toget proxy field from /capture 2021-06-22 18:39:14 +02:00
felalex 046dc4d1d1 new: added field for proxy 2021-06-18 17:12:50 +02:00
Raphaël Vinot 1a9d409d90 Merge branch 'main' into restx 2021-06-17 09:51:57 -07:00
Raphaël Vinot 14a3581fbc chg: Bump 3rd party libs 2021-06-16 18:28:57 -07:00
Raphaël Vinot cd8e76f26b fix: Properly use SRIs 2021-06-16 18:25:40 -07:00
Raphaël Vinot eba913caa0 fix: sort sri dump 2021-06-16 18:21:15 -07:00
Raphaël Vinot c89689374e new: SRI validation on resources 2021-06-16 17:36:01 -07:00
Raphaël Vinot a44b7b30b5 new: Get URLs and Hostnames from captures 2021-06-16 14:57:14 -07:00
Raphaël Vinot 7b32454f9a new: get all the ressources hashes in API 2021-06-15 18:26:41 -07:00
Raphaël Vinot 7053ca7994
Merge branch 'main' into restx 2021-06-11 12:12:59 -07:00
Raphaël Vinot 89026e8f3b chg: move mypy config to pyproject 2021-06-11 10:15:03 -07:00
Raphaël Vinot c52509614e new: get capture info API call 2021-06-09 17:59:24 -07:00
Raphaël Vinot 810cceb263 new: Add more calls to the API, cleanup 2021-06-07 15:37:11 -07:00
Raphaël Vinot e5b76b3a2f chg: Move API into a new file, cleanup 2021-06-07 13:12:23 -07:00
Raphaël Vinot 7bf0b78754 new: Use flask-restx for the API 2021-06-04 17:30:14 -07:00
Raphaël Vinot 387f2d3c3d chg: Improve MISP lookup 2021-06-02 13:27:50 -07:00
Raphaël Vinot 8c62a597e7 fix: Make mypy happy 2021-06-01 16:06:24 -07:00
Raphaël Vinot a1bbffd4ad fix: Missing template for MISP lookup 2021-06-01 15:35:35 -07:00
Raphaël Vinot 3071a1a7c9 new: Add MISP lookup 2021-06-01 15:31:14 -07:00
Raphaël Vinot 53ef253c94 chg: Improve MISP push 2021-05-31 13:27:25 -07:00
Raphaël Vinot 4fd7ee2568 chg: Make parent link more generic 2021-05-27 16:33:17 -07:00
Raphaël Vinot 53bc8324cd new: reference to parent on tree (if exists) 2021-05-27 15:23:04 -07:00
Raphaël Vinot 1117ab6371 chg: add stats, avoid building big trees twice, bump deps 2021-05-26 18:25:06 -07:00
Raphaël Vinot 315a2733c3 new: Tickbox to confirm notification 2021-05-26 12:07:47 -07:00
Raphaël Vinot 8a5b1f263e new: Fake field to avoid dumb bots 2021-05-25 13:20:28 -07:00
Raphaël Vinot 11f05626b5 chg: Improve module auto trigger 2021-05-19 15:03:07 -07:00
Raphaël Vinot 7b4f5bd6d2 new: feature to hide captures with error 2021-05-19 10:18:43 -07:00
Raphaël Vinot 925bb9d48e new: priority for captures 2021-05-18 14:58:56 -07:00
Raphaël Vinot 3614a47275 chg: Make mypy happy 2021-05-17 18:29:46 -07:00
Raphaël Vinot bb214d9e2b chg: Use keywords only paramaters when relevant 2021-05-17 17:08:43 -07:00
Raphaël Vinot 5ee62d157f chg: Properly handle capture parents, avoid duplicates 2021-05-14 14:25:37 -07:00
Raphaël Vinot b735cbeae3 chg: Reorganize styles 2021-05-12 14:13:44 -07:00
Raphaël Vinot 1d5925d755 new: Keep captures parent, use extends in MISP export 2021-05-12 13:30:07 -07:00
Raphaël Vinot a47615fb0a chg: Make mypy happy 2021-05-11 22:09:07 -07:00
Raphaël Vinot c07e3696cd fix: force size of img resources in popup, cleanup 2021-05-11 17:14:28 -07:00
Raphaël Vinot 986e581f5d fix: Move flashed messages around 2021-05-11 10:53:00 -07:00
Raphaël Vinot f5258a9904 fix: Put flashed message below the top menu 2021-05-10 18:28:56 -07:00
Raphaël Vinot 6592531ec1 fix: index search on partial URLs 
Fix #202
 2021-05-06 11:27:40 +02:00
Raphaël Vinot 64d1ed785b fix: Blur cropped screenshot if too big 
Fix #196
 2021-04-28 18:13:10 +02:00
Raphaël Vinot 12697964ce chg: Improve tree stats 2021-04-27 17:09:58 +02:00
Raphaël Vinot 3389dcafd6 new: Add support for uwhoisd 2021-04-26 00:52:08 +02:00
Raphaël Vinot 39e894b7b0 fix: body hash page on direct access 2021-04-20 17:32:22 +02:00
Raphaël Vinot 9952e4de32 fix: remove UA - IP mapping from redis 2021-04-18 17:58:16 +02:00
Raphaël Vinot be1ca8d088 new: Disable FLoC 2021-04-18 01:43:50 +02:00
Raphaël Vinot e8b19969fe chg: normalize capture button 2021-04-09 15:45:20 +02:00
Raphaël Vinot dcc7cd1351 fix: Typos 2021-04-09 14:34:20 +02:00
Raphaël Vinot 7707d638cf new: Use async capture for the UI. 
Add a method to make sure splash is up before trying to capture.
 2021-04-08 19:15:53 +02:00
Raphaël Vinot d78ee5de11 new: Link to UA page on wikipedia 2021-04-08 13:47:58 +02:00
Raphaël Vinot 4d23d7ac36 chg: Remove extra code, return unziped resources 2021-04-08 01:05:11 +02:00
Raphaël Vinot e79387ee0d chg: Remove unused entries in legend and stats 2021-04-08 00:35:10 +02:00
Raphaël Vinot 81acc8e2d5 chg: Improve UI (index and menu) 2021-04-06 23:34:57 +02:00
Raphaël Vinot ca0bd97689 new: Wait page when a capture is queued/ongoing 2021-04-01 18:51:42 +02:00
Raphaël Vinot b6ea1c24db new: Query capture status 2021-03-31 19:25:57 +02:00
Raphaël Vinot 55eab4af9c fix: Disable push button if a MISP event already exists. 2021-03-31 09:25:01 +02:00
Raphaël Vinot a8711a18f1 fix: Make mypy happy 2021-03-30 16:43:57 +02:00
Raphaël Vinot 9f88edd74d new: Check if an event with the same lookyloo capture is already on MISP 
Fix #181
 2021-03-30 16:32:04 +02:00
Raphaël Vinot 094b69f9b9 fix: Make cookie samesite only 2021-03-30 01:10:18 +02:00
Raphaël Vinot a2d6ff7b49 fix: scroll to screenshot, add margin 2021-03-30 00:45:24 +02:00
Raphaël Vinot 88bd450b59 chg: Improve tree page (menu and stats) 2021-03-25 18:32:48 +01:00
Raphaël Vinot 9845f60322 fix: Pass the UA in bulk captures 2021-03-19 22:29:13 +01:00
Raphaël Vinot 2a55461286 new: Capture an URL on the rendered page, keep the session (WiP) 2021-03-19 17:52:20 +01:00
Raphaël Vinot cd7b050cb0 chg: rename and cleanup methods 2021-03-18 18:47:54 +01:00
Raphaël Vinot 25c1a6dbce chg: Use sorted cache whenever possible 2021-03-18 15:39:55 +01:00
Raphaël Vinot a909346fc1 fix: mypy error 2021-03-18 00:50:42 +01:00
Raphaël Vinot 49ae4490b2 new: (hidden) interface to search for hostnames and URLs 2021-03-18 00:40:14 +01:00
Raphaël Vinot aec6fe2632 fix: Make mypy happy 2021-03-04 18:21:36 +01:00
Raphaël Vinot 3ed7608f16 chg: Improve ressources listing 2021-03-04 18:10:54 +01:00
Raphaël Vinot 4488a9a492 fix: do not fail if MISP is not working 2021-02-12 12:06:26 +01:00
Raphaël Vinot b91bbe5f07 new: Show preview of embeded ressources if it is an image. 2021-02-09 22:01:20 +01:00
Raphaël Vinot d711fd3644 fix: Make get legacy user config quiet 2021-02-05 15:24:11 +01:00
Raphaël Vinot 39dd2021dd chg: Complete rework of the login system, add UI for MISP Push 2021-02-04 19:51:43 +01:00
Raphaël Vinot 13e1614f5b chg: Remove download screenshot button from left menu, add in overlay 2021-02-04 14:56:09 +01:00
Raphaël Vinot f7dac21e71 fix: Do not fail if cache_clean_user is gone from config 2021-02-03 12:39:19 +01:00
Raphaël Vinot ddb43d909f new: Lightweight auth and api key system 2021-02-02 22:04:33 +01:00
Raphaël Vinot dca06bd272 chg: Make clear the captures are public by default 
Fix https://github.com/Lookyloo/lookyloo/issues/163
 2021-01-29 16:35:47 +01:00
Raphaël Vinot 36fd3b2afc chg: Rename back to index link 2021-01-29 16:34:59 +01:00
Raphaël Vinot c358c08640 fix: Make mypy happy. 2021-01-28 19:28:54 +01:00
Raphaël Vinot acfb0d1c26 new: Add push to MISP feature 2021-01-28 18:37:47 +01:00
Raphaël Vinot c8cc56f78b chg: Improve support of self generated user-agents 2021-01-20 20:54:37 +01:00
Raphaël Vinot f0c7e42bd9 new: center tree on landing page 2021-01-20 01:28:54 +01:00
Raphaël Vinot 861760203e fix: Card on capture page 2021-01-18 16:57:27 +01:00
Raphaël Vinot 1605c6b6e1 fix: Last try to get the card working 2021-01-18 16:37:17 +01:00
Raphaël Vinot 1da32c404e chg: Better handling of big screenshots 2021-01-18 14:19:19 +01:00
Raphaël Vinot f9d8081efa fix: hidden view 2021-01-18 13:26:02 +01:00
Raphaël Vinot 0a89d2190d fix: OG card on index and capture pages. 2021-01-18 13:04:14 +01:00
Raphaël Vinot 660cebe01d chg: More improvements on the twitter card 2021-01-18 12:50:58 +01:00
Raphaël Vinot 8bd874e2b0 new: Add variable width thumbnail method 2021-01-18 12:30:07 +01:00
Raphaël Vinot 07d0c68b5a fix: twitter card image is special 2021-01-17 13:23:30 +01:00
Raphaël Vinot e0615d9df3 fix: Better card rendering on twitter 2021-01-17 13:13:43 +01:00
Raphaël Vinot 721f5b47bb fix: Use better image for OG card 2021-01-17 12:57:19 +01:00
Raphaël Vinot 05b106f14b fix: Pass public_domain to index 2021-01-17 12:54:16 +01:00
Raphaël Vinot fbd981d543 fix: wrong property key for OG card 2021-01-17 12:49:33 +01:00
Raphaël Vinot 026e0b7269 new: Add OpenGraph cards 2021-01-17 12:41:01 +01:00
Raphaël Vinot 6149df06eb chg: Make the cache entries a dataclass 
Fix #99
 2021-01-14 17:12:23 +01:00
Raphaël Vinot ffc2de3cf2 fix: proper variable name for the thumbnail 2021-01-13 16:59:14 +01:00
Raphaël Vinot d4a2e68ceb chg: Properly rebuild cache 2021-01-13 15:35:29 +01:00
Raphaël Vinot a4e520dac5 chg: Add missing image for too big screenshots 2021-01-13 15:08:51 +01:00
Raphaël Vinot 4686b560dc chg: Better handling of insanely long webpages. 2021-01-13 14:33:20 +01:00
Raphaël Vinot 0d68844c90 chg: Refactoring and documenting 2021-01-12 17:22:51 +01:00
Raphaël Vinot dd30d25683 chg: Add dots on stats graph 2021-01-11 20:01:13 +01:00
Raphaël Vinot 7d182b8f4a chg: cleanup download of urls in rendered content 
fix #148
 2021-01-11 15:19:29 +01:00
Fafner [_KeyZee_] a48a345215
Adding final page title in the details of the tree 2021-01-08 19:36:31 +01:00
Fafner [_KeyZee_] 02ddd35379
Adding final page title in the details of the tree 2021-01-08 19:34:21 +01:00
Raphaël Vinot 33326c2463 new: Extract URLs from rendered pages 2021-01-08 13:03:23 +01:00
Raphaël Vinot d1f33d6914 new: Add ribbons on index 2021-01-04 16:51:04 +01:00
Raphaël Vinot a4a51e50d3 chg: Bump doc link on tree page 2021-01-04 16:16:31 +01:00
Raphaël Vinot c0cb9cb556 fix: Node width in firefox. 2021-01-04 10:39:13 +01:00
Raphaël Vinot c492674194 new: Add tooltips on every icons in the popup 2021-01-01 22:47:34 +01:00
Raphaël Vinot 2fbf5d520f new: Add tooltips to icons in tree 2021-01-01 21:27:08 +01:00
Raphaël Vinot 8a633a6c1c chg: Small cleanup 2020-12-31 19:32:08 +01:00
Raphaël Vinot d198cd3d93 new: Add tooltip for number of URLs in nodes 2020-12-31 19:06:27 +01:00
Raphaël Vinot 9b18370fe1 fix: Properly generate meta keys related to the User Agents 2020-12-22 19:16:46 +01:00
Raphaël Vinot fcae1d42d0 new: Show images in tooltip in hostnode popup 2020-12-22 18:23:39 +01:00
varad dingankar 1d3eb64ab3 #142 Adding documentation link to the menu 2020-12-21 00:44:55 +01:00
Raphaël Vinot 2ca2c07015 chg: Improve tooltip to expand/collapse node 2020-12-16 02:28:12 +01:00
Raphaël Vinot 910a154cf7 fix: Do not overwrite all the modal contents on module re-run 2020-12-15 01:25:04 +01:00
Raphaël Vinot 5a65f472fb fix: Expand the background to cover the last node 2020-12-11 23:21:07 +01:00
Raphaël Vinot fe9e185ec2 fix: Firefox support 2020-12-10 19:23:17 +01:00
Raphaël Vinot 0d2edb8ae3 new: Allow to use user UA for capture 2020-12-10 17:23:37 +01:00
Raphaël Vinot 7e1ce67574 chg: Improve details box 2020-12-10 16:26:37 +01:00
Raphaël Vinot 603303560a chg: shorten_string can return a div with title 2020-12-10 11:56:44 +01:00
Raphaël Vinot ed6a53d211 chg: small visual improvments 2020-12-09 21:08:34 +01:00
Raphaël Vinot 3c6eca3567 new: Add screenshot thumbnail on tree, move links to the end of the node 2020-12-09 19:11:19 +01:00
Raphaël Vinot fbbfa3082d chg: Fix typing 2020-12-07 20:54:33 +01:00
Raphaël Vinot 8eab287721 new: Initial implementation of MISP export 2020-12-07 20:50:46 +01:00
Raphaël Vinot 9b3d338d3c chg: Rename analisys->submission, add unique urls on stats graph 2020-12-07 13:55:03 +01:00
Raphaël Vinot 98ddef5b8b fix: Month starts at 1, not 0 2020-12-07 13:35:26 +01:00
Raphaël Vinot 0a632c966a fix: CSS on stats page 2020-12-07 13:33:14 +01:00
Raphaël Vinot 9f84b26ffe chg: Improve hostnode popup 2020-12-07 13:25:47 +01:00
Raphaël Vinot 48f370f471 chg: make stats graph more generic 2020-12-07 13:25:16 +01:00
Raphaël Vinot 187422b36b chg: Improve margins 2020-12-03 14:15:12 +01:00
Raphaël Vinot e472c4a746 fix: Avoid overlav 1st node by menu, fix very small tree 2020-12-03 13:34:15 +01:00
Raphaël Vinot d353463548 chg: Simplify modules activation 2020-12-03 12:33:35 +01:00
Raphaël Vinot 4e69aa203f fix: Normalize buttons colour (tree/popup) 
Fix #115
 2020-11-30 20:26:59 +01:00
Raphaël Vinot 287fdeb8e6 chg: Disable bookmarks by default 2020-11-29 23:56:42 +01:00
Raphaël Vinot 55ef3ed04d chg: Rename legitimate -> known in the interface 
Related to #118
 2020-11-29 23:38:12 +01:00
Raphaël Vinot 1a7a74cccd chg: Cleanup stats page 2020-11-27 16:27:29 +01:00
Raphaël Vinot 9fe6dfd306 chg: Add CSS for stats 2020-11-27 09:56:39 +01:00
Raphaël Vinot 28ed2b168c chg: Use d3js instead of chart.js 2020-11-26 22:26:22 +01:00
Fafner [_KeyZee_] 1ad1c50540
adding graph for years stats 2020-11-25 20:17:36 +01:00
Fafner [_KeyZee_] 6f6eb6128c
reorganise 'scripts' for the stats 2020-11-25 20:16:18 +01:00
Raphaël Vinot d2bd113ab8 chg: Cleanup on stats page 2020-11-25 15:27:34 +01:00
Fafner [_KeyZee_] 76353f0802
Create stats.html 2020-11-25 12:08:07 +01:00
Fafner [_KeyZee_] 17e7701807
adding a page for stats \o/ 2020-11-25 12:07:01 +01:00
Raphaël Vinot d964549e56 fix: Typing, dump to json 2020-11-24 21:01:30 +01:00
Raphaël Vinot c54d29601d chg: Fix typing 2020-11-24 18:19:53 +01:00
Fafner [_KeyZee_] a172c1f58a
adding a new api entry: stats 2020-11-24 16:46:57 +01:00
Raphaël Vinot a117a91341 new: Add feature to automatically trigger the modules on tree load 2020-11-22 23:23:42 +01:00
Raphaël Vinot 4da27f772d fix: Improve popup error message 2020-11-18 15:03:27 +01:00
Raphaël Vinot 354f269218 new: Integrate categorization in indexing 2020-11-09 16:02:54 +01:00
Raphaël Vinot 8b00cf8801 chg: Document email notigication, disable URL entry points for disabled features 
Fix #121
 2020-11-05 16:08:19 +01:00
Raphaël Vinot 6a4b42bafe fix: display popup alertbox in hostnode view 
Fix #112
 2020-11-04 16:02:14 +01:00
Raphaël Vinot 64fff3ec7f chg: Add icon for insecure requests in legend 
Fix #120
 2020-11-04 14:38:15 +01:00
Raphaël Vinot 2c3cfa31a1 chg: Tooltip on collapse/expand subtree 
Fix #119
 2020-11-04 13:43:38 +01:00
Raphaël Vinot 171cd4ecd2 chg: Pass max depth as parameter in the capture page 
Related to #117
 2020-11-03 19:26:28 +01:00
Raphaël Vinot 5ebaf74d67 chg: Remove underline on capture page 
Related: #117
 2020-11-03 17:29:46 +01:00
Raphaël Vinot 9b6c2b9f42 chg: Make icon on capture page a link to index 
Related: #117
 2020-11-03 17:16:43 +01:00
Raphaël Vinot 6e3f051752 chg: Rename flag => bookmark 
Related: #118

Fix: #114
 2020-11-03 17:14:14 +01:00
Raphaël Vinot 99c939fd7f chg: Rename scrape -> capture everywhere 
Related to #118
 2020-11-03 16:34:52 +01:00
Raphaël Vinot 903c071654 chg: Add index button, tooltips 
Fix #110
 2020-11-03 12:54:42 +01:00
Raphaël Vinot 5f4a97e11b fix: Typing meta 2020-10-29 14:19:17 +01:00
Raphaël Vinot da85aa0fb7 fix: Pre-sort entries on index 2020-10-29 13:29:13 +01:00
Raphaël Vinot 6d66bb858b chg: Bump deps 2020-10-29 12:21:31 +01:00
Raphaël Vinot 2802cfd46c new: Add captures categorization 2020-10-28 18:49:15 +01:00
Raphaël Vinot 068c92d5a4 new: API to query hostnames 2020-10-27 01:42:00 +01:00
Raphaël Vinot 39f88e9121 new: API to query URLs 2020-10-27 00:02:18 +01:00
Raphaël Vinot bdc0488e38 new: Hash lookup method 2020-10-23 20:51:15 +02:00
Raphaël Vinot 34deb24afc fix: broken container css class 2020-10-21 16:25:31 +02:00
Raphaël Vinot 13c051e5ce fix: in some cases, container class was overlapping the tree 2020-10-21 12:40:45 +02:00
Raphaël Vinot fa56a3e1f0 chg: Cleanup UI, bump deps 2020-10-21 12:22:50 +02:00
Raphaël Vinot 4f52804361 chg: Make new version of mypy happy 2020-10-12 12:15:07 +02:00
Raphaël Vinot 90a9ff9bb5 chg: Refactoring, add get_hashes 2020-10-09 18:05:25 +02:00
Raphaël Vinot be2cd18d2b chg: Cleanup mypy config 2020-10-01 11:48:00 +02:00
Raphaël Vinot 9ce06b8821 chg: Add resolved IP on hostnode page 2020-09-29 14:24:18 +02:00
Raphaël Vinot e28a7d041c chg: Bump to d3js v6 2020-09-28 15:28:47 +02:00
Raphaël Vinot 26cb2f1d53 chg: make 3rd party dl a python script 2020-09-28 13:57:21 +02:00
Raphaël Vinot d33698357c new: Update script. 2020-09-28 13:32:19 +02:00
Raphaël Vinot 542d6477f9 chg: Add missing js 2020-09-25 19:02:40 +02:00
Raphaël Vinot ef6eb1c253 new: Initial support for CNAME lookups 2020-09-25 17:23:10 +02:00
Raphaël Vinot b0d761df8e chg: Remove FileSaver.js from the deps, bump datatables 2020-09-22 13:00:28 +02:00
Raphaël Vinot 7a34095d9c new: Config option for Flask IP and Port, reorganize config loading 2020-09-21 16:41:30 +02:00
Raphaël Vinot 09a4ccd62e fix: require login when marking a whole tree as legitimate 2020-09-15 01:38:20 +02:00
Raphaël Vinot 99da54f66a chg: Improve message for known malicious entries, add known file 2020-09-14 14:12:22 +02:00
Fafner [_KeyZee_] 00d9fd8db7
Update tree.html 2020-09-10 14:37:42 +02:00
Raphaël Vinot b06f02e101 new: Expose rendered content on hostnode page 2020-09-09 15:04:21 +02:00
Raphaël Vinot 2b237a7416 new: Use rendered HTML 2020-09-08 19:18:55 +02:00
Raphaël Vinot 457829a23f chg: cleanup and improve views 2020-09-04 18:40:51 +02:00
Raphaël Vinot 9f4c77d5d2 chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
Raphaël Vinot 407a9a5511 new: Download ressource from ressources page 2020-09-03 14:39:38 +02:00
Raphaël Vinot 1e1a0ae7c9 fix: remove mark as legitimate if disabled 2020-09-01 18:49:11 +02:00
Raphaël Vinot 370fda48e2 chg: disable mark capture as legitimate on public instance 2020-09-01 18:37:49 +02:00
Raphaël Vinot b16a5768ea chg: Refactoring and normalizing the known hashes lookups 2020-09-01 17:33:36 +02:00
Raphaël Vinot 70b2bbe2b7 fix: Add missing files 2020-09-01 17:32:17 +02:00
Raphaël Vinot 8f242549fc chg: Allow to disable user context form 2020-08-31 16:34:28 +02:00
Raphaël Vinot 4a9a50e289 chg: Add icon for hostnodes with empty content. 2020-08-31 15:21:41 +02:00
Raphaël Vinot a5c210a5de new: Add checkmark for legitimate nodes. 2020-08-28 19:11:19 +02:00
Raphaël Vinot 99550f439e fix: Typing 2020-08-28 18:26:47 +02:00
Raphaël Vinot 6866b49c87 chg: Add support for legitimate content context 2020-08-28 18:24:14 +02:00
Raphaël Vinot 97b5b2d77f chg: Working prototype for user-defined context 2020-08-28 18:03:52 +02:00
Raphaël Vinot 60b767d08f chg: Normalize ressources details display, refactoring 2020-08-27 12:57:10 +02:00
Raphaël Vinot 1b0cdde84e chg: Normalize known content lookup 2020-08-25 18:00:16 +02:00
Raphaël Vinot c75b9e65fe chg: Remove known content from SaneJS module 2020-08-25 15:51:08 +02:00
Raphaël Vinot de0be61e68 chg: WiP form to add context to responses. 2020-08-24 20:08:14 +02:00
Raphaël Vinot bdb726ca9e new: Add malicious listing on hostnode 2020-08-24 15:31:53 +02:00
Raphaël Vinot c5aabcf4a3 new: Initial commit to mark body responses as legitimate/malicious 2020-08-20 19:39:03 +02:00
Raphaël Vinot fa57435433 chg: Sanity check in email send 2020-08-20 15:05:27 +02:00
Raphaël Vinot b6c6c7756e new: Optionally blur screenshots by default (public instances) 2020-08-13 15:56:46 +02:00
Raphaël Vinot 5e6e784ee5 chg: moar cleanup 2020-08-12 20:09:40 +02:00
Raphaël Vinot 022d7a8612 fix: rendering on firefox 2020-08-12 13:59:40 +02:00
Raphaël Vinot b5d56a5a2b chg: refactoring of the tree 2020-08-11 19:17:39 +02:00
Raphaël Vinot aef5658e5d chg: Make the lists of other captures a table 2020-08-10 15:42:26 +02:00
Raphaël Vinot 2873773ee7 new: trigger to hide a capture from the front page (admin only) 2020-08-10 12:35:16 +02:00
Raphaël Vinot d3fc553ab0 chg: Filter user_agent from meta file 2020-08-10 12:10:13 +02:00
Raphaël Vinot 55d08e7675 fix: Properly highlight node across captures 2020-08-08 19:09:34 +02:00
Raphaël Vinot db8e79677e chg: Open related tree in new tab. 2020-08-07 18:01:06 +02:00
Raphaël Vinot ed8ad7b945 new: Waiting messages on scraping page. 2020-08-07 17:06:25 +02:00
Raphaël Vinot 8ebc071b71 chg: back buttons, more tooltips 2020-08-07 15:14:13 +02:00
Raphaël Vinot b85c2b85a3 chg: Add status code description 2020-08-07 13:11:16 +02:00
Raphaël Vinot c949320aa6 new: Add link to download redirects on tree page 2020-08-07 11:58:20 +02:00
Raphaël Vinot 8c53663418 chg: Tooltips everywhere 2020-08-06 17:47:39 +02:00
Raphaël Vinot 5e2a5cf993 chg: Improve notification of insecure content 2020-08-06 17:24:06 +02:00
Raphaël Vinot 21d7d141dd chg: display (un)lock on tree page 2020-08-05 13:54:16 +02:00
Raphaël Vinot 4bf0b1ac9c chg: make minimal height bigger 2020-08-04 17:27:33 +02:00
Raphaël Vinot a85feeebdf new: Glowing arrow to locate node on tree 2020-08-04 16:18:42 +02:00
Raphaël Vinot e1898616c6 chg: Reorganize tree view 2020-07-30 17:45:07 +02:00
Raphaël Vinot b62495be86 chg: Allow to hilight the redirect from a popup 2020-07-29 18:43:41 +02:00
Raphaël Vinot 0fe3826040 fix: Do not hide lookyloo icon 2020-07-29 17:52:11 +02:00
Raphaël Vinot 90843eb8dc new: Initial display of redirect on popup page 2020-07-29 14:00:46 +02:00
Raphaël Vinot c653472ab2 chg: Improve rendering menu 2020-07-29 13:39:01 +02:00
Raphaël Vinot fca85530d5 chg: cleanup minimised menus 2020-07-29 13:35:43 +02:00
Raphaël Vinot fcec79519f new: Add unflag all, cleanup. 2020-07-28 18:26:07 +02:00
Raphaël Vinot 38e4475b94 chg: Make a menu 2020-07-27 18:37:26 +02:00
Raphaël Vinot 121e4b3ebf new: Add flag/unflag button for nodes on tree 2020-07-24 17:50:22 +02:00
Raphaël Vinot 32c41814b1 new: WiP feature: flag a node on the tree. 2020-07-23 17:47:12 +02:00
Raphaël Vinot 1ca8bc168c chg: pretty print json when possible. 2020-07-23 16:09:49 +02:00
Raphaël Vinot 09d04e0835 chg: More UI fixes 2020-07-17 18:39:50 +02:00
Raphaël Vinot b4e5d1be08 chg: Fix a bunch of views, make icons clickable. 2020-07-16 01:08:39 +02:00
Raphaël Vinot c7db7829a7 chg: More macros 2020-07-15 18:04:34 +02:00
Raphaël Vinot 419fe7408b chg: Make icon list in popup a macro 2020-07-15 13:52:22 +02:00
Raphaël Vinot 0468317a20 chg: Improve rendering, bump deps. 2020-07-15 01:35:55 +02:00
Raphaël Vinot c5378c76dd chg: Make the cookies visualization a macro 2020-07-12 14:59:01 +02:00
Raphaël Vinot ef93734ded chg: make macros, deduplicate template 2020-07-12 01:56:29 +02:00
Raphaël Vinot 89725b8ed0 new: Download embedded resource 2020-07-11 02:10:56 +02:00
Raphaël Vinot e5e4e4972e new: Add visualisation for embedded resources. 2020-07-10 18:57:16 +02:00
Raphaël Vinot 23419a31b9 fix: cleanup 2020-07-08 15:52:26 +02:00
Raphaël Vinot c20dd170e0 fix: Proper description in popup 2020-07-08 15:51:45 +02:00
Raphaël Vinot 4851436999 chg: More improvements in body hash display 2020-07-08 15:51:45 +02:00
Raphaël Vinot bfa39223c8 chg: Improve hash lookup rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 34a5dff055 chg: Refactoring, use capture UUID insted of path as reference for public methods 2020-07-08 15:51:45 +02:00
Raphaël Vinot a4bc2b2818 new: Improve hostnode popup, center tree on node 2020-07-08 15:51:45 +02:00
Raphaël Vinot 29c78d3485 chg: Cleanup and improve index rendering 2020-07-08 15:51:45 +02:00
Raphaël Vinot 7772706262 new: Display body hashes matches on hostnode page 2020-07-08 15:51:01 +02:00
Raphaël Vinot 6bb26c4358 new: Initial support for body hashes index 2020-07-08 15:51:01 +02:00
Raphaël Vinot cfec5d8d37 new: Add cookies templates 2020-07-08 15:51:01 +02:00
Raphaël Vinot e6c9f6dada new: Add capture meta on the related cookies page 2020-07-08 15:42:13 +02:00
Raphaël Vinot 5ae7f0f7e4 new: Initial version of cookies indexing 2020-07-08 15:42:13 +02:00
Raphaël Vinot d18f5f4f88 fix: Docker, capture form, error message. 2020-07-08 02:25:15 +02:00
Raphaël Vinot 33fb74ae83 new: Add referer to initial URL 2020-07-08 00:37:29 +02:00
Raphaël Vinot 760b479059 fix: Skip buggy captures on index 2020-07-06 15:45:29 +02:00
Raphaël Vinot 1d77a2001e chg: Bump deps, improve error handling 2020-07-03 18:25:16 +02:00
Raphaël Vinot 05de56022f chg: Use capture UUID as a reference everywhere 2020-06-29 12:01:31 +02:00
Raphaël Vinot fa935a6773 new: Add query for redirects in client 2020-06-26 18:11:22 +02:00
Raphaël Vinot ee29a638dd new: API Endpoint - redirects 2020-06-26 12:07:25 +02:00
Raphaël Vinot c81a0c7438 fix: Log real IP if the header is given by the reverse proxy 2020-06-26 10:54:35 +02:00
Raphaël Vinot 98495c40a9 chg: Make mypy happy 2020-06-25 17:08:11 +02:00
Raphaël Vinot cde3d29892 new: Add option to use User agents of the Lookyloo users for scraping 2020-06-25 16:43:58 +02:00
Raphaël Vinot 1c408af3b0 chg: Improve cookies in hostnode view 2020-06-11 15:13:31 +02:00
Raphaël Vinot 285a0cf727 new: Phishing Initiative module 2020-06-09 15:06:35 +02:00
Raphaël Vinot 0751321e9b new: Cookies investigation 2020-06-04 18:23:36 +02:00
Raphaël Vinot 6fe7d44782 chg: Display 3rd party cookie in popup 2020-05-28 17:33:43 +02:00
Raphaël Vinot 5ebb35c161 new: Add redirects in notifications, optional reply-to 2020-05-27 15:15:45 +02:00
Raphaël Vinot ccad142dd0 chg: Improve hostname popup 2020-05-27 12:38:25 +02:00
Raphaël Vinot 3a3be0cb46 new: Add handles for cookies 2020-05-26 17:45:04 +02:00
Raphaël Vinot e29f2d93af chg: Fix typing 2020-05-25 15:39:12 +02:00
Raphaël Vinot 806c738fcd fix: Do not fail if sanejs isn't enabled 2020-05-25 15:13:09 +02:00
Raphaël Vinot 0876117e90 chg: UI improvement, support sanejs not configured 2020-05-25 14:42:13 +02:00
Raphaël Vinot 876352c2f7 chg: Improve pop-up, cleanup old code. 2020-05-23 03:37:24 +02:00
Raphaël Vinot d04db67d2d Improve hostname popup 2020-05-22 17:36:22 +02:00
Raphaël Vinot 83aef5d680 chg: Fix typing 2020-05-21 23:46:35 +02:00
Raphaël Vinot 3b631f2c92 chg: Improve popup, remove session. 2020-05-20 19:11:15 +02:00
Raphaël Vinot c3bf87beca chg: Improve popup, make sanejs a module, cache 2020-05-19 17:47:55 +02:00
Raphaël Vinot 72afeb5f81 new: WiP - hostname details in popup 2020-05-18 18:35:20 +02:00
Raphaël Vinot 466cb5fcd5 chg: Improve typing 2020-05-18 18:32:59 +02:00
Raphaël Vinot d3971cc47c new: Add stats 2020-05-13 17:31:27 +02:00
Raphaël Vinot cd972076b5 new: Add url to do a full export, and get the page 2020-05-12 16:53:10 +02:00
Raphaël Vinot 6781d5f02e fix: Comment in send mail form 2020-05-11 19:58:46 +02:00
Raphaël Vinot 754ae9354d new: Add email notification feature 2020-05-11 19:01:06 +02:00
Raphaël Vinot a42ec8f6b9 fix: [JS crap] date.getMonth() starts at 0 ¯\_(ツ)_/¯ 2020-04-29 23:59:42 +02:00
Raphaël Vinot 1593e1234b new: Alternative index to see the hidden captures. 2020-04-23 00:12:10 +02:00
Raphaël Vinot 95532530f7 chg: Make mypy happy 2020-04-22 15:54:02 +02:00
Raphaël Vinot ccd73c302a chg: Properly handle proxied setups 2020-04-22 14:58:01 +02:00
Raphaël Vinot 5d07723809 new: Make it possible to strip older captures from the index 2020-04-22 12:03:10 +02:00
Raphaël Vinot ae49fd2c11 new: Add support to pass more parameters via the API 2020-04-21 18:41:57 +02:00
Raphaël Vinot b387e989a5 fix: Missing template 2020-04-20 17:26:19 +02:00
Raphaël Vinot a0c906d3dc new: Initial view for 3rd party modules 2020-04-20 16:41:42 +02:00
Raphaël Vinot 956baef4ae fix: Properly sort the captures even when the system locale could be better. 2020-04-08 14:17:38 +02:00
Raphaël Vinot 178f14a44a chg: Display time using browser locale 
Fix #70
 2020-04-08 12:04:37 +02:00
Raphaël Vinot de7f50c3b0 chg: Improve logging 2020-04-03 17:51:58 +02:00
Raphaël Vinot 2092038a69 new: Add pagination on index 
Use datatables instead of bootstrap-table
 2020-04-02 17:37:30 +02:00
Raphaël Vinot 1c2cdad38b new: Allow admin to rebuild cache 2020-04-01 17:44:06 +02:00
Raphaël Vinot 17c3473d95 new: Add config files, initial support for 3rd party modules 2020-03-31 14:12:57 +02:00
Raphaël Vinot 949ad58667 chg: Refactoring of the redirects, rename report -> capture 2020-03-26 01:56:24 +01:00
Raphaël Vinot f26a02ef86 new: Add link redirects on index 2020-03-23 12:45:57 +01:00
Olivier Ferrand 506d51f4f5 adding link to / on the logo in tree view 2020-03-19 13:49:58 +01:00
Raphaël Vinot 928c17db50 chg: Bump bootstrap table 2020-03-17 23:40:54 +01:00
Raphaël Vinot 9aa995092e chg: Improve error notification 2020-03-17 15:27:04 +01:00
Raphaël Vinot af98c2b075 chg: Better handling of error messages, display them. 2020-03-17 14:17:18 +01:00
Raphaël Vinot fcdbad4a3c fix: Properly handle long URLs 2020-02-10 18:09:40 +01:00
Raphaël Vinot 8cc4194565 chg: Add title to see URLs on mouse hover 
Bump dependencies
 2020-02-10 11:21:23 +01:00
Raphaël Vinot bc1b1f6787 chg: Improve index, move things around. 2020-02-10 01:55:09 +01:00
Raphaël Vinot 6fbc6f6ead chg: Make table responsive 2020-02-06 17:25:21 +01:00
Raphaël Vinot 62ff47c3f1 chg: Improve redirects on index 2020-02-04 19:15:44 +01:00
Raphaël Vinot 4234e44470 new: Add initial redirects columns 2020-02-03 22:25:48 +01:00
Raphaël Vinot 89edef68ab new: Improve index 2020-02-03 18:30:41 +01:00
Raphaël Vinot c9cbf27acc chg: Fix typing 2020-01-24 11:25:53 +01:00
Raphaël Vinot f1309ce5e3 new: Upload optional cookie file 2020-01-24 10:17:41 +01:00
Raphaël Vinot 0aaa814224 new: Initial commit for cookies tracking. No update on the view yet. 2020-01-10 17:28:15 +01:00
Raphaël Vinot 662bca6ed0 fix: Properly display icons in URL view 2020-01-06 19:28:48 +01:00
Raphaël Vinot dec6920cb8 chg: Add typing 2020-01-06 15:32:38 +01:00
Raphaël Vinot 5cfe5306b2 fix: Skip UA fetch on cloudflare website until the lib is updated 2019-12-17 14:29:58 +01:00
Raphaël Vinot cfa300082f fix: docker-compose should now work. 2019-11-01 21:05:08 -07:00
Raphaël Vinot ba26056c6b chg: Bump dependencies 2019-10-01 13:16:40 -07:00
Raphaël Vinot a6693535de fix: Allow to disable scraping private IPs. 2019-07-05 16:27:23 +02:00
Raphaël Vinot 07d1636fdf fix: Properly pass OS, Browser, and User-Agent when scraping. 2019-07-05 15:44:52 +02:00
Raphaël Vinot 1af2aa88fa chg: Slight refactoring of the HTML views 2019-06-28 12:08:35 +02:00
Raphaël Vinot 957fc15e12 fix: Scrape page refactoring 
Related #47
 2019-06-28 11:59:39 +02:00
Raphaël Vinot 96d0723b17 chg: Improve scraping page 
Related: #47
 2019-06-27 17:47:25 +02:00
Raphaël Vinot 2a91111ac0 fix: Make orphan.url node non-clickable. 
Fix #32
 2019-06-27 16:15:53 +02:00
Raphaël Vinot 60d9038078 new: Mark all nodes with HTTP content 2019-06-25 16:49:15 +02:00
Raphaël Vinot 9fdd0d5782 new: Add warning when a node has mixed content. 2019-06-19 14:23:12 +01:00
Raphaël Vinot 92e4eecd08 chg: Make the icon list dynamic 2019-05-22 12:27:20 +02:00
Raphaël Vinot cde04c468f fix: Re-enable URL details view 2019-05-17 16:59:56 +02:00
Raphaël Vinot 05aaa48cc9 chg: Avoid overlap of node details rectangle 2019-05-15 22:16:53 +02:00
Raphaël Vinot bf506b3f87 chg: Add square around nodes data 2019-05-15 18:10:07 +02:00
Raphaël Vinot 296432a096 chg: Step1 - use join pattern to build tree 2019-05-15 12:14:40 +02:00
Raphaël Vinot 2e60c3a95f fix: Page title was wrong 2019-05-02 15:31:25 +02:00
Raphaël Vinot d32395405a chg: Bump dependencies 2019-04-24 11:47:26 +02:00
Raphaël Vinot 046ac71ab6 chg: Unify the views 2019-04-19 15:53:50 +02:00
Raphaël Vinot 974c501865 new: Improve view of metainfo 2019-04-19 14:41:04 +02:00
Raphaël Vinot f7ff6551c6 chg: move to bootstrap4, toggle legend 2019-04-18 17:34:36 +02:00
Raphaël Vinot 66545c26a5 new: keep track of metadata about OS and Browser when scraping 2019-04-07 23:54:16 +02:00
Raphaël Vinot e057f5b45f fix: Broken call to the error page 2019-04-05 14:05:54 +02:00
Raphaël Vinot 35f4292ab0 fix: Systemd service, add proper stop script 2019-04-05 14:01:36 +02:00
Raphaël Vinot 346f2d6ec3 fix: Properly pass the UA to splash 2019-04-02 23:05:31 +02:00
Raphaël Vinot 36c856ef9b new: Add initial support for user-agent 2019-03-29 20:11:44 +01:00
Raphaël Vinot fdcc566e05 chg: Slight cleanup 2019-02-18 14:29:15 +01:00
Raphaël Vinot 747ce7e52d Merge branch 'anonyme' of https://github.com/Th4nat0s/lookyloo into Th4nat0s-anonyme 2019-02-18 13:53:04 +01:00
Raphaël Vinot 9f2b7f7b93 new: Add error page 2019-02-18 13:52:48 +01:00
Th4nat0s 8afcc30840 clarifie index enable/disable 2019-02-17 21:45:23 +00:00
thanat0s f029b5d324 Add noindex button 2019-02-17 17:43:25 +00:00
Raphaël Vinot 852fb708f6 new: Add a thumbnail 2019-02-06 18:01:17 +01:00
Raphaël Vinot 189b78e20f chg: pre-load the existing reports 2019-02-01 16:11:16 +01:00
Raphaël Vinot 608d8816a8 chg: Start the whole thing 2019-01-30 16:01:55 +01:00
Raphaël Vinot 1d244ef456 chg: Refactor code organisation 2019-01-30 14:30:01 +01:00