CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
2,370 Commits
10 Branches
33 Tags
22 MiB
Commit Graph

344 Commits (7ea1caf19d051a3ee2784a0ef1435fc27cc633b7)

Author SHA1 Message Date
Raphaël Vinot 4153138644 new: Add favicons in indexer 2024-02-19 16:15:52 +01:00
Raphaël Vinot c67f01c775 chg: Improve strict typing 2024-01-26 15:03:36 +01:00
Raphaël Vinot bd6a0f2d22 chg: cleanup with annotations 2024-01-13 01:45:45 +01:00
Raphaël Vinot ee1ad48b25 chg: Use new annotations 2024-01-12 17:15:41 +01:00
Raphaël Vinot 4668298943 new: CIRCL Passive DNS module 2023-12-12 16:19:01 +01:00
Raphaël Vinot a198af8690 fix: set tz only when needed 2023-11-22 14:50:43 +01:00
Raphaël Vinot 7536bbb7f2 fix: Properly initialize Lookyloo once/process 2023-11-07 16:10:47 +01:00
Raphaël Vinot a4c643cc16 fix: Do not initialize the Lookyloo class multiple times 2023-11-07 13:49:32 +01:00
Raphaël Vinot 6034d10834 new: (WiP) Add support for multiple MISPs 2023-08-29 14:03:01 +02:00
Raphaël Vinot 206e5957b5 new: Support for favicons fetching and display 
Related https://github.com/Lookyloo/PlaywrightCapture/issues/45
 2023-08-09 16:50:33 +02:00
Raphaël Vinot 4be8186cc6 chg: Improve readability of the background indexer 2023-07-30 16:59:41 +02:00
Raphaël Vinot c0f601e5db chg: remove incomplete_redirects from cache, was always 0/False 2023-07-28 14:05:28 +02:00
Raphaël Vinot ea2ded9beb fix: properly handle missing title in cache 2023-07-27 15:21:06 +02:00
Raphaël Vinot 0604ccfdee new: Improve the HHH details page 2023-07-24 14:53:00 +02:00
Raphaël Vinot 177474e874 new: Basic support for HHHash 2023-07-21 15:48:20 +02:00
Raphaël Vinot ff4faa8ec1 fix: avoid exceptions when the width of the thumbnail is not an int 2023-06-26 15:26:41 +02:00
Raphaël Vinot 0505edff0e new: Global proxy setting. 
Overwrites any proxy given by the user. Still uses the tor proxy when
needed.

Related: https://github.com/Lookyloo/lookyloo/issues/318
 2023-06-13 12:07:26 +02:00
Raphaël Vinot 4ff9b7651d new: Support for TZ, Geo, locale, color scheme 2023-06-07 15:05:40 +02:00
Raphaël Vinot 95f05a3da1 new: Display proxy if passed to the CaptureSettings 
Fix #695
 2023-05-15 16:33:49 +02:00
Raphaël Vinot 582b5956e9 new: Store capture settings, use TypedDict whenever possible. 2023-05-15 16:08:19 +02:00
Raphaël Vinot 1603c99d5e new: Support for notification in monitoring form 2023-05-11 16:04:11 +02:00
Raphaël Vinot 134ccf1acf new: Submit any file to Pandora (if available) 
Fix proposal for #670
 2023-04-26 15:40:38 +02:00
Raphaël Vinot 854a045cba new: Modal for admin tasks. 2023-03-29 15:15:17 +02:00
Raphaël Vinot f46a8ae841 fix: properly wrap file responses when called on broken captures 2023-03-17 11:10:01 +01:00
Raphaël Vinot 260ca14b70 fix: Avoid stacktrace on partially broken capture. 2023-03-16 16:47:37 +01:00
Raphaël Vinot e410b7631e fix: no decoding in archiver, catch exception when requesting hashes on broken capture 2023-03-16 14:47:24 +01:00
Raphaël Vinot 7a96ae9767 new: Fetch the exiting collection names from the monitoring interface 2023-03-02 20:51:46 +01:00
Raphaël Vinot b25fc09a72 chg: Bump version, deps, make mypy happy 2023-02-28 17:30:12 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot f5c1c14c4d fix: Properly handle the optional responses 2023-02-23 18:47:16 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 6e4bf72184 chg: Bump deps 2023-02-16 16:11:03 +01:00
Raphaël Vinot f8aee07251 fix: Remove more print 2022-12-27 01:58:47 +01:00
Raphaël Vinot 1abd97f37a new: switch to return emails only on whois query 2022-12-26 23:01:44 +01:00
Raphaël Vinot 0a9003f58e chg: Use cache whenever possible 2022-12-08 11:57:45 +01:00
Raphaël Vinot 8083c8cabc fix: Major improvement in index display when you break the cache... 2022-12-07 21:05:27 +01:00
Raphaël Vinot 3e7f1c3de9 chg: use cache instead of get_info everywhere. 2022-12-07 14:32:13 +01:00
Raphaël Vinot 6871c36848 fix: Skip urlhaus module if no reports 2022-12-05 18:22:47 +01:00
Raphaël Vinot af9515c123 new: URL Haus module 
Related: #505
 2022-11-30 18:38:41 +01:00
Raphaël Vinot 56ed06eb84 new: Show error message in bulk capture 2022-11-29 15:30:16 +01:00
Raphaël Vinot 3e3eebaf4a new: Proper logging for website too. 2022-11-23 16:24:51 +01:00
Raphaël Vinot 00370291ac new: Logging config in file 2022-11-23 15:54:22 +01:00
Raphaël Vinot c006d53d5d new: More complete submit capture page, use bootstrap 5.2. 2022-11-21 15:02:12 +01:00
Raphaël Vinot 3c1cbd6ece new: Very basic page to submit an existing capture via a HAR file 2022-11-19 01:32:17 +01:00
Raphaël Vinot efa94cc3eb fix: Issue with flask upgrade 2022-11-02 12:23:41 +01:00
Raphaël Vinot f886b8676b fix: More exceptions catching for the the new caching method 2022-09-26 20:55:16 +02:00
Raphaël Vinot 159d444b20 fix: Avoid exception on broken captures 2022-09-26 20:50:42 +02:00
Raphaël Vinot 31261e84c2 fix: Better handling of half broken captures without HAR files 2022-09-26 14:58:30 +02:00
Raphaël Vinot d38b612c37 chg: Bump lacuscore 2022-09-23 13:13:09 +02:00
Raphaël Vinot c6464936fc chg: Bump to poetry v1.2, remove dep on setuptools 2022-08-31 16:33:13 +02:00
Raphaël Vinot f4dfa0343e new: Submit to Pandora button for file URLs 2022-08-23 17:48:36 +02:00
Raphaël Vinot ebbe6e3ce9 new: Pick mobile devices on capture page 2022-08-22 17:34:00 +02:00
Raphaël Vinot d63ea473f5 new: Autoselect browser engine based on the UA 2022-08-19 14:26:22 +02:00
Raphaël Vinot 87be90af83 fix: Avoid exceptions on invalid requests 2022-08-14 16:41:37 +02:00
Raphaël Vinot 72c4e43474 new: Upload a file instead of submitting a URL. 2022-08-14 16:41:34 +02:00
Raphaël Vinot 2ce8b5a96c new: dropdown to pass DoNotTrack HTTP header 
Improvments on the capture page.
 2022-08-14 16:31:51 +02:00
Raphaël Vinot fdfa2e25cb new: Initial listing of all resources loaded on the capture 2022-08-14 16:31:49 +02:00
Arhamyss c589933a40 fix: changed the way things are displayed and fixed errors to make the download working 2022-08-10 11:40:11 +02:00
Arhamyss 5a77044530 new: first try to add an url in the hostnode to dl the file if there is one to be downloaded 2022-08-09 18:23:11 +02:00
Raphaël Vinot b8cd1319a5 fix: Speedup display of hostnode popup 2022-07-27 14:36:56 +02:00
Raphaël Vinot ce8eeda9eb chg: Improve RiskIQ module 2022-07-18 13:24:20 +02:00
Raphaël Vinot c0bde711d2 new: Very basic RiskIQ support for PDNS. 2022-07-15 18:53:49 +02:00
Raphaël Vinot 81f10c7cb8 new: config key to display a link to the github page 2022-07-12 10:24:10 +02:00
Raphaël Vinot ce9ecfefdb chg: remove reference to max depth (not used since playwright), cleanup 2022-06-11 14:49:58 +02:00
Raphaël Vinot 6ba019ec83 chg: Improve somewhat the useragents available for capturing 
Fix #416
 2022-06-09 18:58:17 +02:00
Raphaël Vinot c60da37707 fix: properly display warning if a capture failed 2022-05-25 16:04:23 +02:00
Raphaël Vinot e4a2b0752c chg: dirty improve default UA 2022-05-05 16:30:52 +02:00
Raphaël Vinot 8d159ffba0 new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
Raphaël Vinot cf46dde1ed chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Raphaël Vinot ee69e66750 new: Multiple queries at once on web interface 2022-03-31 00:48:58 +02:00
Raphaël Vinot 787258dec1 chg: Bump bootstrap-flask, use bootstrap 5 2022-01-14 15:58:06 +01:00
Raphaël Vinot f8ed5567fa new: Link to changelog on index 2022-01-03 17:04:10 +01:00
Raphaël Vinot e291fc6167 chg: avoid duplicate URLs in hashlookup view 2021-12-01 17:03:36 +01:00
Raphaël Vinot fc4c342316 new: Add stats on hits on hashlookup 2021-11-30 15:43:42 +01:00
Raphaël Vinot 8f4040b806 new: Hashlookup integration 2021-11-30 14:59:48 +01:00
Raphaël Vinot 26948ed025 new: free text for UA, change order on capture page 2021-11-25 19:36:01 -05:00
Raphaël Vinot 58b50f2b24 new: Pass optional arbitrary HTTP headers to capture 2021-11-23 12:59:56 -08:00
Raphaël Vinot 4042ee9116 new: Add CORS config to submit 2021-11-08 16:47:39 -08:00
Raphaël Vinot b4771f63a7 new: config option to make capture private by default, better working on capture page 
Related #279
 2021-10-26 10:47:06 -04:00
Raphaël Vinot 9c9e26dde5 chg: Improve capture page 
Related to #279
 2021-10-25 17:19:58 -04:00
Raphaël Vinot 1f998b457f chg: use template 2021-10-18 13:06:43 +02:00
Raphaël Vinot 1a0fe677ab fix: Copy bodies before sending them over. 
send_file in flask close the BytesIO, causing issue if we need to
re-access it.
 2021-09-29 15:00:10 +02:00
Raphaël Vinot 6e9e3990c4 fix: Indexes not updated on tree rebuild, better handling of tree cache 2021-09-24 16:16:41 +02:00
Raphaël Vinot 48fc807e7d new: Add monitoring for pickle cache status 2021-09-24 12:02:28 +02:00
Raphaël Vinot 87c6925c7b new: IPs lookup against phishtank 2021-09-23 13:58:40 +02:00
Raphaël Vinot 404f9a3112 fix: Avoid exception if none key 2021-09-17 10:06:59 +02:00
Raphaël Vinot e7d9c1cb1a fix: return error message if urlscan isn't able to run the capture. 2021-09-17 09:51:52 +02:00
Raphaël Vinot cefb3fddbf new: Phishtank lookup. 2021-09-16 16:33:44 +02:00
Raphaël Vinot 39c7d14264 fix: make mypy happy 2021-09-08 12:50:56 +02:00
Raphaël Vinot cc4beeef35 fix: Pass listing (y/n) and proper referer to subsequent captures 2021-09-08 12:24:00 +02:00
Raphaël Vinot 902c8f81b6 chg: Improve error message if the capture fails 
Fix #257
 2021-09-07 18:16:01 +02:00
Raphaël Vinot dfbe40a52e chg: reorder imports 2021-09-07 16:00:07 +02:00
Raphaël Vinot 60f4a09d28 fix: Avoid "None" in URL field if no predefined URL is given. 2021-09-03 17:07:48 +02:00
Raphaël Vinot e213cb5ae8 fix: make mypy happy. 2021-09-03 17:05:26 +02:00
Raphaël Vinot dcfd9cc6a9 new: Re-capture a URL and change parameters. 2021-09-03 16:57:48 +02:00
Raphaël Vinot 7ea37ec617 fix: Avoid exception if capture finishes between two calls. 2021-09-01 16:57:20 +02:00
Raphaël Vinot c09adec333 chg: Improve logging. 2021-09-01 14:08:25 +02:00
Raphaël Vinot d41b7735dd chg: Improve storage, support both modes. 2021-08-26 15:49:19 +02:00
Raphaël Vinot bf700e7a7b chg: Major refactoring, move capture code to external script. 2021-08-25 13:36:48 +02:00
Raphaël Vinot 81390d5ea0 chg: cleanup in the mail lookyloo class 2021-08-24 18:32:54 +02:00