Commit Graph

660 Commits (228432efbbe5986342fef5ebeece9613a6e560c8)

Author SHA1 Message Date
Raphaël Vinot 206e5957b5 new: Support for favicons fetching and display
Related https://github.com/Lookyloo/PlaywrightCapture/issues/45
2023-08-09 16:50:33 +02:00
Raphaël Vinot 7ae2b6e0d1 new: Display ressource URL in ressources list
Related #744
2023-07-31 16:55:34 +02:00
Raphaël Vinot 4be8186cc6 chg: Improve readability of the background indexer 2023-07-30 16:59:41 +02:00
Raphaël Vinot c0f601e5db chg: remove incomplete_redirects from cache, was always 0/False 2023-07-28 14:05:28 +02:00
Raphaël Vinot ea2ded9beb fix: properly handle missing title in cache 2023-07-27 15:21:06 +02:00
Raphaël Vinot f7e5e3e867 new: Link to HHH from hostnode popup 2023-07-24 16:00:55 +02:00
Raphaël Vinot 0604ccfdee new: Improve the HHH details page 2023-07-24 14:53:00 +02:00
Raphaël Vinot 177474e874 new: Basic support for HHHash 2023-07-21 15:48:20 +02:00
Raphaël Vinot 98ae7fb498 new: Expose MISP Export on download modal 2023-07-20 14:02:14 +02:00
Raphaël Vinot 03bf7888e8 chg: Improve rendering capture time 2023-07-18 14:04:44 +02:00
Raphaël Vinot be93c6684e chg: Bump js deps 2023-07-18 12:03:23 +02:00
Raphaël Vinot ff4faa8ec1 fix: avoid exceptions when the width of the thumbnail is not an int 2023-06-26 15:26:41 +02:00
Raphaël Vinot 0505edff0e new: Global proxy setting.
Overwrites any proxy given by the user. Still uses the tor proxy when
needed.

Related: https://github.com/Lookyloo/lookyloo/issues/318
2023-06-13 12:07:26 +02:00
Raphaël Vinot 56944c1338 chg: latitude/longitude in the right order on the UI 2023-06-12 15:46:43 +02:00
Raphaël Vinot 40105a64a3 fix: avoid passing a bad color scheme value 2023-06-07 15:15:03 +02:00
Raphaël Vinot 4ff9b7651d new: Support for TZ, Geo, locale, color scheme 2023-06-07 15:05:40 +02:00
Raphaël Vinot 33553ddd16 chg: Bump js deps 2023-05-15 23:47:39 +02:00
Raphaël Vinot 95f05a3da1 new: Display proxy if passed to the CaptureSettings
Fix #695
2023-05-15 16:33:49 +02:00
Raphaël Vinot 582b5956e9 new: Store capture settings, use TypedDict whenever possible. 2023-05-15 16:08:19 +02:00
Raphaël Vinot 1603c99d5e new: Support for notification in monitoring form 2023-05-11 16:04:11 +02:00
Raphaël Vinot a504facf5e new: Flag to quickly say if two captures are different or not 2023-05-11 15:07:37 +02:00
Raphaël Vinot 6a9bcc0050 new: Automatic reporting via API
Related to #678
2023-04-28 17:19:53 +02:00
Raphaël Vinot 134ccf1acf new: Submit any file to Pandora (if available)
Fix proposal for #670
2023-04-26 15:40:38 +02:00
Raphaël Vinot 079d190138 fix: endpoint to get comparables, more coherent 2023-04-24 18:10:16 +02:00
Raphaël Vinot c62032fee2 new: Endpoint to get comparables from a capture 2023-04-24 16:25:29 +02:00
Raphaël Vinot aa52e6176f fix: same ID for monitoring and notfication button, broke submission. 2023-04-13 10:18:21 +02:00
Raphaël Vinot 854a045cba new: Modal for admin tasks. 2023-03-29 15:15:17 +02:00
Raphaël Vinot 9ff153ea44 chg: Bump deps, new Playwright. 2023-03-28 12:10:59 +02:00
Raphaël Vinot c48bf2f4de new: Pass compare settings (WiP) 2023-03-24 15:47:41 +01:00
Raphaël Vinot f46a8ae841 fix: properly wrap file responses when called on broken captures 2023-03-17 11:10:01 +01:00
Raphaël Vinot 260ca14b70 fix: Avoid stacktrace on partially broken capture. 2023-03-16 16:47:37 +01:00
Raphaël Vinot e410b7631e fix: no decoding in archiver, catch exception when requesting hashes on broken capture 2023-03-16 14:47:24 +01:00
Raphaël Vinot 6d5c4df0d4 fix: Issue with copy/paste 2023-03-09 13:13:01 +02:00
Raphaël Vinot 7e149e63e7 chg: Bump js deps 2023-03-09 13:07:20 +02:00
Raphaël Vinot 53d9a6ba7a new: Add contacts as attachmetn to notification mail 2023-03-09 12:55:45 +02:00
Raphaël Vinot 7a96ae9767 new: Fetch the exiting collection names from the monitoring interface 2023-03-02 20:51:46 +01:00
Raphaël Vinot b25fc09a72 chg: Bump version, deps, make mypy happy 2023-02-28 17:30:12 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot f5c1c14c4d fix: Properly handle the optional responses 2023-02-23 18:47:16 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 180c62cb2f chg: Bump deps (playwright, web) 2023-02-23 11:08:09 +01:00
Raphaël Vinot 6e4bf72184 chg: Bump deps 2023-02-16 16:11:03 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot 599ae9f9f3 new: Compare ressources URLs 2023-01-31 11:24:16 +01:00
Raphaël Vinot ecb4623b86 new: Cloudflare lookup feature to flag IPs appropriately 2023-01-30 16:07:01 +01:00
Raphaël Vinot b020184b1f fix: Improve rendering on tree 2023-01-24 15:00:15 +01:00
Raphaël Vinot c4998b7122 chg: Improve menus on tree page 2023-01-24 13:03:49 +01:00
Raphaël Vinot fbcb99f163 chg: Move notification button to vertical menu 2023-01-23 16:24:01 +01:00
Raphaël Vinot 9ee7341a50 fix: Force d3js version, update must be done manually. 2023-01-20 12:47:45 +01:00
Raphaël Vinot 4ce100e77b chg: Bump d3js 2023-01-20 12:02:28 +01:00
Raphaël Vinot d449edeb23 new: Allow API user to force re-caching the captures on URL/Hostname request 2023-01-20 11:15:33 +01:00
Raphaël Vinot 190d5a7118 new: Very basic capture comparator, API only. 2023-01-18 16:31:12 +01:00
Raphaël Vinot 6624aec1bd new: run DNS lookups on AAAA too 2023-01-16 15:10:10 +01:00
Raphaël Vinot c324bc79e6 fix: Bump SRI for d3js
Fix #572
2023-01-16 14:26:47 +01:00
Raphaël Vinot 14c674e52f new: Link to submit an existing capture 2022-12-29 14:42:24 +01:00
Raphaël Vinot f8aee07251 fix: Remove more print 2022-12-27 01:58:47 +01:00
Raphaël Vinot 1abd97f37a new: switch to return emails only on whois query 2022-12-26 23:01:44 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot c01d4fcb4f chg: Bump JS deps 2022-12-22 00:23:35 +01:00
Raphaël Vinot 0a9003f58e chg: Use cache whenever possible 2022-12-08 11:57:45 +01:00
Raphaël Vinot 8083c8cabc fix: Major improvement in index display when you break the cache... 2022-12-07 21:05:27 +01:00
Raphaël Vinot 3e7f1c3de9 chg: use cache instead of get_info everywhere. 2022-12-07 14:32:13 +01:00
Raphaël Vinot 884b5cf488 fix: Bump d3js 2022-12-05 18:24:37 +01:00
Raphaël Vinot 6871c36848 fix: Skip urlhaus module if no reports 2022-12-05 18:22:47 +01:00
Raphaël Vinot 3189be01dc fix: do not keep the selected os-type on page reload (Firefox bug only) 2022-12-02 09:57:03 +01:00
Raphaël Vinot af9515c123 new: URL Haus module
Related: #505
2022-11-30 18:38:41 +01:00
Raphaël Vinot f30b84b638 fix: Trim URLs on bulk capture 2022-11-29 15:57:13 +01:00
Raphaël Vinot 56ed06eb84 new: Show error message in bulk capture 2022-11-29 15:30:16 +01:00
Raphaël Vinot 3e3eebaf4a new: Proper logging for website too. 2022-11-23 16:24:51 +01:00
Raphaël Vinot 00370291ac new: Logging config in file 2022-11-23 15:54:22 +01:00
Raphaël Vinot 0d310788b0 nwe: Panel for downaloadable stuff 2022-11-23 14:09:00 +01:00
Raphaël Vinot 629c533d6d new: Show capture status on bulk capture page. 2022-11-21 16:49:35 +01:00
Raphaël Vinot c006d53d5d new: More complete submit capture page, use bootstrap 5.2. 2022-11-21 15:02:12 +01:00
Raphaël Vinot 3c1cbd6ece new: Very basic page to submit an existing capture via a HAR file 2022-11-19 01:32:17 +01:00
Raphaël Vinot c6874bef08 chg: Bump datatables 2022-11-18 11:40:43 +01:00
Raphaël Vinot efa94cc3eb fix: Issue with flask upgrade 2022-11-02 12:23:41 +01:00
Raphaël Vinot a4358a9a6a Show message when reloading all the 3rd party modules
Fix #516
2022-10-26 14:35:13 +02:00
Raphaël Vinot 63ba82dd0e fix: Catch exception when getting redirects on broken capture 2022-10-10 14:14:31 +02:00
Raphaël Vinot 83fb88c24e fix: Document upload 2022-10-07 15:39:40 +02:00
Raphaël Vinot e49db6bb38 chg: Improve error message in API. 2022-09-28 12:40:26 +02:00
Raphaël Vinot 5cd8169735 chg: Avoid captures without url(s) or document 2022-09-27 11:33:36 +02:00
Raphaël Vinot f886b8676b fix: More exceptions catching for the the new caching method 2022-09-26 20:55:16 +02:00
Raphaël Vinot 159d444b20 fix: Avoid exception on broken captures 2022-09-26 20:50:42 +02:00
Raphaël Vinot 31261e84c2 fix: Better handling of half broken captures without HAR files 2022-09-26 14:58:30 +02:00
Raphaël Vinot 1c2861ebec chg: Bump jquery 2022-09-23 13:13:09 +02:00
Raphaël Vinot d38b612c37 chg: Bump lacuscore 2022-09-23 13:13:09 +02:00
Raphaël Vinot c6464936fc chg: Bump to poetry v1.2, remove dep on setuptools 2022-08-31 16:33:13 +02:00
Raphaël Vinot c201592c22 chg: Open hashlookup to everyone 2022-08-26 13:41:49 +02:00
Raphaël Vinot 0ae4610270 chg: Notify pandora link copied in clipboard 2022-08-25 15:16:28 +02:00
Raphaël Vinot 2be8a4e4ff chg: Copy pandora link into clipboard 2022-08-25 15:08:08 +02:00
Raphaël Vinot 3d2029956d chg: Replace dl icon 2022-08-25 13:44:30 +02:00
Raphaël Vinot ec07429e65 chg: Much better handling of downloaded files 2022-08-25 13:28:02 +02:00
Raphaël Vinot cbe73fa13f fix: better handling of downloaded content from URL 2022-08-24 14:06:48 +02:00
Raphaël Vinot f4dfa0343e new: Submit to Pandora button for file URLs 2022-08-23 17:48:36 +02:00
Raphaël Vinot f232eba662 chg: Improve UA rendering 2022-08-23 17:44:48 +02:00
Raphaël Vinot ebbe6e3ce9 new: Pick mobile devices on capture page 2022-08-22 17:34:00 +02:00
Raphaël Vinot d63ea473f5 new: Autoselect browser engine based on the UA 2022-08-19 14:26:22 +02:00
Raphaël Vinot 998ef12b06 new: Add support for playwright devices and browser name (API only) 2022-08-18 11:19:32 +02:00
Raphaël Vinot 1c8ae0db52 chg: Make user-agent selection more clear 2022-08-17 21:37:53 +02:00
Raphaël Vinot a71950866e chg: Improve hostnode view 2022-08-14 17:49:04 +02:00
Raphaël Vinot 3c30218cf5 Merge branch 'Arhamyss-HostnodeDl' 2022-08-14 17:23:23 +02:00
Raphaël Vinot d6dc30b260 chg: cleanup formating 2022-08-14 17:14:48 +02:00
Raphaël Vinot 13eaa72a57 chg: Display size of rendered page
Fix #482
2022-08-14 16:43:37 +02:00
Raphaël Vinot 87be90af83 fix: Avoid exceptions on invalid requests 2022-08-14 16:41:37 +02:00
Raphaël Vinot 1ddd38fdcd chg: Improve wording on capture page 2022-08-14 16:41:37 +02:00
Raphaël Vinot 72c4e43474 new: Upload a file instead of submitting a URL. 2022-08-14 16:41:34 +02:00
Raphaël Vinot 2ce8b5a96c new: dropdown to pass DoNotTrack HTTP header
Improvments on the capture page.
2022-08-14 16:31:51 +02:00
Raphaël Vinot fdfa2e25cb new: Initial listing of all resources loaded on the capture 2022-08-14 16:31:49 +02:00
Arhamyss c589933a40 fix: changed the way things are displayed and fixed errors to make the download working 2022-08-10 11:40:11 +02:00
Arhamyss 5a77044530 new: first try to add an url in the hostnode to dl the file if there is one to be downloaded 2022-08-09 18:23:11 +02:00
Raphaël Vinot 474b3275d3 chg: Display size of rendered page
Fix #482
2022-08-05 16:43:41 +02:00
Raphaël Vinot 49f335405e fix: Avoid exceptions on invalid requests 2022-08-05 11:28:44 +02:00
Raphaël Vinot 2f87a77c1b chg: Improve wording on capture page 2022-08-04 17:15:21 +02:00
Raphaël Vinot 4f72d64735 new: Upload a file instead of submitting a URL. 2022-08-04 16:58:07 +02:00
Raphaël Vinot 3170038db7 new: dropdown to pass DoNotTrack HTTP header
Improvments on the capture page.
2022-08-03 12:07:45 +02:00
Raphaël Vinot 83c6c308c5 new: Initial listing of all resources loaded on the capture 2022-08-01 17:51:43 +02:00
Raphaël Vinot 9b4d56a0b6 fix: Do not display all the recent captures with the same hash in popup 2022-07-28 16:14:47 +02:00
Raphaël Vinot b8cd1319a5 fix: Speedup display of hostnode popup 2022-07-27 14:36:56 +02:00
Raphaël Vinot e94b1e05b8 new: Support for in-HAR IPs, TLS/SSL info 2022-07-19 11:22:33 +02:00
Raphaël Vinot ce8eeda9eb chg: Improve RiskIQ module 2022-07-18 13:24:20 +02:00
Raphaël Vinot c0bde711d2 new: Very basic RiskIQ support for PDNS. 2022-07-15 18:53:49 +02:00
Raphaël Vinot 81f10c7cb8 new: config key to display a link to the github page 2022-07-12 10:24:10 +02:00
Raphaël Vinot 0b93a0b356 chg: Update SRIs for new version of d3js 2022-07-11 09:30:44 +02:00
Raphaël Vinot 89782155c4 chg: Bump js deps 2022-06-26 16:05:18 +01:00
Raphaël Vinot ce9ecfefdb chg: remove reference to max depth (not used since playwright), cleanup 2022-06-11 14:49:58 +02:00
Raphaël Vinot 6ba019ec83 chg: Improve somewhat the useragents available for capturing
Fix #416
2022-06-09 18:58:17 +02:00
Raphaël Vinot c60da37707 fix: properly display warning if a capture failed 2022-05-25 16:04:23 +02:00
Raphaël Vinot 358edc9157 chg: Bump datatables 2022-05-23 00:20:38 +02:00
Raphaël Vinot e4a2b0752c chg: dirty improve default UA 2022-05-05 16:30:52 +02:00
Raphaël Vinot cc17b414ff chg: Remove refs to splash 2022-04-25 14:43:02 +02:00
Raphaël Vinot 8d159ffba0 new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
Raphaël Vinot 150171b814 chg: Bump sri 2022-04-15 01:20:38 +02:00
Raphaël Vinot 59b1112aff chg: Bump deps, sri 2022-04-09 12:23:30 +02:00
Raphaël Vinot b2566865b4 chg: Make logo on capture page smaller 2022-03-31 16:21:00 +02:00
Raphaël Vinot 248f9a2340 fix: Wrap long URLs on subsequent capture page 2022-03-31 13:35:33 +02:00
Raphaël Vinot cf46dde1ed chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Raphaël Vinot ee69e66750 new: Multiple queries at once on web interface 2022-03-31 00:48:58 +02:00
Raphaël Vinot f17f6f1a37 new: toggle select in subsequent URLs capture 2022-03-30 13:48:10 +02:00
Raphaël Vinot 954121a363 chg: Improve rendering capture page 2022-03-30 12:32:20 +02:00
Raphaël Vinot 5cdc8c56ef chg: Bump JS deps 2022-03-30 12:20:43 +02:00
Raphaël Vinot 66dcbafaf6 fix: Use same color for all blue buttons
Fix #339
2022-03-18 10:48:12 +01:00
Raphaël Vinot acf5ff2fdf chg: Improve stats page, bump deps 2022-02-28 13:38:45 +01:00
Raphaël Vinot e496277811 fix: font size in top menu, top margin for tree. 2022-01-14 17:03:39 +01:00
Raphaël Vinot 787258dec1 chg: Bump bootstrap-flask, use bootstrap 5 2022-01-14 15:58:06 +01:00
Raphaël Vinot 45ec8efe64 chg: Bump d3js 2022-01-10 11:48:46 +01:00
Raphaël Vinot f8ed5567fa new: Link to changelog on index 2022-01-03 17:04:10 +01:00
Raphaël Vinot c551e4b725 chg: Improve legend with titles
Related: #279
2021-12-22 14:44:56 +01:00
Raphaël Vinot 83f6674dca chg: Add sri to stats page 2021-12-13 17:02:25 +01:00
Raphaël Vinot ec5563337b chg: Bump d3js 2021-12-13 16:39:12 +01:00
Raphaël Vinot 8cceb948f3 new: Get any supported hash algorithm over the API 2021-12-02 17:55:02 +01:00