Commit Graph

703 Commits (4717f3877c5c536e0cbce4db5fe76686ee466315)

Author SHA1 Message Date
Raphaël Vinot 4ff9b7651d new: Support for TZ, Geo, locale, color scheme 2023-06-07 15:05:40 +02:00
Raphaël Vinot 5a61bdf5ee chg: Bump deps 2023-06-05 15:23:35 +02:00
Raphaël Vinot e3e184a317 chg: Bump version 2023-06-01 16:20:26 +02:00
Raphaël Vinot fd93e2847b chg: Bump deps 2023-05-31 16:28:44 +02:00
Raphaël Vinot 640fbb6a44 chg; Bump playwright 2023-05-27 16:09:43 +02:00
Raphaël Vinot 7f27383329 chg: Bump deps 2023-05-23 15:39:53 +02:00
Raphaël Vinot 4f07b1253e chg: Bump deps 2023-05-15 16:16:23 +02:00
Raphaël Vinot a504facf5e new: Flag to quickly say if two captures are different or not 2023-05-11 15:07:37 +02:00
Raphaël Vinot aa474e2b17 chg: Bump urllib3 2023-05-08 12:31:23 +02:00
Raphaël Vinot e39d2a590c chg: Bump deps 2023-05-04 10:20:31 +02:00
Raphaël Vinot 4feee9503e chg: Bump deps 2023-05-02 16:26:22 +02:00
Raphaël Vinot f8c2639c96 fix: Missing file in last commit 2023-04-28 18:30:38 +02:00
Raphaël Vinot 3db72a7039 chg: Bump deps to prepare release. 2023-04-28 18:08:02 +02:00
Raphaël Vinot c80f1b1bd7 chg: Bump deps 2023-04-26 15:42:02 +02:00
Raphaël Vinot 952a53038e chg: Bump deps 2023-04-24 18:10:35 +02:00
Raphaël Vinot b33ef171a4 new: Method to get comparable stuff out of tree 2023-04-21 23:57:23 +02:00
Raphaël Vinot 71c26aeae2 chg: Bump deps 2023-04-19 14:25:55 +03:00
Raphaël Vinot 2dc068a63f chg: Bump deps 2023-04-13 10:19:11 +02:00
Raphaël Vinot c7d3e54edf fix: Cloudflare module always returning True 2023-04-12 14:05:05 +02:00
Raphaël Vinot 4ceae60db7 chg: Avoid stopping the captures before they're done 2023-04-09 13:58:34 +02:00
Raphaël Vinot 2ceda75eab chg: Fairly big refactoring/cleanup to support LacusCore 1.4.0 2023-04-08 13:49:18 +02:00
Raphaël Vinot b109f5e84b chg: Bump deps 2023-04-05 16:24:42 +02:00
Raphaël Vinot 9814381497 chg: Bump pillow 2023-04-03 15:07:47 +02:00
Raphaël Vinot d443aa4d80 fix: Upgrade monitoring package 2023-03-30 13:21:00 +02:00
Raphaël Vinot 5184d45a63 chg: Bump deps, version. 2023-03-30 12:16:29 +02:00
Raphaël Vinot 854a045cba new: Modal for admin tasks. 2023-03-29 15:15:17 +02:00
Raphaël Vinot 9ff153ea44 chg: Bump deps, new Playwright. 2023-03-28 12:10:59 +02:00
Raphaël Vinot c68805f179 chg: Bump deps 2023-03-27 14:23:01 +02:00
Raphaël Vinot c48bf2f4de new: Pass compare settings (WiP) 2023-03-24 15:47:41 +01:00
Raphaël Vinot 1783314c33 chg: Bump deps, block redis v4.5.2 (broken)
Ref for redis: https://github.com/redis/redis-py/issues/2629
2023-03-21 13:36:40 +01:00
Raphaël Vinot 046417c058 chg: Bump pysecurity.txt, pass Lookyloos UA 2023-03-21 11:28:08 +01:00
Raphaël Vinot a0a23dca20 chg: Bump har2tree 2023-03-16 17:32:14 +01:00
Raphaël Vinot 9497060028 fix: Cleanup prints, improve archiver. 2023-03-16 12:28:28 +01:00
Raphaël Vinot 8978f1b798 chg: Bump deps 2023-03-15 18:04:39 +01:00
Raphaël Vinot d9eec029c2 chg: Bump deps 2023-03-12 19:25:16 +01:00
Raphaël Vinot 5c188d05e9 chg: Bump deps 2023-03-08 16:55:34 +02:00
Raphaël Vinot 76e179e9be chg: Bump deps 2023-03-06 14:50:50 +01:00
Raphaël Vinot 5f2bcf9229 chg: Bump deps 2023-03-02 20:52:43 +01:00
Raphaël Vinot 054ba329a8 chg: Bump deps for release 2023-02-28 17:47:54 +01:00
Raphaël Vinot b25fc09a72 chg: Bump version, deps, make mypy happy 2023-02-28 17:30:12 +01:00
Raphaël Vinot 3ffad5a926 chg: Use packaged version of pylookyloomonitoring 2023-02-28 16:53:34 +01:00
Raphaël Vinot dae70597ae Merge branch 'main' into monitoring 2023-02-27 16:05:27 +01:00
Raphaël Vinot e46969ba4d chg: Bump deps 2023-02-27 16:03:05 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot 180c62cb2f chg: Bump deps (playwright, web) 2023-02-23 11:08:09 +01:00
Raphaël Vinot 6e4bf72184 chg: Bump deps 2023-02-16 16:11:03 +01:00
Raphaël Vinot 1558f65c8e new: try to get contact info from security.txt file if available. 2023-02-14 13:32:00 +01:00
Raphaël Vinot 5e2f13d54d chg: Bump deps 2023-02-10 13:48:33 +01:00
Raphaël Vinot 7210f39c42 chg: Bump deps 2023-02-09 15:38:58 +01:00
Raphaël Vinot 70500e0da5 chg: Bump deps 2023-02-06 19:54:06 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot a1adc810ba chg: Bump deps 2023-01-30 16:28:38 +01:00
Raphaël Vinot 584eb5e87d chg: Bump playwright 2023-01-26 23:09:43 +01:00
Raphaël Vinot b373b3d577 chg: Bump deps 2023-01-23 11:20:28 +01:00
Raphaël Vinot f335b4a58d fix: Use publicsuffixlist instead of publicsuffix2 2023-01-20 15:23:11 +01:00
Raphaël Vinot 64007fd5bc chg: Bump deps 2023-01-20 13:36:41 +01:00
Raphaël Vinot 9256b86527 chg: Bump deps 2023-01-20 11:51:31 +01:00
Raphaël Vinot 621bea6896 chg: Bump deps 2023-01-18 16:31:23 +01:00
Raphaël Vinot aab3851a4c chg: Bump deps 2023-01-16 15:11:43 +01:00
Raphaël Vinot a4c2706a80 chg: Bump deps 2023-01-11 14:56:43 +01:00
Raphaël Vinot 4fb2c0ca93 chg: Bump deps 2023-01-08 12:58:58 +01:00
Raphaël Vinot 8d4fd7d742 chg: Bump pyphishtanklookup 2023-01-03 14:14:47 +01:00
Raphaël Vinot 6520d99b10 chg: Bump PyLacus, maintenance. 2023-01-02 17:41:05 +01:00
Raphaël Vinot 73ddd1a2eb chg: Bump deps 2023-01-02 16:25:01 +01:00
Raphaël Vinot 5200402e06 chg: Another quick deps bump, prepare v1.17.0 2022-12-29 14:07:27 +01:00
Raphaël Vinot f0615fc54f chg: Bump deps, prepare for v1.17.0 release 2022-12-28 16:25:44 +01:00
Raphaël Vinot 407b63ec3b chg: Bump deps 2022-12-26 23:30:38 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot 19259ca1dd chg: Bump playwright 2022-12-22 23:27:57 +01:00
Raphaël Vinot 3e0f55eab2 chg: Bump deps 2022-12-22 00:16:13 +01:00
Raphaël Vinot 4461b4e3d5 chg: Bump deps 2022-12-19 14:03:44 +01:00
Raphaël Vinot 00ede19d65 fix: remove cchardet properly 2022-12-16 16:23:36 +01:00
Raphaël Vinot d6af35b98a chg: Bump deps, use poetry 1.3, support python 3.11. 2022-12-16 16:18:11 +01:00
Raphaël Vinot e1dafc4960 chg: Bump certifi 2022-12-09 11:04:46 +01:00
Raphaël Vinot d7dea9a68e fix: Bump har2tree 2022-12-07 15:50:37 +01:00
Raphaël Vinot 94b3b487f3 chg: Add more entries to the cache, use it in the modules. 2022-12-07 13:03:15 +01:00
Raphaël Vinot b1c0835463 chg: Improve dependencies, enable recpatcha bypass by default 2022-12-05 18:00:35 +01:00
Raphaël Vinot 3fc12aec5f chg: Bump deps 2022-12-02 14:27:28 +01:00
Raphaël Vinot d7f849ae7e chg: Bump deps 2022-12-02 10:37:35 +01:00
Raphaël Vinot 3bed8c0a69 chg: Bump deps 2022-12-02 10:06:12 +01:00
Raphaël Vinot af9515c123 new: URL Haus module
Related: #505
2022-11-30 18:38:41 +01:00
Raphaël Vinot 56ed06eb84 new: Show error message in bulk capture 2022-11-29 15:30:16 +01:00
Raphaël Vinot 572f85dace chg: Bump w3lib, har2tree for logging 2022-11-28 16:08:35 +01:00
Raphaël Vinot 3092b46f5d chg: More logging improvements 2022-11-28 12:23:40 +01:00
Raphaël Vinot 48bbc30c59 chg: Bump har2tree 2022-11-27 16:38:32 +01:00
Raphaël Vinot 2d0b7224cc new: Timeout if a tree takes too long to generate 2022-11-27 00:09:40 +01:00
Raphaël Vinot 4c904fd428 chg: Bump deps 2022-11-23 14:09:11 +01:00
Raphaël Vinot 682f0d4936 chg: Bump deps 2022-11-21 15:09:29 +01:00
Raphaël Vinot c006d53d5d new: More complete submit capture page, use bootstrap 5.2. 2022-11-21 15:02:12 +01:00
Raphaël Vinot 3c1cbd6ece new: Very basic page to submit an existing capture via a HAR file 2022-11-19 01:32:17 +01:00
Raphaël Vinot abf1cbc728 chg: Bump playwright 2022-11-17 15:01:33 +01:00
Raphaël Vinot 026b07f0a5 chg: Bump deps 2022-11-16 13:42:11 +01:00
Raphaël Vinot df62481592 chg: Bump deps 2022-11-10 14:15:54 +01:00
Raphaël Vinot 11e671ac8b chg: Bump deps 2022-11-08 19:22:04 +01:00
Raphaël Vinot d8689bd1d5 chg: Bump LacusCore again 2022-11-05 13:12:29 +01:00
Raphaël Vinot 20e9bb6187 chg: Bump deps 2022-11-05 12:30:24 +01:00
Raphaël Vinot 2849b6794c chg: Bump deps 2022-11-03 13:57:22 +01:00
Raphaël Vinot efa94cc3eb fix: Issue with flask upgrade 2022-11-02 12:23:41 +01:00
Raphaël Vinot 108a0702df chg: Bump deps 2022-11-02 11:28:45 +01:00
Raphaël Vinot 9677c4d120 new: Support lacus unreachable by caching locally
+ initialize lacus globally for consistency.
2022-11-01 18:10:25 +01:00
Raphaël Vinot dd0426537a chg: Bump pillow 2022-10-31 11:51:06 +01:00
Raphaël Vinot 07bf2646ae chg: Bump deps 2022-10-29 15:03:36 +02:00
Raphaël Vinot a48c6e0bd6 new: SIGTERM handling (PyLacus and LacusCore) 2022-10-28 12:40:28 +02:00
Raphaël Vinot ff68e29136 fix: numpy install issue with python < 3.10 2022-10-27 13:47:52 +02:00
Raphaël Vinot 73fb2fa652 chg: Bump lacus 2022-10-26 14:20:39 +02:00
Raphaël Vinot 06d707a4dc chg: Bump deps 2022-10-24 10:48:44 +02:00
Raphaël Vinot b4957ea8f0 chg: Bump deps for lacus v1.0 2022-10-19 15:02:19 +02:00
Raphaël Vinot 87bb61efea chg: Bump deps 2022-10-19 11:36:34 +02:00
Raphaël Vinot 6bf125b97e chg: Bump missing dep 2022-10-13 15:28:48 +02:00
Raphaël Vinot 1e746272af chg: Bump deps 2022-10-13 15:27:26 +02:00
Raphaël Vinot 45580f4823 chg: Bump deps 2022-10-09 17:27:32 +02:00
Raphaël Vinot 83fb88c24e fix: Document upload 2022-10-07 15:39:40 +02:00
Raphaël Vinot f0c23f36c5 chg: Bump lacuscore 2022-10-05 13:43:40 +02:00
Raphaël Vinot 76590404b8 chg: Bump deps 2022-10-04 20:08:53 +02:00
Raphaël Vinot f0fabe9ec1 chg: Bump deps 2022-10-03 12:21:46 +02:00
Raphaël Vinot 9e7cd2e310 chg: Bump deps 2022-09-30 18:12:59 +02:00
Raphaël Vinot 1ca175bc68 chg: Bump deps 2022-09-29 15:51:50 +02:00
Raphaël Vinot cdaa4a7563 chg: Bump mypy 2022-09-27 20:49:00 +02:00
Raphaël Vinot b351d4cd87 chg: Bump deps 2022-09-27 13:05:14 +02:00
Raphaël Vinot 8d7e0ecf15 chg: Less logging 2022-09-26 15:51:14 +02:00
Raphaël Vinot 59fbd767f6 chg: Bump deps 2022-09-24 22:38:29 +02:00
Raphaël Vinot 43a79babba chg: Bump deps 2022-09-23 15:23:00 +02:00
Raphaël Vinot 86f3c5638e chg: Bump deps, fix typo 2022-09-23 13:45:14 +02:00
Raphaël Vinot 80119b77b2 chg: Bump vt dep 2022-09-23 13:15:01 +02:00
Raphaël Vinot da502ee3d6 chg: Implement support for LacusCore *or* PyLacus 2022-09-23 13:13:09 +02:00
Raphaël Vinot d38b612c37 chg: Bump lacuscore 2022-09-23 13:13:09 +02:00
Raphaël Vinot 318f554db3 chg: move to lacus, WiP 2022-09-23 13:13:09 +02:00
Raphaël Vinot ca07a8fcba chg: Bump deps, fix endless loop 2022-09-06 14:50:24 +02:00
Raphaël Vinot 903c67127b chg: Bump har2tree 2022-09-06 02:09:40 +02:00
Raphaël Vinot 07515bcb40 chg: Bump deps 2022-09-05 18:47:16 +02:00
Raphaël Vinot d8e82bd6bf chg: Bump pyhashlookup 2022-08-31 17:38:20 +02:00
Raphaël Vinot c6464936fc chg: Bump to poetry v1.2, remove dep on setuptools 2022-08-31 16:33:13 +02:00
Raphaël Vinot 799139be2e chg: Bump PlawrightCapture 2022-08-30 01:51:16 +02:00
Raphaël Vinot a77746fb1d chg: Bump deps 2022-08-30 01:11:32 +02:00
Raphaël Vinot dac45e401f chg: Bump har2tree, bugfix. 2022-08-25 15:56:32 +02:00
Raphaël Vinot ec07429e65 chg: Much better handling of downloaded files 2022-08-25 13:28:02 +02:00
Raphaël Vinot 53b4297dc8 chg: Bump deps 2022-08-24 13:28:37 +02:00
Raphaël Vinot f4dfa0343e new: Submit to Pandora button for file URLs 2022-08-23 17:48:36 +02:00
Raphaël Vinot ebbe6e3ce9 new: Pick mobile devices on capture page 2022-08-22 17:34:00 +02:00
Raphaël Vinot c1009cbc11 chg: Bump version, improve logging 2022-08-19 09:33:26 +02:00
Raphaël Vinot 3a8649d593 chg: Bump deps 2022-08-18 17:34:44 +02:00
Raphaël Vinot 998ef12b06 new: Add support for playwright devices and browser name (API only) 2022-08-18 11:19:32 +02:00
Raphaël Vinot 3da2308f01 chg: Bump deps 2022-08-14 17:52:41 +02:00
Raphaël Vinot 4a0cb8b0ec chg: Bump deps 2022-08-14 16:50:44 +02:00
Raphaël Vinot 618bbb920f chg: Bump deps 2022-08-14 16:45:18 +02:00
Raphaël Vinot 72c4e43474 new: Upload a file instead of submitting a URL. 2022-08-14 16:41:34 +02:00
Raphaël Vinot fdfa2e25cb new: Initial listing of all resources loaded on the capture 2022-08-14 16:31:49 +02:00
Arhamyss 5a77044530 new: first try to add an url in the hostnode to dl the file if there is one to be downloaded 2022-08-09 18:23:11 +02:00
Raphaël Vinot 08897d4d77 fix: Python 3.8 compatibility 2022-07-29 13:15:45 +02:00
Raphaël Vinot 9b4d56a0b6 fix: Do not display all the recent captures with the same hash in popup 2022-07-28 16:14:47 +02:00
Raphaël Vinot 37212a5d3e chg: Bump deps 2022-07-27 14:43:44 +02:00
Raphaël Vinot 2b14d6e9e6 chg: Bump deps, pass UA to hashlookup calls 2022-07-26 10:50:55 +02:00
Raphaël Vinot 5404f5dce2 fix: flask-login is incompatible with werkzeug 2.2 2022-07-24 21:04:17 +02:00
Raphaël Vinot f953629539 fix: webserver crash when RiskIQ is not reachable. Bump deps. 2022-07-24 20:57:16 +02:00
Raphaël Vinot 05b9e551e4 chg: Bump playwright, avoid exception on request timeout 2022-07-22 14:29:19 +02:00
Raphaël Vinot c9381873c7 chg: cleanup the file download feature 2022-07-19 17:54:45 +02:00
Raphaël Vinot e94b1e05b8 new: Support for in-HAR IPs, TLS/SSL info 2022-07-19 11:22:33 +02:00
Raphaël Vinot c0bde711d2 new: Very basic RiskIQ support for PDNS. 2022-07-15 18:53:49 +02:00
Raphaël Vinot 2caa19aec0 chg: Bump deps 2022-07-12 18:43:25 +02:00
Raphaël Vinot 92d8b9e36c chg: Bump deps 2022-07-11 17:07:36 +02:00
Raphaël Vinot f71b02badc chg: Bump deps 2022-07-11 10:24:40 +02:00
Raphaël Vinot 8a4d8ded35 chg: Bump deps 2022-06-29 12:10:11 +01:00
Raphaël Vinot cd7eb1b33b chg: Bump deps 2022-06-28 17:04:14 +01:00
Raphaël Vinot 881ccb5923 chg: Bump deps, version. 2022-06-26 16:08:24 +01:00
Raphaël Vinot 4ee1b66c7e fix: bump har2tree, handle exception properly, take 2 2022-06-23 19:25:36 +02:00
Raphaël Vinot 1e0b2c16d7 fix: bump har2tree, handle exception properly 2022-06-23 18:57:10 +02:00
Raphaël Vinot b9a0eaeab4 chg: Bump deps 2022-06-23 18:23:29 +02:00
Raphaël Vinot b5391e241f chg: Bump deps 2022-06-16 13:22:31 +02:00
Raphaël Vinot 77b1970991 fix: sign package, bump deps 2022-06-09 14:56:19 +02:00
Raphaël Vinot 2f35433b42 chg: Bump deps 2022-06-03 11:44:30 +02:00
Raphaël Vinot 029adc723c chg: Bump deps 2022-05-31 01:40:10 +02:00
Raphaël Vinot 494d601e8c chg: Bump type defs 2022-05-27 12:44:14 +02:00
Raphaël Vinot c60da37707 fix: properly display warning if a capture failed 2022-05-25 16:04:23 +02:00
Raphaël Vinot 7f1b9f8139 chg: Bump deps, fix issue with playwright 2022-05-24 14:54:30 +02:00
Raphaël Vinot 193fe897cd chg: Bump version 2022-05-24 13:14:07 +02:00
Raphaël Vinot 48d5977150 chg: Bump deps 2022-05-23 20:43:55 +02:00
Raphaël Vinot 1817a3e13b chg: sunday cleanup 2022-05-23 00:15:52 +02:00
Raphaël Vinot 549861d3de chg: Bump deps 2022-05-20 01:05:52 +02:00
Raphaël Vinot 06fca309b4 chg: Bump har2tree 2022-05-12 14:56:12 +02:00
Raphaël Vinot 56bf9d08ba chg: switch from pydeep to pydeep2, easier to install. 2022-05-11 14:36:44 +02:00
Raphaël Vinot 4558f1d4f4 chg: Bunp deps 2022-05-11 14:06:12 +02:00
Raphaël Vinot 25bea394c7 chg: Bump deps 2022-05-09 12:54:37 +02:00
Raphaël Vinot adaddc591c chg: Bump deps, improvments in har2tree and pw capture 2022-05-04 16:45:56 +02:00
Raphaël Vinot d222ae04aa new: Keep capture even if we have a network error 2022-05-03 12:23:16 +02:00
Raphaël Vinot 463d1d2d1a new: autosubmit to FOX, bump deps 2022-05-02 13:04:55 +02:00
Raphaël Vinot 163c35a614 fix: Avoid exception if bytes in query 2022-04-30 00:08:35 +02:00
Raphaël Vinot ef1094a331 chg: Bump deps, fix cookie issue
Fix  #404
2022-04-29 00:44:03 +02:00
Raphaël Vinot e54832b268 fix: more cleanup in tree building 2022-04-28 14:14:42 +02:00
Raphaël Vinot 4bfa625418 chg: Bump har2tree, fix trees 2022-04-28 02:08:50 +02:00
Raphaël Vinot 6ffff5247c chg: Bump deps, improve tree 2022-04-27 14:42:04 +02:00
Raphaël Vinot 1679ccf90f chg: Improve capture, ignore ssl issues. 2022-04-26 13:49:24 +02:00
Raphaël Vinot 77fbf47e73 fix: capture cleanup 2022-04-26 10:25:11 +02:00
Raphaël Vinot e12a4d39f3 fix: error in playwright capture 2022-04-26 01:54:21 +02:00
Raphaël Vinot 41c7e87458 fix: docker, improve error catching 2022-04-26 00:33:50 +02:00
Raphaël Vinot 5af278f84d fix: issue in playwrightcapture module 2022-04-25 15:20:05 +02:00
Raphaël Vinot 1cdea05df5 chg: Bump lock 2022-04-25 13:36:39 +02:00
Raphaël Vinot 4ad898a375 chg: Use packaged playwright capture module 2022-04-25 13:34:01 +02:00
Raphaël Vinot fa54cb2caa chg: Bump deps 2022-04-21 15:14:28 +03:00