Commit Graph

663 Commits (d16bd170c604182bb2fccf5fe50975540a94448a)

Author SHA1 Message Date
Raphaël Vinot 3ffad5a926 chg: Use packaged version of pylookyloomonitoring 2023-02-28 16:53:34 +01:00
Raphaël Vinot dae70597ae Merge branch 'main' into monitoring 2023-02-27 16:05:27 +01:00
Raphaël Vinot e46969ba4d chg: Bump deps 2023-02-27 16:03:05 +01:00
Raphaël Vinot cf25da5646 new: Show the monitoring settings on the modal 2023-02-27 16:01:46 +01:00
Raphaël Vinot 5e72e1104e new: Basic support for monitoring 2023-02-23 18:37:40 +01:00
Raphaël Vinot 370850285d fix: exception when cloudflare lookup is unavailable 2023-02-23 16:55:24 +01:00
Raphaël Vinot 180c62cb2f chg: Bump deps (playwright, web) 2023-02-23 11:08:09 +01:00
Raphaël Vinot 6e4bf72184 chg: Bump deps 2023-02-16 16:11:03 +01:00
Raphaël Vinot 1558f65c8e new: try to get contact info from security.txt file if available. 2023-02-14 13:32:00 +01:00
Raphaël Vinot 5e2f13d54d chg: Bump deps 2023-02-10 13:48:33 +01:00
Raphaël Vinot 7210f39c42 chg: Bump deps 2023-02-09 15:38:58 +01:00
Raphaël Vinot 70500e0da5 chg: Bump deps 2023-02-06 19:54:06 +01:00
Raphaël Vinot f6a12d50ea new: very basic takedown information gatherer 2023-02-02 15:18:39 +01:00
Raphaël Vinot a1adc810ba chg: Bump deps 2023-01-30 16:28:38 +01:00
Raphaël Vinot 584eb5e87d chg: Bump playwright 2023-01-26 23:09:43 +01:00
Raphaël Vinot b373b3d577 chg: Bump deps 2023-01-23 11:20:28 +01:00
Raphaël Vinot f335b4a58d fix: Use publicsuffixlist instead of publicsuffix2 2023-01-20 15:23:11 +01:00
Raphaël Vinot 64007fd5bc chg: Bump deps 2023-01-20 13:36:41 +01:00
Raphaël Vinot 9256b86527 chg: Bump deps 2023-01-20 11:51:31 +01:00
Raphaël Vinot 621bea6896 chg: Bump deps 2023-01-18 16:31:23 +01:00
Raphaël Vinot aab3851a4c chg: Bump deps 2023-01-16 15:11:43 +01:00
Raphaël Vinot a4c2706a80 chg: Bump deps 2023-01-11 14:56:43 +01:00
Raphaël Vinot 4fb2c0ca93 chg: Bump deps 2023-01-08 12:58:58 +01:00
Raphaël Vinot 8d4fd7d742 chg: Bump pyphishtanklookup 2023-01-03 14:14:47 +01:00
Raphaël Vinot 6520d99b10 chg: Bump PyLacus, maintenance. 2023-01-02 17:41:05 +01:00
Raphaël Vinot 73ddd1a2eb chg: Bump deps 2023-01-02 16:25:01 +01:00
Raphaël Vinot 5200402e06 chg: Another quick deps bump, prepare v1.17.0 2022-12-29 14:07:27 +01:00
Raphaël Vinot f0615fc54f chg: Bump deps, prepare for v1.17.0 release 2022-12-28 16:25:44 +01:00
Raphaël Vinot 407b63ec3b chg: Bump deps 2022-12-26 23:30:38 +01:00
Raphaël Vinot 479fcb39e5 new: Basic support for IPASN lookup 2022-12-23 16:36:11 +01:00
Raphaël Vinot 19259ca1dd chg: Bump playwright 2022-12-22 23:27:57 +01:00
Raphaël Vinot 3e0f55eab2 chg: Bump deps 2022-12-22 00:16:13 +01:00
Raphaël Vinot 4461b4e3d5 chg: Bump deps 2022-12-19 14:03:44 +01:00
Raphaël Vinot 00ede19d65 fix: remove cchardet properly 2022-12-16 16:23:36 +01:00
Raphaël Vinot d6af35b98a chg: Bump deps, use poetry 1.3, support python 3.11. 2022-12-16 16:18:11 +01:00
Raphaël Vinot e1dafc4960 chg: Bump certifi 2022-12-09 11:04:46 +01:00
Raphaël Vinot d7dea9a68e fix: Bump har2tree 2022-12-07 15:50:37 +01:00
Raphaël Vinot 94b3b487f3 chg: Add more entries to the cache, use it in the modules. 2022-12-07 13:03:15 +01:00
Raphaël Vinot b1c0835463 chg: Improve dependencies, enable recpatcha bypass by default 2022-12-05 18:00:35 +01:00
Raphaël Vinot 3fc12aec5f chg: Bump deps 2022-12-02 14:27:28 +01:00
Raphaël Vinot d7f849ae7e chg: Bump deps 2022-12-02 10:37:35 +01:00
Raphaël Vinot 3bed8c0a69 chg: Bump deps 2022-12-02 10:06:12 +01:00
Raphaël Vinot af9515c123 new: URL Haus module
Related: #505
2022-11-30 18:38:41 +01:00
Raphaël Vinot 56ed06eb84 new: Show error message in bulk capture 2022-11-29 15:30:16 +01:00
Raphaël Vinot 572f85dace chg: Bump w3lib, har2tree for logging 2022-11-28 16:08:35 +01:00
Raphaël Vinot 3092b46f5d chg: More logging improvements 2022-11-28 12:23:40 +01:00
Raphaël Vinot 48bbc30c59 chg: Bump har2tree 2022-11-27 16:38:32 +01:00
Raphaël Vinot 2d0b7224cc new: Timeout if a tree takes too long to generate 2022-11-27 00:09:40 +01:00
Raphaël Vinot 4c904fd428 chg: Bump deps 2022-11-23 14:09:11 +01:00
Raphaël Vinot 682f0d4936 chg: Bump deps 2022-11-21 15:09:29 +01:00
Raphaël Vinot c006d53d5d new: More complete submit capture page, use bootstrap 5.2. 2022-11-21 15:02:12 +01:00
Raphaël Vinot 3c1cbd6ece new: Very basic page to submit an existing capture via a HAR file 2022-11-19 01:32:17 +01:00
Raphaël Vinot abf1cbc728 chg: Bump playwright 2022-11-17 15:01:33 +01:00
Raphaël Vinot 026b07f0a5 chg: Bump deps 2022-11-16 13:42:11 +01:00
Raphaël Vinot df62481592 chg: Bump deps 2022-11-10 14:15:54 +01:00
Raphaël Vinot 11e671ac8b chg: Bump deps 2022-11-08 19:22:04 +01:00
Raphaël Vinot d8689bd1d5 chg: Bump LacusCore again 2022-11-05 13:12:29 +01:00
Raphaël Vinot 20e9bb6187 chg: Bump deps 2022-11-05 12:30:24 +01:00
Raphaël Vinot 2849b6794c chg: Bump deps 2022-11-03 13:57:22 +01:00
Raphaël Vinot efa94cc3eb fix: Issue with flask upgrade 2022-11-02 12:23:41 +01:00
Raphaël Vinot 108a0702df chg: Bump deps 2022-11-02 11:28:45 +01:00
Raphaël Vinot 9677c4d120 new: Support lacus unreachable by caching locally
+ initialize lacus globally for consistency.
2022-11-01 18:10:25 +01:00
Raphaël Vinot dd0426537a chg: Bump pillow 2022-10-31 11:51:06 +01:00
Raphaël Vinot 07bf2646ae chg: Bump deps 2022-10-29 15:03:36 +02:00
Raphaël Vinot a48c6e0bd6 new: SIGTERM handling (PyLacus and LacusCore) 2022-10-28 12:40:28 +02:00
Raphaël Vinot ff68e29136 fix: numpy install issue with python < 3.10 2022-10-27 13:47:52 +02:00
Raphaël Vinot 73fb2fa652 chg: Bump lacus 2022-10-26 14:20:39 +02:00
Raphaël Vinot 06d707a4dc chg: Bump deps 2022-10-24 10:48:44 +02:00
Raphaël Vinot b4957ea8f0 chg: Bump deps for lacus v1.0 2022-10-19 15:02:19 +02:00
Raphaël Vinot 87bb61efea chg: Bump deps 2022-10-19 11:36:34 +02:00
Raphaël Vinot 6bf125b97e chg: Bump missing dep 2022-10-13 15:28:48 +02:00
Raphaël Vinot 1e746272af chg: Bump deps 2022-10-13 15:27:26 +02:00
Raphaël Vinot 45580f4823 chg: Bump deps 2022-10-09 17:27:32 +02:00
Raphaël Vinot 83fb88c24e fix: Document upload 2022-10-07 15:39:40 +02:00
Raphaël Vinot f0c23f36c5 chg: Bump lacuscore 2022-10-05 13:43:40 +02:00
Raphaël Vinot 76590404b8 chg: Bump deps 2022-10-04 20:08:53 +02:00
Raphaël Vinot f0fabe9ec1 chg: Bump deps 2022-10-03 12:21:46 +02:00
Raphaël Vinot 9e7cd2e310 chg: Bump deps 2022-09-30 18:12:59 +02:00
Raphaël Vinot 1ca175bc68 chg: Bump deps 2022-09-29 15:51:50 +02:00
Raphaël Vinot cdaa4a7563 chg: Bump mypy 2022-09-27 20:49:00 +02:00
Raphaël Vinot b351d4cd87 chg: Bump deps 2022-09-27 13:05:14 +02:00
Raphaël Vinot 8d7e0ecf15 chg: Less logging 2022-09-26 15:51:14 +02:00
Raphaël Vinot 59fbd767f6 chg: Bump deps 2022-09-24 22:38:29 +02:00
Raphaël Vinot 43a79babba chg: Bump deps 2022-09-23 15:23:00 +02:00
Raphaël Vinot 86f3c5638e chg: Bump deps, fix typo 2022-09-23 13:45:14 +02:00
Raphaël Vinot 80119b77b2 chg: Bump vt dep 2022-09-23 13:15:01 +02:00
Raphaël Vinot da502ee3d6 chg: Implement support for LacusCore *or* PyLacus 2022-09-23 13:13:09 +02:00
Raphaël Vinot d38b612c37 chg: Bump lacuscore 2022-09-23 13:13:09 +02:00
Raphaël Vinot 318f554db3 chg: move to lacus, WiP 2022-09-23 13:13:09 +02:00
Raphaël Vinot ca07a8fcba chg: Bump deps, fix endless loop 2022-09-06 14:50:24 +02:00
Raphaël Vinot 903c67127b chg: Bump har2tree 2022-09-06 02:09:40 +02:00
Raphaël Vinot 07515bcb40 chg: Bump deps 2022-09-05 18:47:16 +02:00
Raphaël Vinot d8e82bd6bf chg: Bump pyhashlookup 2022-08-31 17:38:20 +02:00
Raphaël Vinot c6464936fc chg: Bump to poetry v1.2, remove dep on setuptools 2022-08-31 16:33:13 +02:00
Raphaël Vinot 799139be2e chg: Bump PlawrightCapture 2022-08-30 01:51:16 +02:00
Raphaël Vinot a77746fb1d chg: Bump deps 2022-08-30 01:11:32 +02:00
Raphaël Vinot dac45e401f chg: Bump har2tree, bugfix. 2022-08-25 15:56:32 +02:00
Raphaël Vinot ec07429e65 chg: Much better handling of downloaded files 2022-08-25 13:28:02 +02:00
Raphaël Vinot 53b4297dc8 chg: Bump deps 2022-08-24 13:28:37 +02:00
Raphaël Vinot f4dfa0343e new: Submit to Pandora button for file URLs 2022-08-23 17:48:36 +02:00
Raphaël Vinot ebbe6e3ce9 new: Pick mobile devices on capture page 2022-08-22 17:34:00 +02:00
Raphaël Vinot c1009cbc11 chg: Bump version, improve logging 2022-08-19 09:33:26 +02:00
Raphaël Vinot 3a8649d593 chg: Bump deps 2022-08-18 17:34:44 +02:00
Raphaël Vinot 998ef12b06 new: Add support for playwright devices and browser name (API only) 2022-08-18 11:19:32 +02:00
Raphaël Vinot 3da2308f01 chg: Bump deps 2022-08-14 17:52:41 +02:00
Raphaël Vinot 4a0cb8b0ec chg: Bump deps 2022-08-14 16:50:44 +02:00
Raphaël Vinot 618bbb920f chg: Bump deps 2022-08-14 16:45:18 +02:00
Raphaël Vinot 72c4e43474 new: Upload a file instead of submitting a URL. 2022-08-14 16:41:34 +02:00
Raphaël Vinot fdfa2e25cb new: Initial listing of all resources loaded on the capture 2022-08-14 16:31:49 +02:00
Arhamyss 5a77044530 new: first try to add an url in the hostnode to dl the file if there is one to be downloaded 2022-08-09 18:23:11 +02:00
Raphaël Vinot 08897d4d77 fix: Python 3.8 compatibility 2022-07-29 13:15:45 +02:00
Raphaël Vinot 9b4d56a0b6 fix: Do not display all the recent captures with the same hash in popup 2022-07-28 16:14:47 +02:00
Raphaël Vinot 37212a5d3e chg: Bump deps 2022-07-27 14:43:44 +02:00
Raphaël Vinot 2b14d6e9e6 chg: Bump deps, pass UA to hashlookup calls 2022-07-26 10:50:55 +02:00
Raphaël Vinot 5404f5dce2 fix: flask-login is incompatible with werkzeug 2.2 2022-07-24 21:04:17 +02:00
Raphaël Vinot f953629539 fix: webserver crash when RiskIQ is not reachable. Bump deps. 2022-07-24 20:57:16 +02:00
Raphaël Vinot 05b9e551e4 chg: Bump playwright, avoid exception on request timeout 2022-07-22 14:29:19 +02:00
Raphaël Vinot c9381873c7 chg: cleanup the file download feature 2022-07-19 17:54:45 +02:00
Raphaël Vinot e94b1e05b8 new: Support for in-HAR IPs, TLS/SSL info 2022-07-19 11:22:33 +02:00
Raphaël Vinot c0bde711d2 new: Very basic RiskIQ support for PDNS. 2022-07-15 18:53:49 +02:00
Raphaël Vinot 2caa19aec0 chg: Bump deps 2022-07-12 18:43:25 +02:00
Raphaël Vinot 92d8b9e36c chg: Bump deps 2022-07-11 17:07:36 +02:00
Raphaël Vinot f71b02badc chg: Bump deps 2022-07-11 10:24:40 +02:00
Raphaël Vinot 8a4d8ded35 chg: Bump deps 2022-06-29 12:10:11 +01:00
Raphaël Vinot cd7eb1b33b chg: Bump deps 2022-06-28 17:04:14 +01:00
Raphaël Vinot 881ccb5923 chg: Bump deps, version. 2022-06-26 16:08:24 +01:00
Raphaël Vinot 4ee1b66c7e fix: bump har2tree, handle exception properly, take 2 2022-06-23 19:25:36 +02:00
Raphaël Vinot 1e0b2c16d7 fix: bump har2tree, handle exception properly 2022-06-23 18:57:10 +02:00
Raphaël Vinot b9a0eaeab4 chg: Bump deps 2022-06-23 18:23:29 +02:00
Raphaël Vinot b5391e241f chg: Bump deps 2022-06-16 13:22:31 +02:00
Raphaël Vinot 77b1970991 fix: sign package, bump deps 2022-06-09 14:56:19 +02:00
Raphaël Vinot 2f35433b42 chg: Bump deps 2022-06-03 11:44:30 +02:00
Raphaël Vinot 029adc723c chg: Bump deps 2022-05-31 01:40:10 +02:00
Raphaël Vinot 494d601e8c chg: Bump type defs 2022-05-27 12:44:14 +02:00
Raphaël Vinot c60da37707 fix: properly display warning if a capture failed 2022-05-25 16:04:23 +02:00
Raphaël Vinot 7f1b9f8139 chg: Bump deps, fix issue with playwright 2022-05-24 14:54:30 +02:00
Raphaël Vinot 193fe897cd chg: Bump version 2022-05-24 13:14:07 +02:00
Raphaël Vinot 48d5977150 chg: Bump deps 2022-05-23 20:43:55 +02:00
Raphaël Vinot 1817a3e13b chg: sunday cleanup 2022-05-23 00:15:52 +02:00
Raphaël Vinot 549861d3de chg: Bump deps 2022-05-20 01:05:52 +02:00
Raphaël Vinot 06fca309b4 chg: Bump har2tree 2022-05-12 14:56:12 +02:00
Raphaël Vinot 56bf9d08ba chg: switch from pydeep to pydeep2, easier to install. 2022-05-11 14:36:44 +02:00
Raphaël Vinot 4558f1d4f4 chg: Bunp deps 2022-05-11 14:06:12 +02:00
Raphaël Vinot 25bea394c7 chg: Bump deps 2022-05-09 12:54:37 +02:00
Raphaël Vinot adaddc591c chg: Bump deps, improvments in har2tree and pw capture 2022-05-04 16:45:56 +02:00
Raphaël Vinot d222ae04aa new: Keep capture even if we have a network error 2022-05-03 12:23:16 +02:00
Raphaël Vinot 463d1d2d1a new: autosubmit to FOX, bump deps 2022-05-02 13:04:55 +02:00
Raphaël Vinot 163c35a614 fix: Avoid exception if bytes in query 2022-04-30 00:08:35 +02:00
Raphaël Vinot ef1094a331 chg: Bump deps, fix cookie issue
Fix  #404
2022-04-29 00:44:03 +02:00
Raphaël Vinot e54832b268 fix: more cleanup in tree building 2022-04-28 14:14:42 +02:00
Raphaël Vinot 4bfa625418 chg: Bump har2tree, fix trees 2022-04-28 02:08:50 +02:00
Raphaël Vinot 6ffff5247c chg: Bump deps, improve tree 2022-04-27 14:42:04 +02:00
Raphaël Vinot 1679ccf90f chg: Improve capture, ignore ssl issues. 2022-04-26 13:49:24 +02:00
Raphaël Vinot 77fbf47e73 fix: capture cleanup 2022-04-26 10:25:11 +02:00
Raphaël Vinot e12a4d39f3 fix: error in playwright capture 2022-04-26 01:54:21 +02:00
Raphaël Vinot 41c7e87458 fix: docker, improve error catching 2022-04-26 00:33:50 +02:00
Raphaël Vinot 5af278f84d fix: issue in playwrightcapture module 2022-04-25 15:20:05 +02:00
Raphaël Vinot 1cdea05df5 chg: Bump lock 2022-04-25 13:36:39 +02:00
Raphaël Vinot 4ad898a375 chg: Use packaged playwright capture module 2022-04-25 13:34:01 +02:00
Raphaël Vinot fa54cb2caa chg: Bump deps 2022-04-21 15:14:28 +03:00
Raphaël Vinot 8d159ffba0 new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
Raphaël Vinot 3839c34e39 chg: Bump typing libs 2022-04-18 16:43:07 +02:00
Raphaël Vinot 4a51b45e3a chg: Bump deps 2022-04-15 01:12:06 +02:00
Raphaël Vinot 59b1112aff chg: Bump deps, sri 2022-04-09 12:23:30 +02:00
Raphaël Vinot 54cfe25f92 ch: Bump deps 2022-04-07 10:16:43 +02:00
Raphaël Vinot 82a599d8a9 chg: Bump deps, version 2022-03-31 12:32:45 +02:00
Raphaël Vinot ee69e66750 new: Multiple queries at once on web interface 2022-03-31 00:48:58 +02:00
Raphaël Vinot 284c2d26ab chg: temporary switch to flask-login from git (werkzeug compat) 2022-03-30 12:20:11 +02:00
Raphaël Vinot ae9cb3e81c chg: Bump deps 2022-03-29 21:13:02 +02:00
Raphaël Vinot 6d27b861b3 chg: Bump deps 2022-03-29 17:17:03 +02:00
Raphaël Vinot 1ca7dc9349 chg: Bump deps 2022-03-18 10:34:06 +01:00
Raphaël Vinot 74fd73327c chg: Bump VT lib 2022-03-16 11:16:01 +01:00
Raphaël Vinot 9b1737964a chg: Bump deps 2022-03-16 11:09:32 +01:00
Raphaël Vinot dca9c0e5d2 chg: Bump deps 2022-03-13 15:07:09 +01:00
Raphaël Vinot 410232c0b1 chg: Bump deps 2022-03-10 00:42:41 +01:00
Raphaël Vinot acf5ff2fdf chg: Improve stats page, bump deps 2022-02-28 13:38:45 +01:00
Raphaël Vinot 53a8952fcc chg: Bump types-redis 2022-02-22 09:56:37 +01:00
Raphaël Vinot 9ddd0a228d chg: Bump deps 2022-02-22 00:32:05 +01:00
Raphaël Vinot 0e0a607bdc chg: Bump deps 2022-02-19 03:03:21 +01:00
Raphaël Vinot 11e2a13ac8 chg: Bump deps 2022-02-17 09:53:35 +01:00
Raphaël Vinot 0311f9fb17 chg: Bump deps 2022-02-11 00:10:36 +01:00
Raphaël Vinot e7cd873fb2 chg: Bump deps 2022-02-03 11:51:35 +01:00
Raphaël Vinot 89bde8387e chg: Bump deps 2022-02-02 00:26:45 +01:00
Raphaël Vinot bf081f63b6 chg: Bump deps 2022-01-21 01:02:00 +01:00
Raphaël Vinot 787258dec1 chg: Bump bootstrap-flask, use bootstrap 5 2022-01-14 15:58:06 +01:00
Raphaël Vinot 9e944f4b7b chg: Bump ipython 2022-01-13 08:58:26 +01:00
Raphaël Vinot df317f331c chg: Bump deps 2022-01-10 11:36:21 +01:00
Raphaël Vinot c5f7bc6233 chg: Bump deps 2022-01-05 16:08:55 +01:00
Raphaël Vinot cc8ae07434 chg: Bump deps 2022-01-03 16:58:24 +01:00
Raphaël Vinot 5508035d6a chg: Bump deps, fix HTML parsing. 2021-12-27 23:05:22 +01:00
Raphaël Vinot ce4e276c68 chg: Bump pymisp, vt-py 2021-12-22 12:43:09 +01:00
Raphaël Vinot 64d626b726 chg: Improve first run of update 2021-12-22 10:55:46 +01:00
Raphaël Vinot 3055a850b7 chg: Bump deps 2021-12-20 12:58:11 +01:00
Raphaël Vinot b0857ac404 chg: Bump mypy 2021-12-16 12:29:17 +01:00
Raphaël Vinot 03fac12e0b chg: Bump deps 2021-12-14 10:09:31 +01:00
Raphaël Vinot e160e54362 chg: Bump deps, security advisory on lxml 2021-12-13 21:50:19 +01:00
Raphaël Vinot 33237f2620 chg: Bump version 2021-12-03 10:41:08 +01:00
Raphaël Vinot 593f8490c4 chg: Bump rich dep 2021-12-02 17:56:12 +01:00
Raphaël Vinot c9307b5159 chg: Improve start/stop for DBs 2021-12-02 14:39:32 +01:00
Raphaël Vinot 649d7714cf chg: Bump pyhashlookup, fix typing 2021-12-01 15:44:45 +01:00