CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
1,134 Commits
8 Branches
33 Tags
22 MiB
Commit Graph

76 Commits (4c4b01547a7092179ca2730d91eb9424a14472d1)

Author SHA1 Message Date
Raphaël Vinot e56c70d1a1 chg: out of safety, do not remove a capture dir. 2021-08-30 12:54:17 +02:00
Raphaël Vinot 117500b777 chg: Make archiver an index generator 2021-08-30 12:48:13 +02:00
Raphaël Vinot 324736f62c fix: Use proper exception on redis start 2021-08-27 18:08:34 +02:00
Raphaël Vinot ae76cb77be fix: Uncomment website start 2021-08-27 17:49:27 +02:00
Raphaël Vinot 8a51383d7a chg: Move the process managment methods to the proper class 2021-08-27 17:28:26 +02:00
Raphaël Vinot 85e43fc677 chg: Make the website start a normal start script 2021-08-27 16:45:16 +02:00
Raphaël Vinot d41b7735dd chg: Improve storage, support both modes. 2021-08-26 15:49:19 +02:00
Raphaël Vinot 407e78ae7f chg: More cleanup, support clean shutdown of multiple async captures 2021-08-25 16:40:51 +02:00
Raphaël Vinot bf700e7a7b chg: Major refactoring, move capture code to external script. 2021-08-25 13:36:48 +02:00
Raphaël Vinot c732e38395 chg: Add logging in BG processing 2021-08-24 18:44:00 +02:00
Raphaël Vinot 81390d5ea0 chg: cleanup in the mail lookyloo class 2021-08-24 18:32:54 +02:00
Raphaël Vinot 8433cbcc1b chg: Cleanup archiver, initialize index captures in start 2021-08-24 17:10:14 +02:00
Raphaël Vinot ece30a33eb chg: Fix typo in archiver 2021-08-23 16:56:17 +02:00
Raphaël Vinot fb1685cedc add: reset recent captures in archiving process 2021-08-23 16:19:50 +02:00
Raphaël Vinot 8f28335010 fix: properly match cut time 2021-08-23 15:51:06 +02:00
Raphaël Vinot 2c1971311a chg: Make the cut-off date for archiving the 1st of the month 2021-08-23 15:36:59 +02:00
Raphaël Vinot 5c9b88a3ca fix: Make sure all the archived UUIDs are removed 2021-08-23 15:29:21 +02:00
Raphaël Vinot 67e6571145 chg: Force init the archived indexes 2021-08-23 15:14:08 +02:00
Raphaël Vinot 53ceb9c329 chg: Cleanup when dir is moved, digit months on 2 values 2021-08-23 14:53:19 +02:00
Raphaël Vinot d359bc7521 chg: Better use of cache, sanity checks 2021-08-23 12:17:44 +02:00
Raphaël Vinot 58b837cb6c new: Archiver, refactoring. 2021-08-20 17:46:22 +02:00
Raphaël Vinot 6be9b69d95 chg: Use connection pool whenever possible 2021-08-18 18:01:04 +02:00
Raphaël Vinot 59f2a510c0 fix: properly catch broken capture, bump deps 2021-07-14 11:34:10 +02:00
Raphaël Vinot 1117ab6371 chg: add stats, avoid building big trees twice, bump deps 2021-05-26 18:25:06 -07:00
Raphaël Vinot 335ab662cf new: Auto trigger modules in the bg process 2021-05-19 15:12:35 -07:00
Raphaël Vinot f865ec912a fix: Move set/unset running to abstract 
Avoid issues when a script fails unexpectedly.
 2021-04-09 14:33:42 +02:00
Raphaël Vinot 7707d638cf new: Use async capture for the UI. 
Add a method to make sure splash is up before trying to capture.
 2021-04-08 19:15:53 +02:00
Raphaël Vinot 4847fdb670 fix: Windows path in update 2021-04-06 17:43:45 +02:00
Raphaël Vinot c38ec90bb1 fix: Make update script windows compatible 2021-04-06 17:27:59 +02:00
Raphaël Vinot fa6b4701c0 chg: update the cache at the right place. 2021-03-20 21:54:46 +01:00
Raphaël Vinot 13d34421dc chg: Improve BG indexer 2021-03-20 01:13:37 +01:00
Raphaël Vinot 648d4d5b5b chg: Add background ingester to the start script 2021-03-18 01:00:27 +01:00
Raphaël Vinot b3541e0e78 new: background indexer 2021-03-12 16:53:00 +01:00
Raphaël Vinot 6059cb5219 chg: Remove useless code 2021-03-12 16:49:04 +01:00
Raphaël Vinot 82d9cc7b2f fix: Properly rebuild indexed captures 2021-03-07 13:25:27 +01:00
Raphaël Vinot 3ec8015e14 chg: Better messages if website does not start 2021-02-21 23:40:47 +01:00
Raphaël Vinot 6149df06eb chg: Make the cache entries a dataclass 
Fix #99
 2021-01-14 17:12:23 +01:00
Raphaël Vinot 354f269218 new: Integrate categorization in indexing 2020-11-09 16:02:54 +01:00
Raphaël Vinot ea052c7c12 fix: Rename scrape -> capture in async 2020-11-05 14:14:33 +01:00
Raphaël Vinot 8b1e3585ea chg: Improve initial caching. 2020-10-29 23:25:20 +01:00
Raphaël Vinot 39f88e9121 new: API to query URLs 2020-10-27 00:02:18 +01:00
Raphaël Vinot c6c4da981c chg: Improve start/stop 2020-10-22 16:41:00 +02:00
Raphaël Vinot 733e030839 fix: make flake8 happy 2020-10-13 16:38:56 +02:00
Fafner [_KeyZee_] 81fb9db3cf
Generating correct hashes 2020-10-13 16:18:01 +02:00
Fafner [_KeyZee_] 3d17a98799
Restart lookyloo after update 2020-10-13 15:05:36 +02:00
Raphaël Vinot 90a9ff9bb5 chg: Refactoring, add get_hashes 2020-10-09 18:05:25 +02:00
Raphaël Vinot 98eac69d1f new: Add self check in update script. 2020-10-03 21:32:30 +02:00
Raphaël Vinot c0ec0d7a50 chg: Bump minimal version of poetry, bump deps, fix pyproject 2020-10-03 21:19:43 +02:00
Raphaël Vinot 26cb2f1d53 chg: make 3rd party dl a python script 2020-09-28 13:57:21 +02:00
Raphaël Vinot d33698357c new: Update script. 2020-09-28 13:32:19 +02:00