Commit Graph

91 Commits (a40d0f02b6dacec2306126af2b38350b34902a3c)

Author SHA1 Message Date
Raphaël Vinot 917c1beebc fix: More logical use of the keys 2018-04-12 18:29:44 +02:00
Raphaël Vinot 6b18e9921c new: Major rewrite of the website 2018-04-12 18:09:04 +02:00
Raphaël Vinot 5cfd5df97e new: Add date picker 2018-04-11 18:04:40 +02:00
Raphaël Vinot 5e0f198836 fix: Search field 2018-04-11 16:16:19 +02:00
Raphaël Vinot 823a83a9cd new: Search field on index 2018-04-11 15:55:46 +02:00
Raphaël Vinot bf2da80e96 new: ASN prefix page 2018-04-11 15:31:34 +02:00
Raphaël Vinot 5ac57a9e1a chg: Move the querying module, add very simple web interface 2018-04-11 14:55:20 +02:00
Raphaël Vinot 4b7f0b8d95 fix: get the score instead of the position of an ASN 2018-04-10 23:28:52 +02:00
Raphaël Vinot 07f29e865e fix: typing 2018-04-10 23:23:36 +02:00
Raphaël Vinot 0764f066fd new: Small query API 2018-04-10 21:27:35 +02:00
Raphaël Vinot 5670db9d1d fix: Insert big chunks in ARDB is baster. 2018-04-10 14:47:51 +02:00
Raphaël Vinot ce96ad9825 chg: Reduce the queries against the ranking db 2018-04-10 14:36:08 +02:00
Raphaël Vinot f65228a2df new: Use hiredis for speed 2018-04-10 14:14:50 +02:00
Raphaël Vinot 4a2db70a26 chg: More reasonable insert chunks 2018-04-10 14:14:04 +02:00
Raphaël Vinot c20175fce6 chg: default timestamp for a parsed IP is today midnight 2018-04-10 14:01:07 +02:00
Raphaël Vinot 4be3636a39 fix: Only add ranking if the rank isn't 0 2018-04-10 11:57:47 +02:00
Raphaël Vinot 583bdfccd3 fix: zincrby parameters order 2018-04-10 11:35:19 +02:00
Raphaël Vinot 191975578e fix: Properly cleanup intakedb 2018-04-10 11:27:52 +02:00
Raphaël Vinot 53b08e6181 new: Add daily aggregated rankings 2018-04-10 11:21:03 +02:00
Raphaël Vinot b60c70a3c5 fix: Mark ranking as done when db not ready 2018-04-10 01:54:34 +02:00
Raphaël Vinot 332a2aeed8 fix: last commit. 2018-04-10 01:46:38 +02:00
Raphaël Vinot 69ae93badb Add Ranking.
Make all possible strings f-string.
2018-04-10 00:20:59 +02:00
Raphaël Vinot 8180d1e0f3 chg: Use UNIX sockets instead of local TCP 2018-04-05 14:36:01 +02:00
Raphaël Vinot c2b92c56eb fix: remove loop close 2018-04-04 23:45:13 +02:00
Raphaël Vinot b5894c45da chg: Move on if there is an exception on fetching lists 2018-04-04 23:44:11 +02:00
Raphaël Vinot e00dfc3e3f Revert "chg: Catch aiohttp.ClientError"
This reverts commit 9904404003.
2018-04-04 23:41:22 +02:00
Raphaël Vinot 9904404003 chg: Catch aiohttp.ClientError 2018-04-04 23:34:48 +02:00
Raphaël Vinot 76ec7ff379 chg: Catch exceptions in the main loop 2018-04-03 23:31:54 +02:00
Raphaël Vinot 595fa671d7 chg: Change directory used to store raw data 2018-04-01 19:05:48 +02:00
Raphaël Vinot 3512290cc2 chg: Store the source files in the home directory 2018-04-01 18:15:44 +02:00
Raphaël Vinot 28ef7b2ecc chg: cleanup and improvements 2018-03-30 14:33:39 +02:00
Raphaël Vinot b4b012a430 chg: cleanup 2018-03-29 23:05:07 +02:00
Raphaël Vinot b0550bc91c chg: Better name to check if the parsers are running 2018-03-29 22:47:41 +02:00
Raphaël Vinot ae6c5bc9c0 chg: add missing requirements 2018-03-29 22:41:10 +02:00
Raphaël Vinot adf2f1e157 new: major refactoring 2018-03-29 22:37:28 +02:00
Raphaël Vinot 3544dcb7e4 new: use local patricia tree to lookup prefixes 2018-03-22 13:39:57 +01:00
Raphaël Vinot 9979c9abe1 new: Add startup scripts for redis & ardb 2018-03-21 17:58:36 +01:00
Raphaël Vinot b3c68db8ec fix: Properly use asyncio all over the place \o/ 2018-03-20 21:44:52 +01:00
Raphaël Vinot 7961b68852 chg: Update readme 2018-03-12 17:46:54 +01:00
Raphaël Vinot ebf58b535d Initial commit
* Module fetchers, parsers and archivers
* Initial import (intake)
* Pre-insert sanitizer
* Routing Information Service fetcher
* Database insert
2018-03-12 15:52:26 +01:00
Raphaël Vinot 6e4f530f54
Initial commit 2018-03-12 15:13:01 +01:00