Raphaël Vinot
|
5670db9d1d
|
fix: Insert big chunks in ARDB is baster.
|
2018-04-10 14:47:51 +02:00 |
|
Raphaël Vinot
|
ce96ad9825
|
chg: Reduce the queries against the ranking db
|
2018-04-10 14:36:08 +02:00 |
|
Raphaël Vinot
|
f65228a2df
|
new: Use hiredis for speed
|
2018-04-10 14:14:50 +02:00 |
|
Raphaël Vinot
|
4a2db70a26
|
chg: More reasonable insert chunks
|
2018-04-10 14:14:04 +02:00 |
|
Raphaël Vinot
|
c20175fce6
|
chg: default timestamp for a parsed IP is today midnight
|
2018-04-10 14:01:07 +02:00 |
|
Raphaël Vinot
|
4be3636a39
|
fix: Only add ranking if the rank isn't 0
|
2018-04-10 11:57:47 +02:00 |
|
Raphaël Vinot
|
583bdfccd3
|
fix: zincrby parameters order
|
2018-04-10 11:35:19 +02:00 |
|
Raphaël Vinot
|
191975578e
|
fix: Properly cleanup intakedb
|
2018-04-10 11:27:52 +02:00 |
|
Raphaël Vinot
|
53b08e6181
|
new: Add daily aggregated rankings
|
2018-04-10 11:21:03 +02:00 |
|
Raphaël Vinot
|
b60c70a3c5
|
fix: Mark ranking as done when db not ready
|
2018-04-10 01:54:34 +02:00 |
|
Raphaël Vinot
|
332a2aeed8
|
fix: last commit.
|
2018-04-10 01:46:38 +02:00 |
|
Raphaël Vinot
|
69ae93badb
|
Add Ranking.
Make all possible strings f-string.
|
2018-04-10 00:20:59 +02:00 |
|
Raphaël Vinot
|
8180d1e0f3
|
chg: Use UNIX sockets instead of local TCP
|
2018-04-05 14:36:01 +02:00 |
|
Raphaël Vinot
|
c2b92c56eb
|
fix: remove loop close
|
2018-04-04 23:45:13 +02:00 |
|
Raphaël Vinot
|
b5894c45da
|
chg: Move on if there is an exception on fetching lists
|
2018-04-04 23:44:11 +02:00 |
|
Raphaël Vinot
|
e00dfc3e3f
|
Revert "chg: Catch aiohttp.ClientError"
This reverts commit 9904404003.
|
2018-04-04 23:41:22 +02:00 |
|
Raphaël Vinot
|
9904404003
|
chg: Catch aiohttp.ClientError
|
2018-04-04 23:34:48 +02:00 |
|
Raphaël Vinot
|
76ec7ff379
|
chg: Catch exceptions in the main loop
|
2018-04-03 23:31:54 +02:00 |
|
Raphaël Vinot
|
595fa671d7
|
chg: Change directory used to store raw data
|
2018-04-01 19:05:48 +02:00 |
|
Raphaël Vinot
|
3512290cc2
|
chg: Store the source files in the home directory
|
2018-04-01 18:15:44 +02:00 |
|
Raphaël Vinot
|
28ef7b2ecc
|
chg: cleanup and improvements
|
2018-03-30 14:33:39 +02:00 |
|
Raphaël Vinot
|
b4b012a430
|
chg: cleanup
|
2018-03-29 23:05:07 +02:00 |
|
Raphaël Vinot
|
b0550bc91c
|
chg: Better name to check if the parsers are running
|
2018-03-29 22:47:41 +02:00 |
|
Raphaël Vinot
|
ae6c5bc9c0
|
chg: add missing requirements
|
2018-03-29 22:41:10 +02:00 |
|
Raphaël Vinot
|
adf2f1e157
|
new: major refactoring
|
2018-03-29 22:37:28 +02:00 |
|
Raphaël Vinot
|
3544dcb7e4
|
new: use local patricia tree to lookup prefixes
|
2018-03-22 13:39:57 +01:00 |
|
Raphaël Vinot
|
9979c9abe1
|
new: Add startup scripts for redis & ardb
|
2018-03-21 17:58:36 +01:00 |
|
Raphaël Vinot
|
b3c68db8ec
|
fix: Properly use asyncio all over the place \o/
|
2018-03-20 21:44:52 +01:00 |
|
Raphaël Vinot
|
7961b68852
|
chg: Update readme
|
2018-03-12 17:46:54 +01:00 |
|
Raphaël Vinot
|
ebf58b535d
|
Initial commit
* Module fetchers, parsers and archivers
* Initial import (intake)
* Pre-insert sanitizer
* Routing Information Service fetcher
* Database insert
|
2018-03-12 15:52:26 +01:00 |
|
Raphaël Vinot
|
6e4f530f54
|
Initial commit
|
2018-03-12 15:13:01 +01:00 |