Commit Graph

13 Commits (888859565441a6a4f03a418bcfd3e58ae34da326)

Author SHA1 Message Date
Alexandre Dulaunoy fc012367ec
new: [cisco umbrella block pages] hostname, IPv4 and IPv6 addresses
some minor clean-up and final update
2023-08-25 16:11:41 +02:00
LaZyDK 8892893d9b Initial commit 2023-08-25 09:55:52 +02:00
Alexandre Dulaunoy 811869148f
chg: [generator] add an option to handle gzip file
- It doesn't change the default behavior assuming it's a non-gzip file
- If the `gzip_enable` is set to `True` then the destination file is uncompressed
2023-01-02 11:16:49 +01:00
Alexandre Dulaunoy e72f112dfb
chg: [generator] logging updated 2022-02-01 16:52:09 +01:00
Jakub Onderka 00d5e40ac1 new: List of known SMTP receiving IP addresses 2021-06-14 23:26:44 +02:00
Jakub Onderka e7401c9cbe new: List of known SMTP sending IP ranges 2021-06-14 23:09:39 +02:00
Jakub Onderka 98f7390e88 chg: [cidr] Consolidate CIDR networks 2021-06-13 14:54:48 +02:00
Jakub Onderka 104bf6883f new: [second-level-tlds] Add generator and update to latest version 2021-06-10 10:36:57 +02:00
Kevin Holvoet a9c163ef20 Refactor last scripts, logging, central directory for downloads
* Refactored generate_moz-top50.py
* Download all file to new /tmp file to centralize all downloads
* Add central logging to generators.log file
* Create Bash script that generates all warninglists
* Add /tmp folder and extra files to .gitignore
* Start adding exception handling in download_to_file and write_to_file
2020-07-27 10:44:30 +02:00
Kevin Holvoet 610292e90f Refactor more generators 2020-07-21 13:42:50 +02:00
Kevin Holvoet 9dc6ea9ca8 add check if downloaded file has changed on server before downloading 2020-07-21 09:11:51 +02:00
Kevin Holvoet d3e87dc7ae Refactor code to make it simpler/more uniform 2020-07-21 01:21:28 +02:00
Kevin Holvoet e0b3968635 Merge tranco scripts,:generate_tranco.py generates both full and 10k list 2020-07-17 09:23:39 +02:00