6494e55411
Create requirements.txt
...
Those are the additional Python3 requirements I needed to generate all the lists.
2020-09-23 09:33:02 +02:00
Alexandre Dulaunoy
bcbb62d734
chg: [automatic] updated
2020-09-16 09:04:39 +02:00
e0736d0b7a
fix: changed parsing algorithm to string, see #7c1de70
2020-09-16 00:27:55 +02:00
7c1de70ce0
Changed matching algorithm to string
...
Example for a dangerous entry: dropbox.com with the hostname algorithm and url as a valid attribute type means that https://dropbox.com/malicious/files.exe would get excluded from the automation systems when using the warninglist.
I've changed the algorithm to full string matches.
2020-09-16 00:27:03 +02:00
Alexandre Dulaunoy
fa7cbb52f7
chg: [automatic] updated
2020-09-11 14:33:42 +02:00
Alexandre Dulaunoy
ae3f68338a
Merge pull request #162 from Wiscy-Security/main
...
Refactor last scripts, central logging, central directory for downloads, automation script
2020-09-11 14:26:00 +02:00
d7f01edbac
Merge upstream, update lists, fix conflicts.
...
Merge remote-tracking branch 'upstream/main' into main
2020-09-11 13:48:51 +02:00
Alexandre Dulaunoy
17e6f1b761
Merge pull request #161 from bartblaze/patch-1
...
Add new domains
2020-09-11 06:48:47 +02:00
40ebba72d3
Add new domains
2020-09-10 21:27:06 +02:00
Alexandre Dulaunoy
f19e7274e3
chg: [tranco] updated
2020-08-11 10:35:50 +02:00
Alexandre Dulaunoy
e2bb53492a
chg: [public-dns] updated
2020-08-11 10:33:32 +02:00
Alexandre Dulaunoy
fa325114ab
chg: [microsoft-azure] updated
2020-08-11 10:31:56 +02:00
Alexandre Dulaunoy
963381c839
chg: [tld] updated to the latest version
2020-08-11 10:29:32 +02:00
Alexandre Dulaunoy
a2355251ac
chg: [aws] updated
2020-08-10 14:46:50 +02:00
Alexandre Dulaunoy
fea9465eb5
chg: [office 365] updated
2020-08-10 14:45:58 +02:00
Alexandre Dulaunoy
746e0ba5d0
chg: [office 365] updated
2020-08-10 14:45:05 +02:00
Alexandre Dulaunoy
fa350ba446
Merge pull request #157 from sustefil/fix-issue-156
...
Fix generator.py:download_to_file
2020-08-05 10:38:56 +02:00
9557844065
Fix generator.py:download_to_file
...
When some script which is using generator.py module (e.g. generate-publicdns.py) is run for the
first time, the file is missing and unhandled exception is thrown
2020-08-03 17:24:39 +02:00
aa81303fd0
Merge remote-tracking branch 'upstream/main' into main
2020-07-27 10:56:55 +02:00
a9c163ef20
Refactor last scripts, logging, central directory for downloads
...
* Refactored generate_moz-top50.py
* Download all file to new /tmp file to centralize all downloads
* Add central logging to generators.log file
* Create Bash script that generates all warninglists
* Add /tmp folder and extra files to .gitignore
* Start adding exception handling in download_to_file and write_to_file
2020-07-27 10:44:30 +02:00
Alexandre Dulaunoy
4636dc5640
chg: [mozilla-intermediate-CA] updated to the latest version
2020-07-27 10:17:17 +02:00
Alexandre Dulaunoy
23418c5483
Merge pull request #154 from Wiscy-Security/main
...
Refactoring of code + updates of warninglists
2020-07-27 10:07:44 +02:00
610292e90f
Refactor more generators
2020-07-21 13:42:50 +02:00
623ccd6c44
remove extra .txt extension from downloaded filed
2020-07-21 09:13:15 +02:00
9dc6ea9ca8
add check if downloaded file has changed on server before downloading
2020-07-21 09:11:51 +02:00
d3e87dc7ae
Refactor code to make it simpler/more uniform
2020-07-21 01:21:28 +02:00
d32eb23a58
Chg generator-publicdns: work with new CSV format
...
1. The CSV format has changed with the update on 2020-07-14.
2. The script also generates IPv4, IPv6, and the hostname lists at once.
3. Downloaded file added to .gitignore
2020-07-21 00:38:50 +02:00
cb52a472e6
solved LGTM alerts
2020-07-17 12:42:34 +02:00
9ba47c1463
Added multiple lists from Cisco Umbrella list. Solves issue #24 and #13
2020-07-17 12:31:29 +02:00
feb3ceefda
Merge remote-tracking branch 'upstream/main' into main
2020-07-17 10:24:24 +02:00
6837ba016c
Updated lists after updating scripts
2020-07-17 10:10:04 +02:00
049475ab22
add .gitignore for downloaded files, refactor code for generators: use central module, remove useless code, fix minor issues
2020-07-17 10:06:06 +02:00
c00b21de5f
Fix Microsoft Azure generator: format changed from XML to JSON + download link changed.
2020-07-17 09:25:01 +02:00
e0b3968635
Merge tranco scripts,:generate_tranco.py generates both full and 10k list
2020-07-17 09:23:39 +02:00
1d59d7f6f5
Automatically copy output to list.json file in correct folder
2020-07-16 10:02:59 +02:00
1f15bba220
Refactored mozilla certificate generator: solve relative path issue, remove unused code, refactor structure of code
2020-07-15 16:28:34 +02:00
c924d72db5
renamed cisco top1m to top1k to reflect reality
2020-07-15 02:06:02 +02:00
Alexandre Dulaunoy
79dc2cba16
Merge pull request #153 from Wiscy-Security/main
...
Change tool/scripts permission + update tranco lists
2020-07-14 21:51:40 +02:00
cde6059d73
Update Tranco & Tranco10k list
2020-07-14 16:38:12 +02:00
2bbbb52e1c
chg: chmod +x for new scripts in tools folder
2020-07-14 16:28:07 +02:00
Alexandre Dulaunoy
db0bf3305f
chg: [whats-my-ip] fix 152
2020-07-09 08:34:43 +02:00
Alexandre Dulaunoy
7a28900663
Merge branch 'main' of github.com:MISP/misp-warninglists into main
2020-07-08 14:54:14 +02:00
Alexandre Dulaunoy
1acdef286a
Merge pull request #151 from JakubOnderka/tlds-update
...
Update TLDs list
2020-07-08 07:23:18 +02:00
f493aa451d
Update TLDs list
2020-07-06 16:20:48 +02:00
Alexandre Dulaunoy
8cd3e148cb
Merge pull request #150 from houey/patch-3
...
adding forms.gle which is for google forms.
2020-06-24 07:57:36 +02:00
c6a361c7a1
adding forms.gle which is for google forms.
...
adding forms.gle to the list. This is a short link for Google Forms managed by Google Firebase
2020-06-23 17:06:04 -05:00
Alexandre Dulaunoy
6611f8b977
Merge pull request #149 from houey/patch-2
...
added gvt1.com to Google domains warning list.
2020-06-20 11:52:06 +02:00
fbab4c59dc
added gvt1.com to Google domains warning list.
2020-06-19 11:03:32 -05:00
Alexandre Dulaunoy
82fdf528e9
Merge pull request #148 from GlennHD/master
...
Fixed typo in list.json of Tranco10k
2020-06-12 08:51:28 +02:00
dfa999922e
Fixed typo
...
Fixed typo in list.json
2020-06-11 11:30:36 -05:00
Robert Haist
Alexandre Dulaunoy