a9386a4b42
Create generate-microsoft-azure-appid.py
2022-11-18 23:03:50 +11:00
3adfc0e309
fix: [generator] remove header
2022-10-13 08:19:33 +02:00
49922d0635
chg: [majestic_million] numbers parameter
2022-10-10 15:51:11 +02:00
Alexandre Dulaunoy
14d19fa58f
Merge pull request #226 from jberkers42/jberkers42-tenable
...
Add generator script for Tenable
2022-10-05 15:52:48 +02:00
3069e9ab00
Add generator script for Tenable
2022-10-05 18:03:03 +11:00
Alexandre Dulaunoy
70733ad25b
chg: [dns] add 1.1.1.1 as golden
2022-09-09 16:22:54 +02:00
Alexandre Dulaunoy
3e8138338e
chg: [tools] vpn generation updated following the removal of
...
github.com/ejrv/VPNs
2022-09-01 10:49:26 +02:00
Alexandre Dulaunoy
cd1baa3de5
fix: [public-dns] Update the public-dns generator to remove non valid hostnames
...
Fix reported issue #214
2022-08-16 08:26:14 +02:00
8ea33dd725
Update StackPatch ipblocks URL
2022-08-16 11:42:09 +10:00
Alexandre Dulaunoy
cbb5c8f6a7
chg: [tools] fix generate vpn uri
2022-03-31 13:47:25 +02:00
f974c15776
VPN list is outdated
...
github.com/ejrv/VPNs/ has not been refreshed in 24 months.
https://github.com/X4BNet/lists_vpn/ seems to have replicated that effort for ipv4. No new source found for ipv6
Pros:
- Code for generation is in repository
Cons:
- Unsure about quality. Lots of ASN as source of data.
- No IPV6 data
Comparable open source sources:
- Firehol https://github.com/firehol/blocklist-ipsets / datacenter.ipset . Source data (https://github.com/client9/ipcat ) is outdated from 2019
- https://github.com/jhassine/server-ip-addresses limited provider list
- https://incolumitas.com/pages/Datacenter-IP-API/ API, smaller list
Others sources seem commercial (Udger, securitytrails)
2022-03-30 09:41:37 -06:00
Alexandre Dulaunoy
e72f112dfb
chg: [generator] logging updated
2022-02-01 16:52:09 +01:00
Alexandre Dulaunoy
697aec2821
fix: [stackpath] now a txt file is included on the stackpath
2022-01-04 15:45:01 +01:00
Alexandre Dulaunoy
40b8d3834a
chg: [[publicdns] update the golden list
2021-09-23 10:50:09 +02:00
5687ebf976
new: Include dnscrypt-resolvers IP addresses to public-dns lists
2021-09-15 11:44:51 +02:00
Alexandre Dulaunoy
d68a78085c
chg: [tools] add golden IPv4 DNS server in the generate-publicdns.py script
...
One of the source is regularly dropping 9.9.9.9 as a source of
publicdns. This additional list can be used to ensure these known golden
DNS public resolver are there.
2021-07-13 09:21:21 +02:00
00d5e40ac1
new: List of known SMTP receiving IP addresses
2021-06-14 23:26:44 +02:00
e7401c9cbe
new: List of known SMTP sending IP ranges
2021-06-14 23:09:39 +02:00
6c9eff2dcc
new: Generator for Akamai
2021-06-13 15:48:55 +02:00
98f7390e88
chg: [cidr] Consolidate CIDR networks
2021-06-13 14:54:48 +02:00
Alexandre Dulaunoy
0c8d517366
Merge pull request #188 from JakubOnderka/office365-cn
...
chg: [microsoft-office365-cn] Update to latest version
2021-06-13 07:36:08 +02:00
7dfdb1dbaf
chg: [microsoft-office365-cn] Update to latest version
2021-06-12 18:38:05 +02:00
d66a51e537
new: [crl] Genreate domains and IPs directly from Mozilla intermediate list
2021-06-12 11:28:13 +02:00
8f2691535b
fix: [mozilla-IntermediateCA] Typo
2021-06-10 17:57:35 +02:00
c9320d8ca9
new: [google-gmail-sending-ips] Add generator and update to latest version
2021-06-10 16:26:26 +02:00
14ee657daf
new: [google-gcp] Add generator and update to latest version
2021-06-10 16:07:29 +02:00
a6c3455944
new: [azure] List for Azure China, Germany and US Gov cloud
2021-06-10 11:15:32 +02:00
104bf6883f
new: [second-level-tlds] Add generator and update to latest version
2021-06-10 10:36:57 +02:00
aee9919ac4
fix: [moz] Moz is not Mozilla
2021-06-10 10:02:20 +02:00
8a2c3dc760
fix: [publicdns] IP addresses should be cidr
2021-06-10 09:59:04 +02:00
08a0a32813
generate-stackpath.py: Added scraper on website to get new link for ipblocks.txt file
2021-06-02 14:51:58 +02:00
Alexandre Dulaunoy
329092675a
new: [tools] simple python script to generate the list of warning-lists
...
in Markdown
2021-05-01 10:59:07 +02:00
Alexandre Dulaunoy
16313352e2
chg: [tools] fix the link for the documentation generator
2021-05-01 10:32:52 +02:00
Alexandre Dulaunoy
9f426c8099
chg: [stackpath] host IPv6 addresses are without subnet
2021-04-21 16:42:55 +02:00
68666c298e
Gave execute permissions to generate_phone_numbers.py
2021-04-21 12:10:30 +02:00
37bc01ae21
Created new Stackpath CDN IP list
2021-04-21 12:09:59 +02:00
b2ed7f766b
fix: python 3.9 compat, take 2
2020-11-24 18:49:43 +01:00
46fd402d43
fix: python 3.9 compat
2020-11-24 18:47:20 +01:00
7154bfc01f
add: A few more phone numbers regexes
2020-10-31 22:06:20 +01:00
6d49d3386f
add: Added regexes for the american fictitious numbers in the list
2020-10-30 23:29:18 +01:00
8a629209f2
chg: Changed name to be displayed as warning and description
2020-10-27 11:19:05 +01:00
a50c06c9eb
chg: Turned the regexes for audiovisual works into a single one
2020-10-27 10:38:45 +01:00
543406dff4
add: New Warninglist for phone numbers that should never be attributed
...
- First examples filling the list of regexes: the
phone numbers used for audiovisual works, or
the communications companies internal numbers.
Those phone numbers are reserved and should
never be given to any user
- We'll add as well the numbers reserved for the
american audiovisual works soon
2020-10-27 04:03:44 +01:00
14fc1e9cf0
Adding replacement for wildcard and dash inputs
2020-09-30 15:43:57 -04:00
7e0e72bb5c
Changed matching algorithm to string
2020-09-23 15:58:03 -04:00
e121ff3925
Changed matching algorithm to string
2020-09-23 15:47:49 -04:00
365fb4c00e
Changed matching algorithm to string
2020-09-23 15:46:41 -04:00
7c1de70ce0
Changed matching algorithm to string
...
Example for a dangerous entry: dropbox.com with the hostname algorithm and url as a valid attribute type means that https://dropbox.com/malicious/files.exe would get excluded from the automation systems when using the warninglist.
I've changed the algorithm to full string matches.
2020-09-16 00:27:03 +02:00
a9c163ef20
Refactor last scripts, logging, central directory for downloads
...
* Refactored generate_moz-top50.py
* Download all file to new /tmp file to centralize all downloads
* Add central logging to generators.log file
* Create Bash script that generates all warninglists
* Add /tmp folder and extra files to .gitignore
* Start adding exception handling in download_to_file and write_to_file
2020-07-27 10:44:30 +02:00
610292e90f
Refactor more generators
2020-07-21 13:42:50 +02:00
temperatestage
Alexandre Dulaunoy