Commit Graph

146 Commits (hardcoreslacker-patch-1)

Author SHA1 Message Date
Dion Akkerman 0d32a4c5e6 Fix typo in digitalside description 2024-07-22 10:21:04 +02:00
Alexandre Dulaunoy 738861342e
fix: [public-dns] filter out non-domain related fields
Fix #275 as reported by @cgrangerdc
2024-06-15 04:25:16 +02:00
Alexandre Dulaunoy b9519496da
chg: [tools publicdns] add missing composite attribute type 2024-06-15 03:45:20 +02:00
Jeroen Pinoy e48c2539c2 chg: Add ip-src|dst and ip-dst|port as matching attr types to cidr lists 2024-04-22 09:20:14 +02:00
Alexandre Dulaunoy e9efbff3d5
new: [warning-lists] add the check-host.net source of IP addresses 2024-04-02 14:32:29 +02:00
Alexandre Dulaunoy fc012367ec
new: [cisco umbrella block pages] hostname, IPv4 and IPv6 addresses
some minor clean-up and final update
2023-08-25 16:11:41 +02:00
LaZyDK 8892893d9b Initial commit 2023-08-25 09:55:52 +02:00
Alexandre Dulaunoy 07a1e66092
new: [zscaler] Zscaler IP addresses added
Thanks to Remi Akintonde for the idea
2023-08-10 13:44:06 +02:00
Alexandre Dulaunoy 495b629d08
new: [openai chatgpt] OpenAI source bot added 2023-08-08 11:45:53 +02:00
Alexandre Dulaunoy 11101527c0
chg: [tools] CRL tool updated to support latest version of dnspython
Add exception handling for some CRL (in China) returning incorrect DNS
response from their authoritative servers.
2023-07-28 10:55:30 +02:00
Davide fdbfb29eba Added DigitalSide.IT warninglist (false positive detection) 2023-06-22 15:34:20 +02:00
Alexandre Dulaunoy 925b3f30ef
chg: [tools] remove debugging 2023-05-11 10:22:50 +02:00
Alexandre Dulaunoy d2bf685e75
chg: [tools] remove debugging 2023-05-11 10:22:13 +02:00
Hendrik Baecker bcbb51d50e Added google bot updater + list 2023-04-05 14:33:08 +02:00
csandera d91c41438b generator-vpn.py did not saved the generated list because of incorrect destination folder name 2023-01-10 19:41:59 +01:00
Alexandre Dulaunoy fe923ca1d7
new: [generate-chrome-crux-1m] New generator added for the Cached Chrome Top Million Websites
"Recent research showed that the top million most popular websites published by Google Chrome via their UX Report (CrUX) is significantly more accurate than other top lists like the Alexa Top Million and Tranco Top Million.

This repository caches a CSV version of the Chrome top sites, queried
from the CrUX data in Google BigQuery. You can browse all of the cached
lists here. The most up-to-date top million global websites can be
downloaded directly at:
https://raw.githubusercontent.com/zakird/crux-top-lists/main/data/global/current.csv.gz."

Ref: https://github.com/zakird/crux-top-lists
2023-01-02 11:18:35 +01:00
Alexandre Dulaunoy 811869148f
chg: [generator] add an option to handle gzip file
- It doesn't change the default behavior assuming it's a non-gzip file
- If the `gzip_enable` is set to `True` then the destination file is uncompressed
2023-01-02 11:16:49 +01:00
Jakub Onderka d4845c59fe
fix: [microsoft-azure-appid] Correct type 2022-12-01 13:38:11 +00:00
Alexandre Dulaunoy 917e009e27
fix: [tools] typo fixed 2022-12-01 11:32:27 +01:00
temperatestage a9386a4b42
Create generate-microsoft-azure-appid.py 2022-11-18 23:03:50 +11:00
David Cruciani 3adfc0e309 fix: [generator] remove header 2022-10-13 08:19:33 +02:00
David Cruciani 49922d0635 chg: [majestic_million] numbers parameter 2022-10-10 15:51:11 +02:00
Alexandre Dulaunoy 14d19fa58f
Merge pull request #226 from jberkers42/jberkers42-tenable
Add generator script for Tenable
2022-10-05 15:52:48 +02:00
John Berkers 3069e9ab00 Add generator script for Tenable 2022-10-05 18:03:03 +11:00
Alexandre Dulaunoy 70733ad25b
chg: [dns] add 1.1.1.1 as golden 2022-09-09 16:22:54 +02:00
Alexandre Dulaunoy 3e8138338e
chg: [tools] vpn generation updated following the removal of
github.com/ejrv/VPNs
2022-09-01 10:49:26 +02:00
Alexandre Dulaunoy cd1baa3de5
fix: [public-dns] Update the public-dns generator to remove non valid hostnames
Fix reported issue #214
2022-08-16 08:26:14 +02:00
John Berkers 8ea33dd725 Update StackPatch ipblocks URL 2022-08-16 11:42:09 +10:00
Alexandre Dulaunoy cbb5c8f6a7
chg: [tools] fix generate vpn uri 2022-03-31 13:47:25 +02:00
Loïc Jaquemet f974c15776
VPN list is outdated
github.com/ejrv/VPNs/ has not been refreshed in 24 months.
https://github.com/X4BNet/lists_vpn/ seems to have replicated that effort for ipv4. No new source found for ipv6
Pros:
- Code for generation is in repository

Cons:
- Unsure about quality. Lots of ASN as source of data.
- No IPV6 data

Comparable open source sources:
- Firehol https://github.com/firehol/blocklist-ipsets / datacenter.ipset . Source data (https://github.com/client9/ipcat) is outdated from 2019
- https://github.com/jhassine/server-ip-addresses limited provider list
- https://incolumitas.com/pages/Datacenter-IP-API/ API, smaller list

Others sources seem commercial (Udger, securitytrails)
2022-03-30 09:41:37 -06:00
Alexandre Dulaunoy e72f112dfb
chg: [generator] logging updated 2022-02-01 16:52:09 +01:00
Alexandre Dulaunoy 697aec2821
fix: [stackpath] now a txt file is included on the stackpath 2022-01-04 15:45:01 +01:00
Alexandre Dulaunoy 40b8d3834a
chg: [[publicdns] update the golden list 2021-09-23 10:50:09 +02:00
Jakub Onderka 5687ebf976 new: Include dnscrypt-resolvers IP addresses to public-dns lists 2021-09-15 11:44:51 +02:00
Alexandre Dulaunoy d68a78085c
chg: [tools] add golden IPv4 DNS server in the generate-publicdns.py script
One of the source is regularly dropping 9.9.9.9 as a source of
publicdns. This additional list can be used to ensure these known golden
DNS public resolver are there.
2021-07-13 09:21:21 +02:00
Jakub Onderka 00d5e40ac1 new: List of known SMTP receiving IP addresses 2021-06-14 23:26:44 +02:00
Jakub Onderka e7401c9cbe new: List of known SMTP sending IP ranges 2021-06-14 23:09:39 +02:00
Jakub Onderka 6c9eff2dcc new: Generator for Akamai 2021-06-13 15:48:55 +02:00
Jakub Onderka 98f7390e88 chg: [cidr] Consolidate CIDR networks 2021-06-13 14:54:48 +02:00
Alexandre Dulaunoy 0c8d517366
Merge pull request #188 from JakubOnderka/office365-cn
chg: [microsoft-office365-cn] Update to latest version
2021-06-13 07:36:08 +02:00
Jakub Onderka 7dfdb1dbaf chg: [microsoft-office365-cn] Update to latest version 2021-06-12 18:38:05 +02:00
Jakub Onderka d66a51e537 new: [crl] Genreate domains and IPs directly from Mozilla intermediate list 2021-06-12 11:28:13 +02:00
Jakub Onderka 8f2691535b fix: [mozilla-IntermediateCA] Typo 2021-06-10 17:57:35 +02:00
Jakub Onderka c9320d8ca9 new: [google-gmail-sending-ips] Add generator and update to latest version 2021-06-10 16:26:26 +02:00
Jakub Onderka 14ee657daf new: [google-gcp] Add generator and update to latest version 2021-06-10 16:07:29 +02:00
Jakub Onderka a6c3455944 new: [azure] List for Azure China, Germany and US Gov cloud 2021-06-10 11:15:32 +02:00
Jakub Onderka 104bf6883f new: [second-level-tlds] Add generator and update to latest version 2021-06-10 10:36:57 +02:00
Jakub Onderka aee9919ac4 fix: [moz] Moz is not Mozilla 2021-06-10 10:02:20 +02:00
Jakub Onderka 8a2c3dc760 fix: [publicdns] IP addresses should be cidr 2021-06-10 09:59:04 +02:00
Kevin Holvoet 08a0a32813 generate-stackpath.py: Added scraper on website to get new link for ipblocks.txt file 2021-06-02 14:51:58 +02:00