Warning lists to inform users of MISP about potential false-positives or other information in indicators

forensics misp network threat-intelligence threat-sharing warning-lists warninglists

Go to file

Alexandre Dulaunoy 43e82c6b25 Merge pull request #69 from raw-data/master [ADD] new domains for whats-my-ip section and url-shortener section		2018-05-27 17:08:35 +02:00
lists	[ADD] 1 new domain for url-shortener section	2018-05-27 15:54:00 +01:00
tools	…
.travis.yml	…
README.md	Add reference to PyMISPWarningLists	2018-05-09 09:05:58 +02:00
jq_all_the_things.sh	…
schema.json	…
validate_all.sh	…

README.md

misp-warninglist

misp-warninglists are lists of well-known indicators that can be associated to potential false positives, errors or mistakes.

The warning lists are integrated in MISP to display an info/warning box at the event and attribute level if such indicators are available in one of the list. The list can be globally enabled or disabled in MISP following the practices of the organization.

lists

lists/alexa - Top 1000 websites from Alexa
lists/amazon-aws - Known Amazon AWS IP address ranges
lists/automated-malware-analysis - known domains used by automated malware analysis services
lists/eicar.com - hashes for EICAR test virus
lists/empty-hashes - hash values of empty files
lists/google - known domains and hostnames from Google
lists/ipv6-linklocal - IPv6 link local prefix
lists/microsoft - known Microsoft domains
lists/microsoft-azure - known Microsoft Azure Datacenter IP Ranges
lists/microsoft-office365 - known Office 365 URLs and IP address ranges
lists/microsoft-office365-cn - known Office 365 IP address ranges in China
lists/multicast - known IPv4 multicast CIDR blocks
lists/ovh-cluster - List of known OVH Cluster IP
lists/public-dns-v4 - IPv4 addresses and reverse of public DNS resolver
lists/public-dns-v6 - IPv6 addresses and reverse of public DNS resolver
lists/rfc1918 - RFC 1918 network subnets
lists/rfc3849 - RFC 3849 - Documentation prefix for ipv6
lists/rfc5735 - RFC 5735 CIDR blocks - Special Use IPv4 Addresses
lists/rfc6598 - RFC 6598 IANA-Reserved IPv4 Prefix for Shared Address Space (Carrier- Grade NAT (CGN) devices)
lists/rfc6761 - RFC 6761 Special-Use Domain Names
lists/security-provider-blogpost - Security providers or vendors blog domains
lists/second-level-tlds - Mozilla list of second level top-level domains
lists/tlds - top-level domains
lists/whats-my-ip - "What's my IP" service
lists/url-shortener - URL shorteners services

Format of a warning list

{
  "name": "List of known public DNS resolvers",
  "version": 1,
  "description": "Event contains one or more public DNS resolvers as attribute with an IDS flag set",
  "matching_attributes": [
    "ip-src",
    "ip-dst"
  ],
  "list": [
    "8.8.8.8",
    "8.8.4.4",
    "208.67.222.222",
    "208.67.220.220",
    "195.46.39.39",
    "195.46.39.40"
  ]
}

If matching_attributes are not set, the list is matched against any type of attributes.

type of warning list

string (default) - perfect match of a string in the warning list against matching attributes
substring - substring matching of a string in the warning list against matching attributes
hostname - hostname matching (e.g. domain matching from URL) of a string in the warning list against matching attributes
cidr - IP or CDIR block matching in the warning list against matching attributes
regex - regex matching of a string matching attributes

Processing warning lists in python

See PyMISPWarningLists for a python interface to warning lists.

License

MISP warning-lists are licensed under CC0 1.0 Universal (CC0 1.0) - Public Domain Dedication. If a specific author of a taxonomy wants to license it under a different license, a pull request can be requested.