From d6fa8078ddb36ea30699d267fad1ca4184b891ee Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sat, 22 Sep 2018 10:25:09 +0200 Subject: [PATCH 01/30] chg: [misp-galaxy] RFC text export added --- misp-galaxy-format/raw.md.txt | 232 +++++++++++++++++++++------------- 1 file changed, 144 insertions(+), 88 deletions(-) diff --git a/misp-galaxy-format/raw.md.txt b/misp-galaxy-format/raw.md.txt index 6e81e0b..eb73b92 100755 --- a/misp-galaxy-format/raw.md.txt +++ b/misp-galaxy-format/raw.md.txt @@ -5,8 +5,8 @@ Network Working Group A. Dulaunoy Internet-Draft A. Iklody Intended status: Informational D. Servili -Expires: October 3, 2018 CIRCL - April 1, 2018 +Expires: March 24, 2019 CIRCL + September 20, 2018 MISP galaxy format @@ -38,7 +38,7 @@ Status of This Memo time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on October 3, 2018. + This Internet-Draft will expire on March 24, 2019. Copyright Notice @@ -53,9 +53,9 @@ Copyright Notice -Dulaunoy, et al. Expires October 3, 2018 [Page 1] +Dulaunoy, et al. Expires March 24, 2019 [Page 1] -Internet-Draft MISP galaxy format April 2018 +Internet-Draft MISP galaxy format September 2018 to this document. Code Components extracted from this document must @@ -73,7 +73,7 @@ Table of Contents 2.3. related . . . . . . . . . . . . . . . . . . . . . . . . . 3 2.4. meta . . . . . . . . . . . . . . . . . . . . . . . . . . 4 3. JSON Schema . . . . . . . . . . . . . . . . . . . . . . . . . 7 - 3.1. MISP galaxy format - clusters . . . . . . . . . . . . . . 7 + 3.1. MISP galaxy format - clusters . . . . . . . . . . . . . . 8 4. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 11 5. References . . . . . . . . . . . . . . . . . . . . . . . . . 11 5.1. Normative References . . . . . . . . . . . . . . . . . . 11 @@ -109,9 +109,9 @@ Table of Contents -Dulaunoy, et al. Expires October 3, 2018 [Page 2] +Dulaunoy, et al. Expires March 24, 2019 [Page 2] -Internet-Draft MISP galaxy format April 2018 +Internet-Draft MISP galaxy format September 2018 2. Format @@ -165,9 +165,9 @@ Internet-Draft MISP galaxy format April 2018 -Dulaunoy, et al. Expires October 3, 2018 [Page 3] +Dulaunoy, et al. Expires March 24, 2019 [Page 3] -Internet-Draft MISP galaxy format April 2018 +Internet-Draft MISP galaxy format September 2018 present. The type is represented as a string and MUST be present and @@ -187,15 +187,17 @@ Internet-Draft MISP galaxy format April 2018 2.4. meta Meta contains a list of custom defined JSON key value pairs. Users - SHOULD reuse commonly used keys such as properties, complexity, - effectiveness, country, possible_issues, colour, motive, impact, - refs, synonyms, status, date, encryption, extensions, ransomnotes, - cfr-suspected-victims, cfr-suspected-state-sponsor, cfr-type-of- - incident, cfr-target-category wherever applicable. + SHOULD reuse commonly used keys such as complexity, effectiveness, + country, possible_issues, colour, motive, impact, refs, synonyms, + status, date, encryption, extensions, ransomnotes, suspected-victims, + suspected-state-sponsor, type-of-incident, target-category, cfr- + suspected-victims, cfr-suspected-state-sponsor, cfr-type-of-incident, + cfr-target-category wherever applicable. - properties is used to provide clusters with additional properties. - Properties are represented as an array containing one or more strings - ans MAY be present. + refs, synonyms SHALL be used to give further informations. refs is + represented as an array containing one or more strings and SHALL be + present. synonyms is represented as an array containing one or more + strings and SHALL be present. date, status MAY be used to give time information about an cluster. date is represented as a string describing a time or period and SHALL @@ -216,16 +218,17 @@ Internet-Draft MISP galaxy format April 2018 enumerated value from a fixed vocabulary and SHALL be present. possible_issues is represented as a string and SHOULD be present. + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 4] + +Internet-Draft MISP galaxy format September 2018 + + Example use of the complexity, effectiveness, impact, possible_issues fields in the preventive-measure galaxy: - - -Dulaunoy, et al. Expires October 3, 2018 [Page 4] - -Internet-Draft MISP galaxy format April 2018 - - { "meta": { "refs": [ @@ -271,17 +274,16 @@ Internet-Draft MISP galaxy format April 2018 encryption, extensions, ransomnotes MAY be used to give further information in ransomware galaxy. encryption is represented as a + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 5] + +Internet-Draft MISP galaxy format September 2018 + + string and SHALL be present. extensions is represented as an array containing one or more strings and SHALL be present. ransomnotes is - - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 5] - -Internet-Draft MISP galaxy format April 2018 - - represented as an array containing one or more strings ans SHALL be present. @@ -327,23 +329,28 @@ Internet-Draft MISP galaxy format April 2018 "value": "menuPass (G0045) uses EvilGrab (S0152)" } + + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 6] + +Internet-Draft MISP galaxy format September 2018 + + cfr-suspected-victims, cfr-suspected-state-sponsor, cfr-type-of- incident and cfr-target-category MAY be used to report information gathered from CFR's (Council on Foreign Relations) [CFR] Cyber - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 6] - -Internet-Draft MISP galaxy format April 2018 - - Operations Tracker. cfr-suspected-victims is represented as an array containing one or more strings and SHALL be present. cfr-suspected- state-sponsor is represented as a string and SHALL be present. cfr- - type-of-incident is represented as a string and SHALL be present. - cfr-target-category is represented as an array containing one or more - strings ans SHALL be present. + type-of-incident is represented as a string or an array and SHALL be + present. RECOMMENDED but not exhaustive list of possible values for + cfr-type-of-incident includes "Espionage", "Denial of service", + "Sabotage". cfr-target-category is represented as an array containing + one or more strings ans SHALL be present. RECOMMENDED but not + exhaustive list of possible values for cfr-target-category includes + "Private sector", "Government", "Civil society", "Military". Example use of the cfr-suspected-victims, cfr-suspected-state- sponsor, cfr-type-of-incident, cfr-target-category fields in the @@ -376,6 +383,17 @@ Internet-Draft MISP galaxy format April 2018 formats. The main format is the MISP galaxy format used for the clusters. + + + + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 7] + +Internet-Draft MISP galaxy format September 2018 + + 3.1. MISP galaxy format - clusters { @@ -386,14 +404,6 @@ Internet-Draft MISP galaxy format April 2018 "additionalProperties": false, "properties": { "description": { - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 7] - -Internet-Draft MISP galaxy format April 2018 - - "type": "string" }, "type": { @@ -432,6 +442,14 @@ Internet-Draft MISP galaxy format April 2018 "additionalProperties": false, "items": { "type": "object" + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 8] + +Internet-Draft MISP galaxy format September 2018 + + }, "properties": { "dest-uuid": { @@ -442,14 +460,6 @@ Internet-Draft MISP galaxy format April 2018 }, "tags": { "type": "array", - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 8] - -Internet-Draft MISP galaxy format April 2018 - - "uniqueItems": true, "items": { "type": "string" @@ -488,6 +498,14 @@ Internet-Draft MISP galaxy format April 2018 }, "impact": { "type": "string" + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 9] + +Internet-Draft MISP galaxy format September 2018 + + }, "refs": { "type": "array", @@ -498,14 +516,6 @@ Internet-Draft MISP galaxy format April 2018 }, "synonyms": { "type": "array", - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 9] - -Internet-Draft MISP galaxy format April 2018 - - "uniqueItems": true, "items": { "type": "string" @@ -544,6 +554,14 @@ Internet-Draft MISP galaxy format April 2018 }, "authors": { "type": "array", + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 10] + +Internet-Draft MISP galaxy format September 2018 + + "uniqueItems": true, "items": { "type": "string" @@ -554,14 +572,6 @@ Internet-Draft MISP galaxy format April 2018 "description", "type", "version", - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 10] - -Internet-Draft MISP galaxy format April 2018 - - "name", "uuid", "values", @@ -600,6 +610,14 @@ Internet-Draft MISP galaxy format April 2018 Relations", 2018, . + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 11] + +Internet-Draft MISP galaxy format September 2018 + + [JSON-SCHEMA] "JSON Schema: A Media Type for Describing JSON Documents", 2016, @@ -608,16 +626,6 @@ Internet-Draft MISP galaxy format April 2018 [MISP-G] MISP, "MISP Galaxy - Public Repository", . - - - - - -Dulaunoy, et al. Expires October 3, 2018 [Page 11] - -Internet-Draft MISP galaxy format April 2018 - - [MISP-G-DOC] MISP, "MISP Galaxy - Documentation of the Public Repository", . @@ -651,6 +659,21 @@ Authors' Addresses Email: andras.iklody@circl.lu + + + + + + + + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 12] + +Internet-Draft MISP galaxy format September 2018 + + Deborah Servili Computer Incident Response Center Luxembourg 16, bd d'Avranches @@ -669,4 +692,37 @@ Authors' Addresses -Dulaunoy, et al. Expires October 3, 2018 [Page 12] + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Dulaunoy, et al. Expires March 24, 2019 [Page 13] From e5d87ab4e35382be1b72eadb802f288b945323c8 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Thu, 27 Sep 2018 09:06:36 +0200 Subject: [PATCH 02/30] chg: [misp-galaxy] Internet-Draft published as 05 --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 959a05d..605a0ba 100755 --- a/README.md +++ b/README.md @@ -11,7 +11,7 @@ All the formats can be freely reused by everyone. * [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [04](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) * [misp-taxonomy-format](misp-taxonomy-format/raw.md.txt) ([markdown source](misp-taxonomy-format/raw.md)) which describes the taxonomy JSON format of MISP. Current Internet-Draft: [05](https://tools.ietf.org/html/draft-dulaunoy-misp-taxonomy-format) -* [misp-galaxy-format](misp-galaxy-format/raw.md.txt) which describes the [galaxy](https://github.com/MISP/misp-galaxy) template format used to expand the threat actor modelling of MISP. Current Internet-Draft: [04](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-galaxy-format/) +* [misp-galaxy-format](misp-galaxy-format/raw.md.txt) which describes the [galaxy](https://github.com/MISP/misp-galaxy) template format used to expand the threat actor modelling of MISP. Current Internet-Draft: [05](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-galaxy-format/) * [misp-object-template-format](misp-object-template-format/raw.md.txt) which describes the [object](https://github.com/MISP/misp-objects) template format to add combinedand composite object to the MISP core format. Current Internet-Draft: [01](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-object-template-format/) ## MISP Format in design phase and implemented in at least one software prototype From b5013640886bc27b5d690e24ef02184b37134021 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 7 Oct 2018 10:26:11 +0200 Subject: [PATCH 03/30] chg: [misp-core-format] fix title section for the references --- misp-core-format/raw.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index 79cedcf..43f7537 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -1822,7 +1822,7 @@ The authors wish to thank all the MISP community who are supporting the creation of open standards in threat intelligence sharing. A special thank to Nicolas Bareil for the review of the JSON Schema. -# Sample MISP file +# References From bc35cf0030cc0d161122db8b37deca001fbf0efd Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 7 Oct 2018 11:23:53 +0200 Subject: [PATCH 04/30] add: [misp-query-format] WiP first introduction and general skeleton --- misp-query-format/Makefile | 9 + misp-query-format/raw.md | 152 ++++++++ misp-query-format/raw.md.html | 652 ++++++++++++++++++++++++++++++++++ misp-query-format/raw.md.txt | 280 +++++++++++++++ misp-query-format/raw.md.xml | 163 +++++++++ 5 files changed, 1256 insertions(+) create mode 100644 misp-query-format/Makefile create mode 100755 misp-query-format/raw.md create mode 100644 misp-query-format/raw.md.html create mode 100644 misp-query-format/raw.md.txt create mode 100644 misp-query-format/raw.md.xml diff --git a/misp-query-format/Makefile b/misp-query-format/Makefile new file mode 100644 index 0000000..210eb88 --- /dev/null +++ b/misp-query-format/Makefile @@ -0,0 +1,9 @@ +MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page + +docs = $(wildcard *.md) + +all: $(docs) + $(MMARK) $< > $<.xml + xml2rfc --text $<.xml + xml2rfc --html $<.xml + diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md new file mode 100755 index 0000000..7cfa0bc --- /dev/null +++ b/misp-query-format/raw.md @@ -0,0 +1,152 @@ +% Title = "MISP query format" +% abbrev = "MISP query format" +% category = "info" +% docName = "draft-dulaunoy-misp-core-format" +% ipr= "trust200902" +% area = "Security" +% +% date = 2018-10-08T00:00:00Z +% +% [[author]] +% initials="A." +% surname="Dulaunoy" +% fullname="Alexandre Dulaunoy" +% abbrev="CIRCL" +% organization = "Computer Incident Response Center Luxembourg" +% [author.address] +% email = "alexandre.dulaunoy@circl.lu" +% phone = "+352 247 88444" +% [author.address.postal] +% street = "16, bd d'Avranches" +% city = "Luxembourg" +% code = "L-1160" +% country = "Luxembourg" +% [[author]] +% initials="A." +% surname="Iklody" +% fullname="Andras Iklody" +% abbrev="CIRCL" +% organization = "Computer Incident Response Center Luxembourg" +% [author.address] +% email = "andras.iklody@circl.lu" +% phone = "+352 247 88444" +% [author.address.postal] +% street = "16, bd d'Avranches" +% city = "Luxembourg" +% code = "L-1160" +% country = "Luxembourg" + +.# Abstract + +This document describes the MISP query format used to search MISP (Malware Information and threat Sharing Platform) [@?MISP-P] threat intelligence instances. +MISP query format is a simple format used to query MISP instances over a REST (Representational State Transfer ) interface. +The query format includes the JSON format to describe the query and the minimal API access to perform the query. The JSON format includes the overall structure along with the semantic associated for each respective key. The goal of the format is to query MISP threat intelligence instances can feed and integrate with network security devices (such as firewall, network intrusion detection system, routers, SIEMs), endpoint security devices or monitoring devices. + +{mainmatter} + +# Introduction + +Sharing threat information became a fundamental requirements in the Internet, security and intelligence community at large. Threat +information can include indicators of compromise, malicious file indicators, financial fraud indicators +or even detailed information about a threat actor. MISP [@?MISP-P] started as an open source project in late 2011 and +the MISP format started to be widely used as an exchange format within the community in the past years. The core format +is described in an Internet-Draft as misp-core-format [@?MISP-C] and contain the standard MISP JSON format used for threat +intelligence. + +The aim of this document is to describe the specification of the MISP query format and how the query can be perform against a REST interface. + +## Conventions and Terminology + +The key words "**MUST**", "**MUST NOT**", "**REQUIRED**", "**SHALL**", "**SHALL NOT**", +"**SHOULD**", "**SHOULD NOT**", "**RECOMMENDED**", "**MAY**", and "**OPTIONAL**" in this +document are to be interpreted as described in RFC 2119 [@!RFC2119]. + +# Format + +## Overview + +The MISP query format is in the JSON [@!RFC4627] format. + + +## query format criteria + +### returnFormat + +returnFormat **MUST** be present. returnFormat sets the type of output format. MISP allows multiple format (depending of the configuration): + +| value | Description | +|---------------|:-------------------------------------------------------------------------:| +| json | MISP JSON core format as described in [@?MISP-C] | +| xml | MISP XML format | +| openioc | OpenIOC format | +| suricata | Suricata NIDS format | +| snort | Snort NIDS format | +| csv | CSV format | + +### limit + +### page + +### value + +### type + +### category + + +# Security Considerations + +MISP threat intelligence instances might contain sensitive or confidential information. Adequate access control and encryption measures shall be implemented to ensure the confidentiality of the threat intelligence. + +Adversaries might include malicious content in MISP queries. Implementation **MUST** consider the input of malicious inputs beside the +standard threat information that might already include malicious intended inputs. + +# Acknowledgements + +The authors wish to thank all the MISP community who are supporting the creation +of open standards in threat intelligence sharing. A special thank to all the committees which +triggered us to come with better and flexible format. + + + + + MISP Project - Malware Information Sharing Platform and Threat Sharing + + + + + + + + MISP core format + + + + + + + + MISP Taxonomies - shared and common vocabularies of tags + + + + + + + + MISP Object Relationship Types - common vocabulary of relationships + + + + + + + + JSON Schema: A Media Type for Describing JSON Documents + + + + + + +{backmatter} diff --git a/misp-query-format/raw.md.html b/misp-query-format/raw.md.html new file mode 100644 index 0000000..cbaa4d3 --- /dev/null +++ b/misp-query-format/raw.md.html @@ -0,0 +1,652 @@ + + + + + + + MISP query format + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Network Working GroupA. Dulaunoy
Internet-DraftA. Iklody
Intended status: InformationalCIRCL
Expires: April 11, 2019October 8, 2018
+ +

MISP query format
+ draft-dulaunoy-misp-core-format

+ +

Abstract

+

This document describes the MISP query format used to search MISP (Malware Information and threat Sharing Platform) [MISP-P] threat intelligence instances. MISP query format is a simple format used to query MISP instances over a REST (Representational State Transfer ) interface. The query format includes the JSON format to describe the query and the minimal API access to perform the query. The JSON format includes the overall structure along with the semantic associated for each respective key. The goal of the format is to query MISP threat intelligence instances can feed and integrate with network security devices (such as firewall, network intrusion detection system, routers, SIEMs), endpoint security devices or monitoring devices.

+

Status of This Memo

+

This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

+

Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at https://datatracker.ietf.org/drafts/current/.

+

Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

+

This Internet-Draft will expire on April 11, 2019.

+

Copyright Notice

+

Copyright (c) 2018 IETF Trust and the persons identified as the document authors. All rights reserved.

+

This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License.

+ + +
+

Table of Contents

+ + +

+1. Introduction +

+

Sharing threat information became a fundamental requirements in the Internet, security and intelligence community at large. Threat information can include indicators of compromise, malicious file indicators, financial fraud indicators or even detailed information about a threat actor. MISP [MISP-P] started as an open source project in late 2011 and the MISP format started to be widely used as an exchange format within the community in the past years. The core format is described in an Internet-Draft as misp-core-format [MISP-C] and contain the standard MISP JSON format used for threat intelligence.

+

The aim of this document is to describe the specification of the MISP query format and how the query can be perform against a REST interface.

+

+1.1. Conventions and Terminology +

+

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119 [RFC2119].

+

+2. Format +

+

+2.1. Overview +

+

The MISP query format is in the JSON [RFC4627] format.

+

+2.2. query format criteria +

+

+2.2.1. returnFormat +

+

returnFormat MUST be present. returnFormat sets the type of output format. MISP allows multiple format (depending of the configuration):

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
valueDescription
jsonMISP JSON core format as described in [MISP-C] +
xmlMISP XML format
openiocOpenIOC format
suricataSuricata NIDS format
snortSnort NIDS format
csvCSV format
+

+2.2.2. limit +

+

+2.2.3. page +

+

+2.2.4. value +

+

+2.2.5. type +

+

+2.2.6. category +

+

+3. Security Considerations +

+

MISP threat intelligence instances might contain sensitive or confidential information. Adequate access control and encryption measures shall be implemented to ensure the confidentiality of the threat intelligence.

+

Adversaries might include malicious content in MISP queries. Implementation MUST consider the input of malicious inputs beside the standard threat information that might already include malicious intended inputs.

+

+4. Acknowledgements +

+

The authors wish to thank all the MISP community who are supporting the creation of open standards in threat intelligence sharing. A special thank to all the committees which triggered us to come with better and flexible format.

+

+5. References

+

+5.1. Normative References

+ + + + + + + + + +
[RFC2119] +Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997.
[RFC4627] +Crockford, D., "The application/json Media Type for JavaScript Object Notation (JSON)", RFC 4627, DOI 10.17487/RFC4627, July 2006.
+

+5.2. Informative References

+ + + + + + + + + +
[MISP-C] +MISP, "MISP core format"
[MISP-P] +MISP, "MISP Project - Malware Information Sharing Platform and Threat Sharing"
+

Authors' Addresses

+
+
+ + Alexandre Dulaunoy + + + Computer Incident Response Center Luxembourg + + 16, bd d'Avranches + + + Luxembourg, + + L-1160 + + Luxembourg + + Phone: +352 247 88444 + +EMail: alexandre.dulaunoy@circl.lu + +
+
+
+ + Andras Iklody + + + Computer Incident Response Center Luxembourg + + 16, bd d'Avranches + + + Luxembourg, + + L-1160 + + Luxembourg + + Phone: +352 247 88444 + +EMail: andras.iklody@circl.lu + +
+
+ + + diff --git a/misp-query-format/raw.md.txt b/misp-query-format/raw.md.txt new file mode 100644 index 0000000..ddcb824 --- /dev/null +++ b/misp-query-format/raw.md.txt @@ -0,0 +1,280 @@ + + + + +Network Working Group A. Dulaunoy +Internet-Draft A. Iklody +Intended status: Informational CIRCL +Expires: April 11, 2019 October 8, 2018 + + + MISP query format + draft-dulaunoy-misp-core-format + +Abstract + + This document describes the MISP query format used to search MISP + (Malware Information and threat Sharing Platform) [MISP-P] threat + intelligence instances. MISP query format is a simple format used to + query MISP instances over a REST (Representational State Transfer ) + interface. The query format includes the JSON format to describe the + query and the minimal API access to perform the query. The JSON + format includes the overall structure along with the semantic + associated for each respective key. The goal of the format is to + query MISP threat intelligence instances can feed and integrate with + network security devices (such as firewall, network intrusion + detection system, routers, SIEMs), endpoint security devices or + monitoring devices. + +Status of This Memo + + This Internet-Draft is submitted in full conformance with the + provisions of BCP 78 and BCP 79. + + Internet-Drafts are working documents of the Internet Engineering + Task Force (IETF). Note that other groups may also distribute + working documents as Internet-Drafts. The list of current Internet- + Drafts is at https://datatracker.ietf.org/drafts/current/. + + Internet-Drafts are draft documents valid for a maximum of six months + and may be updated, replaced, or obsoleted by other documents at any + time. It is inappropriate to use Internet-Drafts as reference + material or to cite them other than as "work in progress." + + This Internet-Draft will expire on April 11, 2019. + +Copyright Notice + + Copyright (c) 2018 IETF Trust and the persons identified as the + document authors. All rights reserved. + + This document is subject to BCP 78 and the IETF Trust's Legal + Provisions Relating to IETF Documents + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 1] + +Internet-Draft MISP query format October 2018 + + + (https://trustee.ietf.org/license-info) in effect on the date of + publication of this document. Please review these documents + carefully, as they describe your rights and restrictions with respect + to this document. Code Components extracted from this document must + include Simplified BSD License text as described in Section 4.e of + the Trust Legal Provisions and are provided without warranty as + described in the Simplified BSD License. + +Table of Contents + + 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 + 1.1. Conventions and Terminology . . . . . . . . . . . . . . . 3 + 2. Format . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.1. Overview . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.2. query format criteria . . . . . . . . . . . . . . . . . . 3 + 2.2.1. returnFormat . . . . . . . . . . . . . . . . . . . . 3 + 2.2.2. limit . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.2.3. page . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.2.4. value . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.2.5. type . . . . . . . . . . . . . . . . . . . . . . . . 3 + 2.2.6. category . . . . . . . . . . . . . . . . . . . . . . 3 + 3. Security Considerations . . . . . . . . . . . . . . . . . . . 3 + 4. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 4 + 5. References . . . . . . . . . . . . . . . . . . . . . . . . . 4 + 5.1. Normative References . . . . . . . . . . . . . . . . . . 4 + 5.2. Informative References . . . . . . . . . . . . . . . . . 4 + Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 4 + +1. Introduction + + Sharing threat information became a fundamental requirements in the + Internet, security and intelligence community at large. Threat + information can include indicators of compromise, malicious file + indicators, financial fraud indicators or even detailed information + about a threat actor. MISP [MISP-P] started as an open source + project in late 2011 and the MISP format started to be widely used as + an exchange format within the community in the past years. The core + format is described in an Internet-Draft as misp-core-format [MISP-C] + and contain the standard MISP JSON format used for threat + intelligence. + + The aim of this document is to describe the specification of the MISP + query format and how the query can be perform against a REST + interface. + + + + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 2] + +Internet-Draft MISP query format October 2018 + + +1.1. Conventions and Terminology + + The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", + "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this + document are to be interpreted as described in RFC 2119 [RFC2119]. + +2. Format + +2.1. Overview + + The MISP query format is in the JSON [RFC4627] format. + +2.2. query format criteria + +2.2.1. returnFormat + + returnFormat MUST be present. returnFormat sets the type of output + format. MISP allows multiple format (depending of the + configuration): + + +----------+------------------------------------------------+ + | value | Description | + +----------+------------------------------------------------+ + | json | MISP JSON core format as described in [MISP-C] | + | xml | MISP XML format | + | openioc | OpenIOC format | + | suricata | Suricata NIDS format | + | snort | Snort NIDS format | + | csv | CSV format | + +----------+------------------------------------------------+ + +2.2.2. limit + +2.2.3. page + +2.2.4. value + +2.2.5. type + +2.2.6. category + +3. Security Considerations + + MISP threat intelligence instances might contain sensitive or + confidential information. Adequate access control and encryption + measures shall be implemented to ensure the confidentiality of the + threat intelligence. + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 3] + +Internet-Draft MISP query format October 2018 + + + Adversaries might include malicious content in MISP queries. + Implementation MUST consider the input of malicious inputs beside the + standard threat information that might already include malicious + intended inputs. + +4. Acknowledgements + + The authors wish to thank all the MISP community who are supporting + the creation of open standards in threat intelligence sharing. A + special thank to all the committees which triggered us to come with + better and flexible format. + +5. References + +5.1. Normative References + + [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate + Requirement Levels", BCP 14, RFC 2119, + DOI 10.17487/RFC2119, March 1997, + . + + [RFC4627] Crockford, D., "The application/json Media Type for + JavaScript Object Notation (JSON)", RFC 4627, + DOI 10.17487/RFC4627, July 2006, + . + +5.2. Informative References + + [MISP-C] MISP, "MISP core format", . + + [MISP-P] MISP, "MISP Project - Malware Information Sharing Platform + and Threat Sharing", . + +Authors' Addresses + + Alexandre Dulaunoy + Computer Incident Response Center Luxembourg + 16, bd d'Avranches + Luxembourg L-1160 + Luxembourg + + Phone: +352 247 88444 + Email: alexandre.dulaunoy@circl.lu + + + + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 4] + +Internet-Draft MISP query format October 2018 + + + Andras Iklody + Computer Incident Response Center Luxembourg + 16, bd d'Avranches + Luxembourg L-1160 + Luxembourg + + Phone: +352 247 88444 + Email: andras.iklody@circl.lu + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 5] diff --git a/misp-query-format/raw.md.xml b/misp-query-format/raw.md.xml new file mode 100644 index 0000000..7761c11 --- /dev/null +++ b/misp-query-format/raw.md.xml @@ -0,0 +1,163 @@ + + + + + + + + + + + + +MISP query format + + +Computer Incident Response Center Luxembourg +
+ +16, bd d'Avranches +Luxembourg +L-1160 +Luxembourg + + ++352 247 88444 +alexandre.dulaunoy@circl.lu + +
+ + +Computer Incident Response Center Luxembourg +
+ +16, bd d'Avranches +Luxembourg +L-1160 +Luxembourg + + ++352 247 88444 +andras.iklody@circl.lu + +
+ + + +Security + + + + +This document describes the MISP query format used to search MISP (Malware Information and threat Sharing Platform) threat intelligence instances. +MISP query format is a simple format used to query MISP instances over a REST (Representational State Transfer ) interface. +The query format includes the JSON format to describe the query and the minimal API access to perform the query. The JSON format includes the overall structure along with the semantic associated for each respective key. The goal of the format is to query MISP threat intelligence instances can feed and integrate with network security devices (such as firewall, network intrusion detection system, routers, SIEMs), endpoint security devices or monitoring devices. + + + + + + + + +
+Sharing threat information became a fundamental requirements in the Internet, security and intelligence community at large. Threat +information can include indicators of compromise, malicious file indicators, financial fraud indicators +or even detailed information about a threat actor. MISP started as an open source project in late 2011 and +the MISP format started to be widely used as an exchange format within the community in the past years. The core format +is described in an Internet-Draft as misp-core-format and contain the standard MISP JSON format used for threat +intelligence. + +The aim of this document is to describe the specification of the MISP query format and how the query can be perform against a REST interface. + + +
+The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", +"SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this +document are to be interpreted as described in RFC 2119 . + +
+
+ +
+ +
+The MISP query format is in the JSON format. + +
+ +
+ +
+returnFormat MUST be present. returnFormat sets the type of output format. MISP allows multiple format (depending of the configuration): + + +value +Description + +jsonMISP JSON core format as described in +xmlMISP XML format +openiocOpenIOC format +suricataSuricata NIDS format +snortSnort NIDS format +csvCSV format + +
+ +
+
+ +
+
+ +
+
+ +
+
+ +
+
+
+
+ +
+MISP threat intelligence instances might contain sensitive or confidential information. Adequate access control and encryption measures shall be implemented to ensure the confidentiality of the threat intelligence. + +Adversaries might include malicious content in MISP queries. Implementation MUST consider the input of malicious inputs beside the +standard threat information that might already include malicious intended inputs. + +
+ +
+The authors wish to thank all the MISP community who are supporting the creation +of open standards in threat intelligence sharing. A special thank to all the committees which +triggered us to come with better and flexible format. + +
+ + + + + + + + + + + MISP core format + + + + + + + MISP Project - Malware Information Sharing Platform and Threat Sharing + + + + + + + + From 100ba755cb131f59a5d6145b642ada18cf1c5d77 Mon Sep 17 00:00:00 2001 From: Andras Iklody Date: Sun, 7 Oct 2018 11:33:48 +0200 Subject: [PATCH 05/30] some more stuff --- misp-query-format/raw.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index 7cfa0bc..d86bdc6 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -82,17 +82,28 @@ returnFormat **MUST** be present. returnFormat sets the type of output format. M | suricata | Suricata NIDS format | | snort | Snort NIDS format | | csv | CSV format | +| rpz | Response policy zone format | +| text | Raw value list format | ### limit +limit **MAY** be present. If present, the page parameter **MUST** also be supplied. limit sets the number of returned elements when paginating, depending on the scope of the request (x number of attributes or x number of events) as converted into the output format. + ### page +page **MAY** be present. If present, the page parameter **MUST** also be supplied. page generates the offset for the pagination and will return a result set consisting of a slice of the query results starting with offset (limit * page) + 1 and ending with (limit * (page+1)). + ### value +value **MAY** be present. If set, the returned data set will be filtered on the attribute value field. value **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. + ### type +type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. + ### category +category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. # Security Considerations From 3b577a0ad6ef024f1e3ab917411a361e185dc5d1 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 7 Oct 2018 11:57:12 +0200 Subject: [PATCH 06/30] chg: [misp-query-format] types and categories available in MISP core format --- misp-query-format/raw.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index d86bdc6..95b66f1 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -99,11 +99,11 @@ value **MAY** be present. If set, the returned data set will be filtered on the ### type -type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. +type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [@?MISP-C] in the attribute type section. ### category -category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. +category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. # Security Considerations From 8891052e2a039886d2be086f0c0e6f0a2104b1f4 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 7 Oct 2018 12:02:58 +0200 Subject: [PATCH 07/30] chg: [misp-query-format] add a sample query with financial fraud --- misp-query-format/raw.md | 10 ++++ misp-query-format/raw.md.html | 21 +++++++ misp-query-format/raw.md.txt | 102 ++++++++++++++++++++++++++-------- misp-query-format/raw.md.xml | 22 ++++++++ 4 files changed, 132 insertions(+), 23 deletions(-) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index 95b66f1..a6e7a4e 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -105,6 +105,16 @@ type **MAY** be present. If set, the returned data set will be filtered on the a category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. +A sample query to lookup for the last 30 days of indicators in the `Financial fraud` category and output in CSV format: + +~~~~ +{ + "returnFormat": "csv", + "last": "30d", + "category": "Financial fraud" +} +~~~~ + # Security Considerations MISP threat intelligence instances might contain sensitive or confidential information. Adequate access control and encryption measures shall be implemented to ensure the confidentiality of the threat intelligence. diff --git a/misp-query-format/raw.md.html b/misp-query-format/raw.md.html index cbaa4d3..71b0cf0 100644 --- a/misp-query-format/raw.md.html +++ b/misp-query-format/raw.md.html @@ -541,23 +541,44 @@ csv CSV format + +rpz +Response policy zone format + + +text +Raw value list format +

2.2.2. limit

+

limit MAY be present. If present, the page parameter MUST also be supplied. limit sets the number of returned elements when paginating, depending on the scope of the request (x number of attributes or x number of events) as converted into the output format.

2.2.3. page

+

page MAY be present. If present, the page parameter MUST also be supplied. page generates the offset for the pagination and will return a result set consisting of a slice of the query results starting with offset (limit * page) + 1 and ending with (limit * (page+1)).

2.2.4. value

+

value MAY be present. If set, the returned data set will be filtered on the attribute value field. value MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters.

2.2.5. type

+

type MAY be present. If set, the returned data set will be filtered on the attribute type field. type MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [MISP-C] in the attribute type section.

2.2.6. category

+

category MAY be present. If set, the returned data set will be filtered on the attribute category field. category MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [MISP-C] in the attribute type section.

+

A sample query to lookup for the last 30 days of indicators in the Financial fraud category and output in CSV format:

+
+{
+    "returnFormat": "csv",
+    "last": "30d",
+    "category": "Financial fraud"
+}
+

3. Security Considerations

diff --git a/misp-query-format/raw.md.txt b/misp-query-format/raw.md.txt index ddcb824..1ad03a4 100644 --- a/misp-query-format/raw.md.txt +++ b/misp-query-format/raw.md.txt @@ -76,15 +76,15 @@ Table of Contents 2.2.1. returnFormat . . . . . . . . . . . . . . . . . . . . 3 2.2.2. limit . . . . . . . . . . . . . . . . . . . . . . . . 3 2.2.3. page . . . . . . . . . . . . . . . . . . . . . . . . 3 - 2.2.4. value . . . . . . . . . . . . . . . . . . . . . . . . 3 - 2.2.5. type . . . . . . . . . . . . . . . . . . . . . . . . 3 - 2.2.6. category . . . . . . . . . . . . . . . . . . . . . . 3 - 3. Security Considerations . . . . . . . . . . . . . . . . . . . 3 - 4. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 4 - 5. References . . . . . . . . . . . . . . . . . . . . . . . . . 4 - 5.1. Normative References . . . . . . . . . . . . . . . . . . 4 - 5.2. Informative References . . . . . . . . . . . . . . . . . 4 - Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 4 + 2.2.4. value . . . . . . . . . . . . . . . . . . . . . . . . 4 + 2.2.5. type . . . . . . . . . . . . . . . . . . . . . . . . 4 + 2.2.6. category . . . . . . . . . . . . . . . . . . . . . . 4 + 3. Security Considerations . . . . . . . . . . . . . . . . . . . 4 + 4. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 5 + 5. References . . . . . . . . . . . . . . . . . . . . . . . . . 5 + 5.1. Normative References . . . . . . . . . . . . . . . . . . 5 + 5.2. Informative References . . . . . . . . . . . . . . . . . 5 + Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 5 1. Introduction @@ -143,24 +143,24 @@ Internet-Draft MISP query format October 2018 | suricata | Suricata NIDS format | | snort | Snort NIDS format | | csv | CSV format | + | rpz | Response policy zone format | + | text | Raw value list format | +----------+------------------------------------------------+ 2.2.2. limit + limit MAY be present. If present, the page parameter MUST also be + supplied. limit sets the number of returned elements when paginating, + depending on the scope of the request (x number of attributes or x + number of events) as converted into the output format. + 2.2.3. page -2.2.4. value - -2.2.5. type - -2.2.6. category - -3. Security Considerations - - MISP threat intelligence instances might contain sensitive or - confidential information. Adequate access control and encryption - measures shall be implemented to ensure the confidentiality of the - threat intelligence. + page MAY be present. If present, the page parameter MUST also be + supplied. page generates the offset for the pagination and will + return a result set consisting of a slice of the query results + starting with offset (limit * page) + 1 and ending with (limit * + (page+1)). @@ -170,11 +170,62 @@ Dulaunoy & Iklody Expires April 11, 2019 [Page 3] Internet-Draft MISP query format October 2018 +2.2.4. value + + value MAY be present. If set, the returned data set will be filtered + on the attribute value field. value MAY be a string or a sub-string, + the latter of which start with, ends with or is encapsulated in + wildcard (\%) characters. + +2.2.5. type + + type MAY be present. If set, the returned data set will be filtered + on the attribute type field. type MAY be a string or a sub-string, + the latter of which start with, ends with or is encapsulated in + wildcard (\%) characters. The list of valid attribute types is + described in the MISP core format [MISP-C] in the attribute type + section. + +2.2.6. category + + category MAY be present. If set, the returned data set will be + filtered on the attribute category field. category MAY be a string or + a sub-string, the latter of which start with, ends with or is + encapsulated in wildcard (\%) characters. The list of valid + categories is described in the MISP core format [MISP-C] in the + attribute type section. + + A sample query to lookup for the last 30 days of indicators in the + "Financial fraud" category and output in CSV format: + + { + "returnFormat": "csv", + "last": "30d", + "category": "Financial fraud" + } + +3. Security Considerations + + MISP threat intelligence instances might contain sensitive or + confidential information. Adequate access control and encryption + measures shall be implemented to ensure the confidentiality of the + threat intelligence. + Adversaries might include malicious content in MISP queries. Implementation MUST consider the input of malicious inputs beside the standard threat information that might already include malicious intended inputs. + + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 4] + +Internet-Draft MISP query format October 2018 + + 4. Acknowledgements The authors wish to thank all the MISP community who are supporting @@ -221,7 +272,12 @@ Authors' Addresses -Dulaunoy & Iklody Expires April 11, 2019 [Page 4] + + + + + +Dulaunoy & Iklody Expires April 11, 2019 [Page 5] Internet-Draft MISP query format October 2018 @@ -277,4 +333,4 @@ Internet-Draft MISP query format October 2018 -Dulaunoy & Iklody Expires April 11, 2019 [Page 5] +Dulaunoy & Iklody Expires April 11, 2019 [Page 6] diff --git a/misp-query-format/raw.md.xml b/misp-query-format/raw.md.xml index 7761c11..9be5e6e 100644 --- a/misp-query-format/raw.md.xml +++ b/misp-query-format/raw.md.xml @@ -101,22 +101,44 @@ document are to be interpreted as described in RFC 2119 suricataSuricata NIDS format snortSnort NIDS format csvCSV format +rpzResponse policy zone format +textRaw value list format
+limit MAY be present. If present, the page parameter MUST also be supplied. limit sets the number of returned elements when paginating, depending on the scope of the request (x number of attributes or x number of events) as converted into the output format. +
+page MAY be present. If present, the page parameter MUST also be supplied. page generates the offset for the pagination and will return a result set consisting of a slice of the query results starting with offset (limit * page) + 1 and ending with (limit * (page+1)). +
+value MAY be present. If set, the returned data set will be filtered on the attribute value field. value MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. +
+type MAY be present. If set, the returned data set will be filtered on the attribute type field. type MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format in the attribute type section. +
+category MAY be present. If set, the returned data set will be filtered on the attribute category field. category MAY be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format in the attribute type section. + +A sample query to lookup for the last 30 days of indicators in the Financial fraud category and output in CSV format: + + +
+{ + "returnFormat": "csv", + "last": "30d", + "category": "Financial fraud" +} +
From be9b3294758ace9a77c0d96b75765c1eabd0bf86 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Wed, 10 Oct 2018 15:12:20 +0200 Subject: [PATCH 08/30] chg: [misp-query-format] all the fields added [WiP] --- misp-query-format/raw.md | 49 ++++++++++++++++++++++++++++++++++++++++ 1 file changed, 49 insertions(+) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index a6e7a4e..307d144 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -115,6 +115,55 @@ A sample query to lookup for the last 30 days of indicators in the `Financial fr } ~~~~ +### org + +org **MAY** be present. If set, the returned data set will be filtered by the organisation identifier (local ID of the instance). org **MUST** be the identifier of the organisation in a string format. + +### tags + +### quickfilter + +### from + +### to + +### last + +### eventid + +### withAttachments + +### metadata + +### uuid + +### publish_timestamp + +### timestamp + +### published + +### enforceWarninglist + +### to_ids + +### deleted + +### includeEventUuid + +### event_timestamp + +### sgReferenceOnly + +### eventinfo + +### searchall + +### requested_attributes + +### includeContext + + # Security Considerations MISP threat intelligence instances might contain sensitive or confidential information. Adequate access control and encryption measures shall be implemented to ensure the confidentiality of the threat intelligence. From ece4b9dcc679c6b9616d27471d08c760d7c66a02 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 12 Oct 2018 08:33:32 +0200 Subject: [PATCH 09/30] chg: [misp-query-format] more updates [WiP] --- misp-query-format/raw.md | 34 +++++++++++++++++++++++++++++++--- 1 file changed, 31 insertions(+), 3 deletions(-) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index 307d144..db3dd63 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -84,6 +84,7 @@ returnFormat **MUST** be present. returnFormat sets the type of output format. M | csv | CSV format | | rpz | Response policy zone format | | text | Raw value list format | +| cache | MISP cache format (hashed values of attributes) | ### limit @@ -95,15 +96,15 @@ page **MAY** be present. If present, the page parameter **MUST** also be supplie ### value -value **MAY** be present. If set, the returned data set will be filtered on the attribute value field. value **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. +value **MAY** be present. If set, the returned data set will be filtered on the attribute value field. value **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. ### type -type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [@?MISP-C] in the attribute type section. +type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [@?MISP-C] in the attribute type section. ### category -category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which start with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. +category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. A sample query to lookup for the last 30 days of indicators in the `Financial fraud` category and output in CSV format: @@ -121,14 +122,41 @@ org **MAY** be present. If set, the returned data set will be filtered by the or ### tags +tags **MAY** be present. If set, the returned data set will be filtered by tags. tags **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. + +~~~~ +{ + "returnFormat": "cache", + "limit": "100", + "tags": ["tlp:red", "%private%"] +} +~~~~ + ### quickfilter ### from +from **MAY** be present. If set, the returned data set will be filtered from a starting date. from **MAY** be a string represented in the format year-month-date. + +~~~~ +{ + "returnFormat": "json", + "limit": "100", + "tags": ["tlp:amber"], + "from": "2018-09-02", + "to": "2018-10-01" +} +~~~~ + ### to +to **MAY** be present. If set, the returned data set will be filtered until the specified date. from **MAY** be a string represented in the format year-month-date. + ### last +last **MAY** be present. If set, the returned data set + + ### eventid ### withAttachments From 3f8bccce3ed310da17e428fc170531e06af35b8c Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Mon, 15 Oct 2018 11:46:07 +0200 Subject: [PATCH 10/30] chg: [misp-object] fix the references --- misp-object-template-format/raw.md | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/misp-object-template-format/raw.md b/misp-object-template-format/raw.md index be05b5a..f66943f 100755 --- a/misp-object-template-format/raw.md +++ b/misp-object-template-format/raw.md @@ -313,7 +313,7 @@ format is represented by a JSON list containing a list of formats that the relat The MISP object template directory is publicly available [@?MISP-O] in a git repository. The repository contains an objects directory, which contains a directory per object type, containing a file named definition.json which contains the definition of the object template in the above described format. -A relationships directory is also included, containing a definition.json file which contains a list of MISP object relation definitions +A relationships directory is also included, containing a definition.json file which contains a list of MISP object relation definitions. There are more than 90 existing templates object documented in [@?MISP-O-DOC]. # Acknowledgements @@ -344,5 +344,13 @@ of open standards in threat intelligence sharing. + + + MISP objects directory + + + + + {backmatter} From 5e15aef5e7ff452394df3d39a2fb320e09ff4c38 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 19 Oct 2018 10:34:17 +0200 Subject: [PATCH 11/30] chg: [misp-galaxy-format] category added (to be reviewed) --- misp-galaxy-format/raw.md | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/misp-galaxy-format/raw.md b/misp-galaxy-format/raw.md index d19640a..b68be1d 100644 --- a/misp-galaxy-format/raw.md +++ b/misp-galaxy-format/raw.md @@ -78,9 +78,9 @@ Clusters are represented as a JSON [@!RFC4627] dictionary. ## Overview -The MISP galaxy format uses the JSON [@!RFC4627] format. Each galaxy is represented as a JSON object with meta information including the following fields: name, uuid, description, version, type, authors, source, values. +The MISP galaxy format uses the JSON [@!RFC4627] format. Each galaxy is represented as a JSON object with meta information including the following fields: name, uuid, description, version, type, authors, source, values, category. -name defines the name of the galaxy. The name is represented as a string and **MUST** be present. The uuid represents the Universally Unique IDentifier (UUID) [@!RFC4122] of the object reference. The uuid **MUST** be preserved. For any updates or transfer of the same object reference. UUID version 4 is **RECOMMENDED** when assigning it to a new object reference and **MUST** be present. The description is represented as a string and **MUST** be present. The uuid is represented as a string and **MUST** be present. The version is represented as a decimal and **MUST** be present. The type is represented as a string and **MUST** be present and **MUST** match the name of the galaxy file. The source is represented as a string and **MUST** be present. Authors are represented as an array containing one or more authors and **MUST** be present. +name defines the name of the galaxy. The name is represented as a string and **MUST** be present. The uuid represents the Universally Unique IDentifier (UUID) [@!RFC4122] of the object reference. The uuid **MUST** be preserved. For any updates or transfer of the same object reference. UUID version 4 is **RECOMMENDED** when assigning it to a new object reference and **MUST** be present. The description is represented as a string and **MUST** be present. The uuid is represented as a string and **MUST** be present. The version is represented as a decimal and **MUST** be present. The type is represented as a string and **MUST** be present and **MUST** match the name of the galaxy file. The source is represented as a string and **MUST** be present. Authors are represented as an array containing one or more authors and **MUST** be present. The category is represented as a string and **SHOULD** be present and describes the overall category of the galaxy such as tool or actor. Values are represented as an array containing one or more values and **MUST** be present. Values defines all values available in the galaxy. @@ -267,6 +267,9 @@ The JSON Schema [@?JSON-SCHEMA] below defines the overall MISP galaxy formats. T "source": { "type": "string" }, + "category": { + "type": "string + }, "values": { "type": "array", "uniqueItems": true, From 11d23995a33ddf04ac80a3435535d0d86cebf543 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 19 Oct 2018 14:24:32 +0200 Subject: [PATCH 12/30] fix: [misp-galaxy] category is now a MUST --- misp-galaxy-format/raw.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/misp-galaxy-format/raw.md b/misp-galaxy-format/raw.md index b68be1d..2548f18 100644 --- a/misp-galaxy-format/raw.md +++ b/misp-galaxy-format/raw.md @@ -80,7 +80,7 @@ Clusters are represented as a JSON [@!RFC4627] dictionary. The MISP galaxy format uses the JSON [@!RFC4627] format. Each galaxy is represented as a JSON object with meta information including the following fields: name, uuid, description, version, type, authors, source, values, category. -name defines the name of the galaxy. The name is represented as a string and **MUST** be present. The uuid represents the Universally Unique IDentifier (UUID) [@!RFC4122] of the object reference. The uuid **MUST** be preserved. For any updates or transfer of the same object reference. UUID version 4 is **RECOMMENDED** when assigning it to a new object reference and **MUST** be present. The description is represented as a string and **MUST** be present. The uuid is represented as a string and **MUST** be present. The version is represented as a decimal and **MUST** be present. The type is represented as a string and **MUST** be present and **MUST** match the name of the galaxy file. The source is represented as a string and **MUST** be present. Authors are represented as an array containing one or more authors and **MUST** be present. The category is represented as a string and **SHOULD** be present and describes the overall category of the galaxy such as tool or actor. +name defines the name of the galaxy. The name is represented as a string and **MUST** be present. The uuid represents the Universally Unique IDentifier (UUID) [@!RFC4122] of the object reference. The uuid **MUST** be preserved. For any updates or transfer of the same object reference. UUID version 4 is **RECOMMENDED** when assigning it to a new object reference and **MUST** be present. The description is represented as a string and **MUST** be present. The uuid is represented as a string and **MUST** be present. The version is represented as a decimal and **MUST** be present. The type is represented as a string and **MUST** be present and **MUST** match the name of the galaxy file. The source is represented as a string and **MUST** be present. Authors are represented as an array containing one or more authors and **MUST** be present. The category is represented as a string and **MUST** be present and describes the overall category of the galaxy such as tool or actor. Values are represented as an array containing one or more values and **MUST** be present. Values defines all values available in the galaxy. @@ -401,7 +401,8 @@ The JSON Schema [@?JSON-SCHEMA] below defines the overall MISP galaxy formats. T "uuid", "values", "authors", - "source" + "source", + "category ] } ~~~~ From 6c52bfc2bf8ecf71c608a24297df3b574d6860bd Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 30 Nov 2018 08:01:12 +0100 Subject: [PATCH 13/30] chg: [misp-taxonomy-format] list of public taxonomies added --- misp-taxonomy-format/raw.md | 252 +++++++++++++++++++++++++++++++++++- 1 file changed, 250 insertions(+), 2 deletions(-) diff --git a/misp-taxonomy-format/raw.md b/misp-taxonomy-format/raw.md index 404a399..fe09d48 100755 --- a/misp-taxonomy-format/raw.md +++ b/misp-taxonomy-format/raw.md @@ -40,8 +40,8 @@ This document describes the MISP taxonomy format which describes a simple JSON format to represent machine tags (also called triple tags) vocabularies. A public directory of common vocabularies -MISP taxonomies is available and relies on the MISP taxonomy format. MISP taxonomies are used to classify -cyber security events, threats or indicators. +called MISP taxonomies is available and relies on the MISP taxonomy format. MISP taxonomies are used to classify +cyber security events, threats, suspicious events, or indicators. {mainmatter} @@ -422,6 +422,254 @@ A taxonomies array describes the taxonomy available with the description, name a ~~~~ +## Available taxonomies in the public directory + +The public directory of MISP taxonomies [@?MISP-T] contains a variety of taxonomy in various fields such as: + + +CERT-XLM: +: CERT-XLM Security Incident Classification. + +DML: +: The Detection Maturity Level (DML) model is a capability maturity model for referencing ones maturity in detecting cyber attacks. It's designed for organizations who perform intel-driven detection and response and who put an emphasis on having a mature detection program. + +PAP: +: The Permissible Actions Protocol - or short: PAP - was designed to indicate how the received information can be used. + +access-method: +: The access method used to remotely access a system. + +accessnow: +: Access Now classification to classify an issue (such as security, human rights, youth rights). + +action-taken: +: Action taken in the case of a security incident (CSIRT perspective). + +admiralty-scale: +: The Admiralty Scale (also called the NATO System) is used to rank the reliability of a source and the credibility of an information. + +adversary: +: An overview and description of the adversary infrastructure. + +ais-marking: +: AIS Marking Schema implementation is maintained by the National Cybersecurity and Communication Integration Center (NCCIC) of the U.S. Department of Homeland Security (DHS) + +analyst-assessment: +: A series of assessment predicates describing the analyst capabilities to perform analysis. These assessment can be assigned by the analyst him/herself or by another party evaluating the analyst. + +approved-category-of-action: +: A pre-approved category of action for indicators being shared with partners (MIMIC). + +binary-class: +: Custom taxonomy for types of binary file. + +cccs: +: Internal taxonomy for CCCS. + +circl: +: CIRCL Taxonomy is a simple scheme for incident classification and area topic where the incident took place. + +collaborative-intelligence: +: Collaborative intelligence support language is a common language to support analysts to perform their analysis to get crowdsourced support when using threat intelligence sharing platform like MISP. + +copine-scale: +: The COPINE Scale is a rating system created in Ireland and used in the United Kingdom to categorise the severity of images of child sex abuse. + +csirt_case_classification: +: FIRST CSIRT Case Classification. + +cssa: +: The CSSA agreed sharing taxonomy. + +cyber-threat-framework: +: Cyber Threat Framework was developed by the US Government to enable consistent characterization and categorization of cyber threat events, and to identify trends or changes in the activities of cyber adversaries. https://www.dni.gov/index.php/cyber-threat-framework + +ddos: +: Distributed Denial of Service - or short: DDoS - taxonomy supports the description of Denial of Service attacks and especially the types they belong too. + +de-vs: +: Taxonomy for the handling of protectively marked information in MISP with German (DE) Government classification markings (VS) + +dhs-ciip-sectors: +: DHS critical sectors as described in https://www.dhs.gov/critical-infrastructure-sectors. + +diamond-model: +: The Diamond Model for Intrusion Analysis, a phase-based model developed by Lockheed Martin, aims to help categorise and identify the stage of an attack. + +dni-ism: +: ISM (Information Security Marking Metadata) V13 as described by DNI.gov (Director of National Intelligence - US). + +domain-abuse: +: Taxonomy to tag domain names used for cybercrime. + +economical-impact: +: Economical impact is a taxonomy to describe the financial impact as positive or negative gain to the tagged information. + +ecsirt: +: eCSIRT incident classification Appendix C of the eCSIRT EU project including IntelMQ updates. + +enisa: +: ENISA Threat Taxonomy - A tool for structuring threat information as published in https://www.enisa.europa.eu/topics/threat-risk-management/threats-and-trends/enisa-threat-landscape/etl2015/enisa-threat-taxonomy-a-tool-for-structuring-threat-information + +estimative-language: +: Estimative language - including likelihood or probability of event based on the Intelligence Community Directive 203 (ICD 203) (6.2.(a)) and JP 2-0, Joint Intelligence. + +eu-marketop-and-publicadmin: +: Market operators and public administrations that must comply to some notifications requirements under EU NIS directive. + +eu-nis-sector-and-subsectors: +: Sectors and sub sectors as identified by the NIS Directive. + +euci: +: EU classified information (EUCI) means any information or material designated by a EU security classification, the unauthorised disclosure of which could cause varying degrees of prejudice to the interests of the European Union or of one or more of the Member States as described in CELEX 32013D0488 + +europol-event: +: EUROPOL type of events taxonomy. + +europol-incident: +: EUROPOL class of incident taxonomy. + +event-assessment: +: A series of assessment predicates describing the event assessment performed to make judgement(s) under a certain level of uncertainty. + +event-classification: +: Event Classification. + +exercise: +: Exercise is a taxonomy to describe if the information is part of one or more cyber or crisis exercise + +false-positive: +: This taxonomy aims to ballpark the expected amount of false positives. + +file-type: +: List of known file types. + +fpf: +: The Future of Privacy Forum (FPF) [visual guide to practical de-identification](https://fpf.org/2016/04/25/a-visual-guide-to-practical-data-de-identification/) taxonomy is used to evaluate the degree of identifiability of personal data and the types of pseudonymous data, de-identified data and anonymous data. The work of FPF is licensed under a creative commons attribution 4.0 international license. + +fr-classif: +: French gov information classification system. + +gdpr: +: Taxonomy related to the REGULATION (EU) 2016/679 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) + +gsma-attack-category: +: Taxonomy used by GSMA for their information sharing program with telco describing the attack categories + +gsma-fraud: +: Taxonomy used by GSMA for their information sharing program with telco describing the various aspects of fraud + +gsma-network-technology: +: Taxonomy used by GSMA for their information sharing program with telco describing the types of infrastructure. WiP + +honeypot-basic: +: Christian Seifert, Ian Welch, Peter Komisarczuk, ‘Taxonomy of Honeypots’, Technical Report CS-TR-06/12, VICTORIA UNIVERSITY OF WELLINGTON, School of Mathematical and Computing Sciences, June 2006, http://www.mcs.vuw.ac.nz/comp/Publications/archive/CS-TR-06/CS-TR-06-12.pdf + +iep: +: Forum of Incident Response and Security Teams (FIRST) Information Exchange Policy (IEP) framework. + +ifx-vetting: +: The IFX taxonomy is used to categorise information (MISP events and attributes) to aid in the intelligence vetting process + +incident-disposition: +: How an incident is classified in its process to be resolved. The taxonomy is inspired from NASA Incident Response and Management Handbook. + +infoleak: +: A taxonomy describing information leaks and especially information classified as being potentially leaked. + +information-security-indicators: +: Information security indicators have been standardized by the ETSI Industrial Specification Group (ISG) ISI. These indicators provide the basis to switch from a qualitative to a quantitative culture in IT Security Scope of measurements: External and internal threats (attempt and success), user's deviant behaviours, nonconformities and/or vulnerabilities (software, configuration, behavioural, general security framework). ETSI GS ISI 001-1 (V1.1.2): ISI Indicators + +interception-method: +: The interception method used to intercept traffic. + +kill-chain: +: Cyber Kill Chain from Lockheed Martin as described in Intelligence-Driven Computer Network Defense Informed by Analysis of Adversary Campaigns and Intrusion Kill Chains. + +maec-delivery-vectors: +: Vectors used to deliver malware based on MAEC 5.0 + +maec-malware-behavior: +: Malware behaviours based on MAEC 5.0 + +maec-malware-capabilities: +: Malware Capabilities based on MAEC 5.0 + +maec-malware-obfuscation-methods: +: Obfuscation methods used by malware based on MAEC 5.0 + +malware_classification: +: Malware classification based on a SANS whitepaper about malware. + +misp: +: Internal MISP taxonomy. + +monarc-threat: +: MONARC threat taxonomy. + +ms-caro-malware: +: Malware Type and Platform classification based on Microsoft's implementation of the Computer Antivirus Research Organization (CARO) Naming Scheme and Malware Terminology. + +ms-caro-malware-full: +: Malware Type and Platform classification based on Microsoft's implementation of the Computer Antivirus Research Organization (CARO) Naming Scheme and Malware Terminology. + +nato: +: Marking of Classified and Unclassified materials as described by the North Atlantic Treaty Organization, NATO. + +nis: +: NIS Cybersecurity Incident Taxonomy. + +open_threat: +: Open Threat Taxonomy v1.1 base on James Tarala of SANS ref. - http://www.auditscripts.com/resources/open_threat_taxonomy_v1.1a.pdf + +osint: +: Open Source Intelligence - Classification (MISP taxonomies). + +passivetotal: +: Tags for RiskIQ's passivetotal service + +pentest: +: Penetration test (pentest) classification. + +priority-level: +: After an incident is scored, it is assigned a priority level. The six levels listed below are aligned with NCCIC, DHS, and the CISS to help provide a common lexicon when discussing incidents. This priority assignment drives NCCIC urgency, pre-approved incident response offerings, reporting requirements, and recommendations for leadership escalation. Generally, incident priority distribution should follow a similar pattern to the graph below. Based on https://www.us-cert.gov/NCCIC-Cyber-Incident-Scoring-System. + +rsit: +: Reference Security Incident Classification Taxonomy. + +rt_event_status: +: Status of events used in Request Tracker. + +runtime-packer: +: Runtime or software packer used to combine compressed data with the decompression code. The decompression code can add additional obfuscations mechanisms including polymorphic-packer or other obfuscation techniques. This taxonomy lists all the known or official packer used for legitimate use or for packing malicious binaries. + +smart-airports-threats: +: Threat taxonomy in the scope of securing smart airports by ENISA. + +stealth_malware: +: Classification based on malware stealth techniques. + +stix-ttp: +: Representation of the behavior or modus operandi of cyber adversaries (a.k.a TTP) as normalized in STIX + +targeted-threat-index: +: The Targeted Threat Index is a metric for assigning an overall threat ranking score to email messages that deliver malware to a victim’s computer. The TTI metric was first introduced at SecTor 2013 by Seth Hardy as part of the talk “RATastrophe: Monitoring a Malware Menagerie” along with Katie Kleemola and Greg Wiseman. + +tlp: +: The Traffic Light Protocol - or short: TLP - was designed with the objective to create a favorable classification scheme for sharing sensitive information while keeping the control over its distribution at the same time. Extended with TLP:EX:CHR. + +tor: +: Taxonomy to describe Tor network infrastructure + +veris: +: Vocabulary for Event Recording and Incident Sharing (VERIS). + +vocabulaire-des-probabilites-estimatives: +: Vocabulaire des probabilités estimatives + +workflow: +: Workflow support language is a common language to support intelligence analysts to perform their analysis on data and information. + # JSON Schema The JSON Schema [@?JSON-SCHEMA] below defines the structure of the MISP taxonomy document From f7cf72327de7b43477bd20285584227b3c6851fa Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 30 Nov 2018 08:05:04 +0100 Subject: [PATCH 14/30] chg: [taxonomies] updated to the latest version --- misp-taxonomy-format/raw.md.txt | 652 +++++++++++++++++++++++++++----- 1 file changed, 550 insertions(+), 102 deletions(-) diff --git a/misp-taxonomy-format/raw.md.txt b/misp-taxonomy-format/raw.md.txt index 29a02f3..36f735a 100644 --- a/misp-taxonomy-format/raw.md.txt +++ b/misp-taxonomy-format/raw.md.txt @@ -5,7 +5,7 @@ Network Working Group A. Dulaunoy Internet-Draft A. Iklody Intended status: Informational CIRCL -Expires: March 8, 2018 September 4, 2017 +Expires: June 2, 2018 November 29, 2017 MISP taxonomy format @@ -15,10 +15,10 @@ Abstract This document describes the MISP taxonomy format which describes a simple JSON format to represent machine tags (also called triple - tags) vocabularies. A public directory of common vocabularies MISP - taxonomies is available and relies on the MISP taxonomy format. MISP - taxonomies are used to classify cyber security events, threats or - indicators. + tags) vocabularies. A public directory of common vocabularies called + MISP taxonomies is available and relies on the MISP taxonomy format. + MISP taxonomies are used to classify cyber security events, threats, + suspicious events, or indicators. Status of This Memo @@ -28,14 +28,14 @@ Status of This Memo Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- - Drafts is at http://datatracker.ietf.org/drafts/current/. + Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on March 8, 2018. + This Internet-Draft will expire on June 2, 2018. Copyright Notice @@ -44,7 +44,7 @@ Copyright Notice This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents - (http://trustee.ietf.org/license-info) in effect on the date of + (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must @@ -53,9 +53,9 @@ Copyright Notice -Dulaunoy & Iklody Expires March 8, 2018 [Page 1] +Dulaunoy & Iklody Expires June 2, 2018 [Page 1] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 the Trust Legal Provisions and are provided without warranty as @@ -78,12 +78,14 @@ Table of Contents 4. Sample Taxonomy in MISP taxonomy format . . . . . . . . . . . 7 4.1. Admiralty Scale Taxonomy . . . . . . . . . . . . . . . . 7 4.2. Open Source Intelligence - Classification . . . . . . . . 9 - 5. JSON Schema . . . . . . . . . . . . . . . . . . . . . . . . . 11 - 6. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 14 - 7. References . . . . . . . . . . . . . . . . . . . . . . . . . 14 - 7.1. Normative References . . . . . . . . . . . . . . . . . . 14 - 7.2. Informative References . . . . . . . . . . . . . . . . . 15 - Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 15 + 4.3. Available taxonomies in the public directory . . . . . . 11 + 5. JSON Schema . . . . . . . . . . . . . . . . . . . . . . . . . 19 + 6. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 22 + 7. References . . . . . . . . . . . . . . . . . . . . . . . . . 22 + 7.1. Normative References . . . . . . . . . . . . . . . . . . 22 + 7.2. Informative References . . . . . . . . . . . . . . . . . 22 + 7.3. URIs . . . . . . . . . . . . . . . . . . . . . . . . . . 23 + Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 23 1. Introduction @@ -103,17 +105,18 @@ Table of Contents information to users and machines. Machine tags are also known as triple tags due to their format. + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 2] + +Internet-Draft MISP taxonomy format November 2017 + + In the MISP taxonomy context, machine tags help analysts to classify their cybersecurity events, indicators or threats. MISP taxonomies can be used for classification, filtering, triggering actions or - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 2] - -Internet-Draft MISP taxonomy format September 2017 - - visualisation depending on their use in threat intelligence platforms such as MISP [MISP-P]. @@ -155,21 +158,22 @@ Internet-Draft MISP taxonomy format September 2017 applicable at event, user or org level. The type is represented as an array containing one or more type and SHOULD be present. If a type is not mentioned, by default, the taxonomy is applicable at - event level only. + event level only. An exclusive boolean property MAY be present and + defines at namespace level if the predicates are mutually exclusive. + + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 3] + +Internet-Draft MISP taxonomy format November 2017 + predicates defines all the predicates available in the namespace defined. predicates is represented as an array of JSON objects. predicates MUST be present and MUST at least content one element. - - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 3] - -Internet-Draft MISP taxonomy format September 2017 - - values defines all the values for each predicate in the namespace defined. values SHOULD be present. @@ -181,7 +185,8 @@ Internet-Draft MISP taxonomy format September 2017 present. value is represented as a string and describes the predicate value. The predicate value MUST not contain spaces or colons. expanded is represented as a string and describes the human-readable - version of the predicate value. + version of the predicate value. An exclusive property MAY be present + and defines at namespace level if the values are mutually exclusive. 2.3. values @@ -216,14 +221,9 @@ Internet-Draft MISP taxonomy format September 2017 - - - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 4] +Dulaunoy & Iklody Expires June 2, 2018 [Page 4] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 "predicates": [ @@ -259,6 +259,10 @@ Internet-Draft MISP taxonomy format September 2017 SHOULD use the decimal value provided to support scoring or filtering. + The decimal range for numerical_value SHOULD use a range from 0 up to + 100. The range is recommended to support common mathematical + properties among taxonomies. + Example use of the numerical_value in the MISP confidence level: @@ -273,13 +277,9 @@ Internet-Draft MISP taxonomy format September 2017 - - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 5] +Dulaunoy & Iklody Expires June 2, 2018 [Page 5] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 { @@ -333,9 +333,9 @@ Internet-Draft MISP taxonomy format September 2017 -Dulaunoy & Iklody Expires March 8, 2018 [Page 6] +Dulaunoy & Iklody Expires June 2, 2018 [Page 6] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 3.1. Sample Manifest @@ -389,9 +389,9 @@ Internet-Draft MISP taxonomy format September 2017 -Dulaunoy & Iklody Expires March 8, 2018 [Page 7] +Dulaunoy & Iklody Expires June 2, 2018 [Page 7] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 "value": "a", @@ -445,9 +445,9 @@ Internet-Draft MISP taxonomy format September 2017 -Dulaunoy & Iklody Expires March 8, 2018 [Page 8] +Dulaunoy & Iklody Expires June 2, 2018 [Page 8] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 { @@ -501,9 +501,9 @@ Internet-Draft MISP taxonomy format September 2017 -Dulaunoy & Iklody Expires March 8, 2018 [Page 9] +Dulaunoy & Iklody Expires June 2, 2018 [Page 9] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 "predicate": "source-type" @@ -557,9 +557,9 @@ Internet-Draft MISP taxonomy format September 2017 -Dulaunoy & Iklody Expires March 8, 2018 [Page 10] +Dulaunoy & Iklody Expires June 2, 2018 [Page 10] -Internet-Draft MISP taxonomy format September 2017 +Internet-Draft MISP taxonomy format November 2017 "description": "30% Probably not" @@ -601,6 +601,423 @@ Internet-Draft MISP taxonomy format September 2017 } +4.3. Available taxonomies in the public directory + + The public directory of MISP taxonomies [MISP-T] contains a variety + of taxonomy in various fields such as: + + CERT-XLM: + CERT-XLM Security Incident Classification. + + DML: + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 11] + +Internet-Draft MISP taxonomy format November 2017 + + + The Detection Maturity Level (DML) model is a capability maturity + model for referencing ones maturity in detecting cyber attacks. + It's designed for organizations who perform intel-driven detection + and response and who put an emphasis on having a mature detection + program. + + PAP: + The Permissible Actions Protocol - or short: PAP - was designed to + indicate how the received information can be used. + + access-method: + The access method used to remotely access a system. + + accessnow: + Access Now classification to classify an issue (such as security, + human rights, youth rights). + + action-taken: + Action taken in the case of a security incident (CSIRT + perspective). + + admiralty-scale: + The Admiralty Scale (also called the NATO System) is used to rank + the reliability of a source and the credibility of an information. + + adversary: + An overview and description of the adversary infrastructure. + + ais-marking: + AIS Marking Schema implementation is maintained by the National + Cybersecurity and Communication Integration Center (NCCIC) of the + U.S. Department of Homeland Security (DHS) + + analyst-assessment: + A series of assessment predicates describing the analyst + capabilities to perform analysis. These assessment can be + assigned by the analyst him/herself or by another party evaluating + the analyst. + + approved-category-of-action: + A pre-approved category of action for indicators being shared with + partners (MIMIC). + + binary-class: + Custom taxonomy for types of binary file. + + cccs: + Internal taxonomy for CCCS. + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 12] + +Internet-Draft MISP taxonomy format November 2017 + + + circl: + CIRCL Taxonomy is a simple scheme for incident classification and + area topic where the incident took place. + + collaborative-intelligence: + Collaborative intelligence support language is a common language + to support analysts to perform their analysis to get crowdsourced + support when using threat intelligence sharing platform like MISP. + + copine-scale: + The COPINE Scale is a rating system created in Ireland and used in + the United Kingdom to categorise the severity of images of child + sex abuse. + + csirt_case_classification: + FIRST CSIRT Case Classification. + + cssa: + The CSSA agreed sharing taxonomy. + + cyber-threat-framework: + Cyber Threat Framework was developed by the US Government to + enable consistent characterization and categorization of cyber + threat events, and to identify trends or changes in the activities + of cyber adversaries. + + ddos: + Distributed Denial of Service - or short: DDoS - taxonomy supports + the description of Denial of Service attacks and especially the + types they belong too. + + de-vs: + Taxonomy for the handling of protectively marked information in + MISP with German (DE) Government classification markings (VS) + + dhs-ciip-sectors: + DHS critical sectors as described in . + + diamond-model: + The Diamond Model for Intrusion Analysis, a phase-based model + developed by Lockheed Martin, aims to help categorise and identify + the stage of an attack. + + dni-ism: + ISM (Information Security Marking Metadata) V13 as described by + DNI.gov (Director of National Intelligence - US). + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 13] + +Internet-Draft MISP taxonomy format November 2017 + + + domain-abuse: + Taxonomy to tag domain names used for cybercrime. + + economical-impact: + Economical impact is a taxonomy to describe the financial impact + as positive or negative gain to the tagged information. + + ecsirt: + eCSIRT incident classification Appendix C of the eCSIRT EU project + including IntelMQ updates. + + enisa: + ENISA Threat Taxonomy - A tool for structuring threat information + as published in + + estimative-language: + Estimative language - including likelihood or probability of event + based on the Intelligence Community Directive 203 (ICD 203) + (6.2.(a)) and JP 2-0, Joint Intelligence. + + eu-marketop-and-publicadmin: + Market operators and public administrations that must comply to + some notifications requirements under EU NIS directive. + + eu-nis-sector-and-subsectors: + Sectors and sub sectors as identified by the NIS Directive. + + euci: + EU classified information (EUCI) means any information or material + designated by a EU security classification, the unauthorised + disclosure of which could cause varying degrees of prejudice to + the interests of the European Union or of one or more of the + Member States as described in CELEX 32013D0488 + + europol-event: + EUROPOL type of events taxonomy. + + europol-incident: + EUROPOL class of incident taxonomy. + + event-assessment: + A series of assessment predicates describing the event assessment + performed to make judgement(s) under a certain level of + uncertainty. + + event-classification: + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 14] + +Internet-Draft MISP taxonomy format November 2017 + + + Event Classification. + + exercise: + Exercise is a taxonomy to describe if the information is part of + one or more cyber or crisis exercise + + false-positive: + This taxonomy aims to ballpark the expected amount of false + positives. + + file-type: + List of known file types. + + fpf: + The Future of Privacy Forum (FPF) visual guide to practical de- + identification [1] taxonomy is used to evaluate the degree of + identifiability of personal data and the types of pseudonymous + data, de-identified data and anonymous data. The work of FPF is + licensed under a creative commons attribution 4.0 international + license. + + fr-classif: + French gov information classification system. + + gdpr: + Taxonomy related to the REGULATION (EU) 2016/679 OF THE EUROPEAN + PARLIAMENT AND OF THE COUNCIL on the protection of natural persons + with regard to the processing of personal data and on the free + movement of such data, and repealing Directive 95/46/EC (General + Data Protection Regulation) + + gsma-attack-category: + Taxonomy used by GSMA for their information sharing program with + telco describing the attack categories + + gsma-fraud: + Taxonomy used by GSMA for their information sharing program with + telco describing the various aspects of fraud + + gsma-network-technology: + Taxonomy used by GSMA for their information sharing program with + telco describing the types of infrastructure. WiP + + honeypot-basic: + Christian Seifert, Ian Welch, Peter Komisarczuk, 'Taxonomy of + Honeypots', Technical Report CS-TR-06/12, VICTORIA UNIVERSITY OF + WELLINGTON, School of Mathematical and Computing Sciences, June + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 15] + +Internet-Draft MISP taxonomy format November 2017 + + + 2006, + + iep: + Forum of Incident Response and Security Teams (FIRST) Information + Exchange Policy (IEP) framework. + + ifx-vetting: + The IFX taxonomy is used to categorise information (MISP events + and attributes) to aid in the intelligence vetting process + + incident-disposition: + How an incident is classified in its process to be resolved. The + taxonomy is inspired from NASA Incident Response and Management + Handbook. + + infoleak: + A taxonomy describing information leaks and especially information + classified as being potentially leaked. + + information-security-indicators: + Information security indicators have been standardized by the ETSI + Industrial Specification Group (ISG) ISI. These indicators + provide the basis to switch from a qualitative to a quantitative + culture in IT Security Scope of measurements: External and + internal threats (attempt and success), user's deviant behaviours, + nonconformities and/or vulnerabilities (software, configuration, + behavioural, general security framework). ETSI GS ISI 001-1 + (V1.1.2): ISI Indicators + + interception-method: + The interception method used to intercept traffic. + + kill-chain: + Cyber Kill Chain from Lockheed Martin as described in + Intelligence-Driven Computer Network Defense Informed by Analysis + of Adversary Campaigns and Intrusion Kill Chains. + + maec-delivery-vectors: + Vectors used to deliver malware based on MAEC 5.0 + + maec-malware-behavior: + Malware behaviours based on MAEC 5.0 + + maec-malware-capabilities: + Malware Capabilities based on MAEC 5.0 + + maec-malware-obfuscation-methods: + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 16] + +Internet-Draft MISP taxonomy format November 2017 + + + Obfuscation methods used by malware based on MAEC 5.0 + + malware_classification: + Malware classification based on a SANS whitepaper about malware. + + misp: + Internal MISP taxonomy. + + monarc-threat: + MONARC threat taxonomy. + + ms-caro-malware: + Malware Type and Platform classification based on Microsoft's + implementation of the Computer Antivirus Research Organization + (CARO) Naming Scheme and Malware Terminology. + + ms-caro-malware-full: + Malware Type and Platform classification based on Microsoft's + implementation of the Computer Antivirus Research Organization + (CARO) Naming Scheme and Malware Terminology. + + nato: + Marking of Classified and Unclassified materials as described by + the North Atlantic Treaty Organization, NATO. + + nis: + NIS Cybersecurity Incident Taxonomy. + + open_threat: + Open Threat Taxonomy v1.1 base on James Tarala of SANS ref. - + + + osint: + Open Source Intelligence - Classification (MISP taxonomies). + + passivetotal: + Tags for RiskIQ's passivetotal service + + pentest: + Penetration test (pentest) classification. + + priority-level: + After an incident is scored, it is assigned a priority level. The + six levels listed below are aligned with NCCIC, DHS, and the CISS + to help provide a common lexicon when discussing incidents. This + priority assignment drives NCCIC urgency, pre-approved incident + response offerings, reporting requirements, and recommendations + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 17] + +Internet-Draft MISP taxonomy format November 2017 + + + for leadership escalation. Generally, incident priority + distribution should follow a similar pattern to the graph below. + Based on . + + rsit: + Reference Security Incident Classification Taxonomy. + + rt_event_status: + Status of events used in Request Tracker. + + runtime-packer: + Runtime or software packer used to combine compressed data with + the decompression code. The decompression code can add additional + obfuscations mechanisms including polymorphic-packer or other + obfuscation techniques. This taxonomy lists all the known or + official packer used for legitimate use or for packing malicious + binaries. + + smart-airports-threats: + Threat taxonomy in the scope of securing smart airports by ENISA. + + stealth_malware: + Classification based on malware stealth techniques. + + stix-ttp: + Representation of the behavior or modus operandi of cyber + adversaries (a.k.a TTP) as normalized in STIX + + targeted-threat-index: + The Targeted Threat Index is a metric for assigning an overall + threat ranking score to email messages that deliver malware to a + victim's computer. The TTI metric was first introduced at SecTor + 2013 by Seth Hardy as part of the talk "RATastrophe: Monitoring a + Malware Menagerie" along with Katie Kleemola and Greg Wiseman. + + tlp: + The Traffic Light Protocol - or short: TLP - was designed with the + objective to create a favorable classification scheme for sharing + sensitive information while keeping the control over its + distribution at the same time. Extended with TLP:EX:CHR. + + tor: + Taxonomy to describe Tor network infrastructure + + veris: + Vocabulary for Event Recording and Incident Sharing (VERIS). + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 18] + +Internet-Draft MISP taxonomy format November 2017 + + + vocabulaire-des-probabilites-estimatives: + Vocabulaire des probabilites estimatives + + workflow: + Workflow support language is a common language to support + intelligence analysts to perform their analysis on data and + information. + 5. JSON Schema The JSON Schema [JSON-SCHEMA] below defines the structure of the MISP @@ -610,14 +1027,6 @@ Internet-Draft MISP taxonomy format September 2017 { "$schema": "http://json-schema.org/schema#", - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 11] - -Internet-Draft MISP taxonomy format September 2017 - - "title": "Validator for misp-taxonomies", "id": "https://www.github.com/MISP/misp-taxonomies/schema.json", "defs": { @@ -649,6 +1058,14 @@ Internet-Draft MISP taxonomy format September 2017 } } }, + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 19] + +Internet-Draft MISP taxonomy format November 2017 + + "values": { "type": "array", "uniqueItems": true, @@ -666,14 +1083,6 @@ Internet-Draft MISP taxonomy format September 2017 "required": [ "predicate" ] - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 12] - -Internet-Draft MISP taxonomy format September 2017 - - } }, "predicates": { @@ -698,10 +1107,21 @@ Internet-Draft MISP taxonomy format September 2017 "value": { "type": "string" }, + "exclusive": { + "type": "boolean" + }, "required": [ "value" ] } + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 20] + +Internet-Draft MISP taxonomy format November 2017 + + } } }, @@ -720,16 +1140,11 @@ Internet-Draft MISP taxonomy format September 2017 "namespace": { "type": "string" }, + "exclusive": { + "type": "boolean" + }, "type": { "type": "array", - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 13] - -Internet-Draft MISP taxonomy format September 2017 - - "uniqueItems": true, "items": { "type": "string", @@ -755,6 +1170,14 @@ Internet-Draft MISP taxonomy format September 2017 "$ref": "#/defs/values" } }, + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 21] + +Internet-Draft MISP taxonomy format November 2017 + + "required": [ "namespace", "description", @@ -774,40 +1197,47 @@ Internet-Draft MISP taxonomy format September 2017 [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, - DOI 10.17487/RFC2119, March 1997, . - - - - - -Dulaunoy & Iklody Expires March 8, 2018 [Page 14] - -Internet-Draft MISP taxonomy format September 2017 - + DOI 10.17487/RFC2119, March 1997, + . [RFC4627] Crockford, D., "The application/json Media Type for JavaScript Object Notation (JSON)", RFC 4627, - DOI 10.17487/RFC4627, July 2006, . + DOI 10.17487/RFC4627, July 2006, + . 7.2. Informative References [JSON-SCHEMA] "JSON Schema: A Media Type for Describing JSON Documents", - 2016, . + 2016, + . [machine-tags] "Machine tags", 2007, . - [MISP-P] MISP, , "MISP Project - Malware Information Sharing - Platform and Threat Sharing", . + [MISP-P] MISP, "MISP Project - Malware Information Sharing Platform + and Threat Sharing", . - [MISP-T] MISP, , "MISP Taxonomies - shared and common vocabularies - of tags", . + [MISP-T] MISP, "MISP Taxonomies - shared and common vocabularies of + tags", . + + + + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 22] + +Internet-Draft MISP taxonomy format November 2017 + + +7.3. URIs + + [1] https://fpf.org/2016/04/25/a-visual-guide-to-practical-data-de- + identification/ Authors' Addresses @@ -837,4 +1267,22 @@ Authors' Addresses -Dulaunoy & Iklody Expires March 8, 2018 [Page 15] + + + + + + + + + + + + + + + + + + +Dulaunoy & Iklody Expires June 2, 2018 [Page 23] From ee233c6fa78c38c4cef6d16274fc08b4b97d1241 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sat, 1 Dec 2018 11:03:54 +0100 Subject: [PATCH 15/30] chg: [misp-rfc] new version of the taxonomy-format RFC published --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 605a0ba..5af3322 100755 --- a/README.md +++ b/README.md @@ -1,16 +1,16 @@ -# MISP standards +# MISP standards and RFCs This repository is the official source of the specification and formats used in the MISP project. The formats are described to support other implementations which reuse the format and ensuring an interoperability -with existing MISP software and other Threat Intelligence Platforms. +with existing MISP software, other Threat Intelligence Platforms and security tools at large. All the formats can be freely reused by everyone. ## MISP Formats in use and implemented in multiple software * [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [04](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) -* [misp-taxonomy-format](misp-taxonomy-format/raw.md.txt) ([markdown source](misp-taxonomy-format/raw.md)) which describes the taxonomy JSON format of MISP. Current Internet-Draft: [05](https://tools.ietf.org/html/draft-dulaunoy-misp-taxonomy-format) +* [misp-taxonomy-format](misp-taxonomy-format/raw.md.txt) ([markdown source](misp-taxonomy-format/raw.md)) which describes the taxonomy JSON format of MISP. Current Internet-Draft: [06](https://tools.ietf.org/html/draft-dulaunoy-misp-taxonomy-format) * [misp-galaxy-format](misp-galaxy-format/raw.md.txt) which describes the [galaxy](https://github.com/MISP/misp-galaxy) template format used to expand the threat actor modelling of MISP. Current Internet-Draft: [05](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-galaxy-format/) * [misp-object-template-format](misp-object-template-format/raw.md.txt) which describes the [object](https://github.com/MISP/misp-objects) template format to add combinedand composite object to the MISP core format. Current Internet-Draft: [01](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-object-template-format/) From 85dd657bac9aa370ff393cb5ecc27b073805e76f Mon Sep 17 00:00:00 2001 From: Christophe Vandeplas Date: Thu, 20 Dec 2018 12:58:38 +0100 Subject: [PATCH 16/30] chg: [datamodel] bump attributes mapping see issue MISP/MISP#3965 --- misp-core-format/raw.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index 43f7537..efcefff 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -309,7 +309,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : link, comment, text, hex, attachment, other **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type **Attribution** : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email @@ -324,16 +324,16 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-sha1, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type **Payload type** : comment, text, other @@ -505,7 +505,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : link, comment, text, hex, attachment, other **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type **Attribution** : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email @@ -520,16 +520,16 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-sha1, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type **Payload type** : comment, text, other From 111c55e481ffcf3d71aa2a0c6b26f2fde07b365d Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 30 Dec 2018 12:54:53 +0100 Subject: [PATCH 17/30] chg: [core] new types added --- misp-core-format/raw.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index 43f7537..c1554f5 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -309,13 +309,13 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : link, comment, text, hex, attachment, other **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type **Attribution** : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -324,16 +324,16 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-sha1, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type **Payload type** : comment, text, other @@ -505,13 +505,13 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : link, comment, text, hex, attachment, other **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type **Attribution** : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -520,16 +520,16 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-sha1, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type **Payload type** : comment, text, other From e289e0c8b0f39a2e0897fda1b7ed4193e2f4a5d1 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 30 Dec 2018 17:06:17 +0100 Subject: [PATCH 18/30] chg: [core] updated the ASCII output --- misp-core-format/raw.md.txt | 402 ++++++++++++++++++------------------ 1 file changed, 201 insertions(+), 201 deletions(-) diff --git a/misp-core-format/raw.md.txt b/misp-core-format/raw.md.txt index 3fa2676..a4ae974 100755 --- a/misp-core-format/raw.md.txt +++ b/misp-core-format/raw.md.txt @@ -5,7 +5,7 @@ Network Working Group A. Dulaunoy Internet-Draft A. Iklody Intended status: Informational CIRCL -Expires: October 12, 2018 April 10, 2018 +Expires: February 9, 2019 August 8, 2018 MISP core format @@ -37,7 +37,7 @@ Status of This Memo time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on October 12, 2018. + This Internet-Draft will expire on February 9, 2019. Copyright Notice @@ -53,9 +53,9 @@ Copyright Notice -Dulaunoy & Iklody Expires October 12, 2018 [Page 1] +Dulaunoy & Iklody Expires February 9, 2019 [Page 1] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 include Simplified BSD License text as described in Section 4.e of @@ -99,7 +99,7 @@ Table of Contents 5. Implementation . . . . . . . . . . . . . . . . . . . . . . . 48 6. Security Considerations . . . . . . . . . . . . . . . . . . . 48 7. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 48 - 8. Sample MISP file . . . . . . . . . . . . . . . . . . . . . . 48 + 8. References . . . . . . . . . . . . . . . . . . . . . . . . . 48 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 48 9.1. Normative References . . . . . . . . . . . . . . . . . . 48 9.2. Informative References . . . . . . . . . . . . . . . . . 49 @@ -109,9 +109,9 @@ Table of Contents -Dulaunoy & Iklody Expires October 12, 2018 [Page 2] +Dulaunoy & Iklody Expires February 9, 2019 [Page 2] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 1. Introduction @@ -165,9 +165,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 3] +Dulaunoy & Iklody Expires February 9, 2019 [Page 3] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.2.1.2. id @@ -221,9 +221,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 4] +Dulaunoy & Iklody Expires February 9, 2019 [Page 4] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.2.1.6. analysis @@ -277,9 +277,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 5] +Dulaunoy & Iklody Expires February 9, 2019 [Page 5] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.2.1.10. org_id @@ -333,9 +333,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 6] +Dulaunoy & Iklody Expires February 9, 2019 [Page 6] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 All Communities @@ -389,9 +389,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 7] +Dulaunoy & Iklody Expires February 9, 2019 [Page 7] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "Org": { @@ -445,9 +445,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 8] +Dulaunoy & Iklody Expires February 9, 2019 [Page 8] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "Attribute": { @@ -501,26 +501,26 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 9] +Dulaunoy & Iklody Expires February 9, 2019 [Page 9] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 link, comment, text, hex, attachment, other Artifacts dropped md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, - filename|sha1, filename|sha224, filename|sha256, filename|sha384, - filename|sha512, filename|sha512/224, filename|sha512/256, - filename|authentihash, filename|ssdeep, filename|tlsh, - filename|imphash, filename|impfuzzy, filename|pehash, regkey, - regkey|value, pattern-in-file, pattern-in-memory, pdb, - stix2-pattern, yara, sigma, attachment, malware-sample, named - pipe, mutex, windows-scheduled-task, windows-service-name, - windows-service-displayname, comment, text, hex, x509-fingerprint- - sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, - cookie, gene, mime-type + ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, + filename|md5, filename|sha1, filename|sha224, filename|sha256, + filename|sha384, filename|sha512, filename|sha512/224, + filename|sha512/256, filename|authentihash, filename|ssdeep, + filename|tlsh, filename|imphash, filename|impfuzzy, + filename|pehash, regkey, regkey|value, pattern-in-file, pattern- + in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware- + sample, named pipe, mutex, windows-scheduled-task, windows- + service-name, windows-service-displayname, comment, text, hex, + x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint- + sha256, other, cookie, gene, mime-type Attribution threat-actor, campaign-name, campaign-id, whois-registrant-phone, @@ -533,11 +533,11 @@ Internet-Draft MISP core format April 2018 md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac- address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, - regkey, regkey|value, AS, snort, pattern-in-file, pattern-in- + regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in- traffic, pattern-in-memory, vulnerability, attachment, malware- sample, link, comment, text, x509-fingerprint-sha1, x509- - fingerprint-md5, x509-fingerprint-sha256, github-repository, - other, cortex + fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, + github-repository, other, cortex Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, @@ -551,51 +551,52 @@ Internet-Draft MISP core format April 2018 domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user- agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- - sha1, other, hex, cookie, hostname|port + md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- + fingerprint-md5, other, hex, cookie, hostname|port, bro + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 10] + +Internet-Draft MISP core format August 2018 + Other - - - -Dulaunoy & Iklody Expires October 12, 2018 [Page 10] - -Internet-Draft MISP core format April 2018 - - comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean Payload delivery md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, - filename|md5, filename|sha1, filename|sha224, filename|sha256, - filename|sha384, filename|sha512, filename|sha512/224, - filename|sha512/256, filename|authentihash, filename|ssdeep, - filename|tlsh, filename|imphash, filename|impfuzzy, - filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip- - dst|port, ip-src|port, hostname, domain, email-src, email-dst, - email-subject, email-attachment, email-body, url, user-agent, AS, - pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, - mime-type, attachment, malware-sample, link, malware-type, - comment, text, hex, vulnerability, x509-fingerprint-sha1, x509- - fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, - email-dst-display-name, email-src-display-name, email-header, - email-reply-to, email-x-mailer, email-mime-boundary, email-thread- - index, email-message-id, mobile-application-id, whois-registrant- - email + ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, + filename, filename|md5, filename|sha1, filename|sha224, + filename|sha256, filename|sha384, filename|sha512, + filename|sha512/224, filename|sha512/256, filename|authentihash, + filename|ssdeep, filename|tlsh, filename|imphash, + filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip- + src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email- + src, email-dst, email-subject, email-attachment, email-body, url, + user-agent, AS, pattern-in-file, pattern-in-traffic, + stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, + link, malware-type, comment, text, hex, vulnerability, x509- + fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, + ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, + email-src-display-name, email-header, email-reply-to, email- + x-mailer, email-mime-boundary, email-thread-index, email-message- + id, mobile-application-id, whois-registrant-email Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, - filename|md5, filename|sha1, filename|sha224, filename|sha256, - filename|sha384, filename|sha512, filename|sha512/224, - filename|sha512/256, filename|authentihash, filename|ssdeep, - filename|tlsh, filename|imphash, filename|impfuzzy, - filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in- - memory, stix2-pattern, yara, sigma, vulnerability, attachment, - malware-sample, malware-type, comment, text, hex, x509- - fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - mobile-application-id, other, mime-type + ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, + filename, filename|md5, filename|sha1, filename|sha224, + filename|sha256, filename|sha384, filename|sha512, + filename|sha512/224, filename|sha512/256, filename|authentihash, + filename|ssdeep, filename|tlsh, filename|imphash, + filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in- + traffic, pattern-in-memory, stix2-pattern, yara, sigma, + vulnerability, attachment, malware-sample, malware-type, comment, + text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509- + fingerprint-sha256, mobile-application-id, other, mime-type Payload type comment, text, other @@ -609,15 +610,15 @@ Internet-Draft MISP core format April 2018 redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place- - port-of-original-embarkation, place-port-of-clearance, place-port- -Dulaunoy & Iklody Expires October 12, 2018 [Page 11] +Dulaunoy & Iklody Expires February 9, 2019 [Page 11] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 + port-of-original-embarkation, place-port-of-clearance, place-port- of-onward-foreign-destination, passenger-name-record-locator- number, comment, text, other, phone-number, identity-card-number @@ -665,15 +666,16 @@ Internet-Draft MISP core format April 2018 The event_id SHOULD be updated when the event is imported to reflect the newly created event's id on the instance. - event_id is represented as a JSON string. event_id MUST be present. -Dulaunoy & Iklody Expires October 12, 2018 [Page 12] +Dulaunoy & Iklody Expires February 9, 2019 [Page 12] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 + event_id is represented as a JSON string. event_id MUST be present. + 2.4.2.7. distribution distribution represents the basic distribution rules of the @@ -719,17 +721,18 @@ Internet-Draft MISP core format April 2018 sharing_group_id represents a human-readable identifier referencing a Sharing Group object that defines the distribution of the attribute, + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 13] + +Internet-Draft MISP core format August 2018 + + if distribution level "4" is set. A human-readable identifier MUST be represented as an unsigned integer. - - - -Dulaunoy & Iklody Expires October 12, 2018 [Page 13] - -Internet-Draft MISP core format April 2018 - - sharing_group_id is represented by a JSON string and SHOULD be present. If a distribution level other than "4" is chosen the sharing_group_id MUST be set to "0". @@ -778,12 +781,9 @@ Internet-Draft MISP core format April 2018 - - - -Dulaunoy & Iklody Expires October 12, 2018 [Page 14] +Dulaunoy & Iklody Expires February 9, 2019 [Page 14] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.4.2.15. value @@ -837,9 +837,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 15] +Dulaunoy & Iklody Expires February 9, 2019 [Page 15] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.5.2.1. uuid @@ -873,17 +873,17 @@ Internet-Draft MISP core format April 2018 Artifacts dropped md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, filename, filename|md5, - filename|sha1, filename|sha224, filename|sha256, filename|sha384, - filename|sha512, filename|sha512/224, filename|sha512/256, - filename|authentihash, filename|ssdeep, filename|tlsh, - filename|imphash, filename|impfuzzy, filename|pehash, regkey, - regkey|value, pattern-in-file, pattern-in-memory, pdb, - stix2-pattern, yara, sigma, attachment, malware-sample, named - pipe, mutex, windows-scheduled-task, windows-service-name, - windows-service-displayname, comment, text, hex, x509-fingerprint- - sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, - cookie, gene, mime-type + ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, + filename|md5, filename|sha1, filename|sha224, filename|sha256, + filename|sha384, filename|sha512, filename|sha512/224, + filename|sha512/256, filename|authentihash, filename|ssdeep, + filename|tlsh, filename|imphash, filename|impfuzzy, + filename|pehash, regkey, regkey|value, pattern-in-file, pattern- + in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware- + sample, named pipe, mutex, windows-scheduled-task, windows- + service-name, windows-service-displayname, comment, text, hex, + x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint- + sha256, other, cookie, gene, mime-type Attribution threat-actor, campaign-name, campaign-id, whois-registrant-phone, @@ -893,9 +893,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 16] +Dulaunoy & Iklody Expires February 9, 2019 [Page 16] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, @@ -905,11 +905,11 @@ Internet-Draft MISP core format April 2018 md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac- address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, - regkey, regkey|value, AS, snort, pattern-in-file, pattern-in- + regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in- traffic, pattern-in-memory, vulnerability, attachment, malware- sample, link, comment, text, x509-fingerprint-sha1, x509- - fingerprint-md5, x509-fingerprint-sha256, github-repository, - other, cortex + fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, + github-repository, other, cortex Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, @@ -923,7 +923,8 @@ Internet-Draft MISP core format April 2018 domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user- agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- - sha1, other, hex, cookie, hostname|port + md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- + fingerprint-md5, other, hex, cookie, hostname|port, bro Other comment, text, other, size-in-bytes, counter, datetime, cpe, port, @@ -931,44 +932,43 @@ Internet-Draft MISP core format April 2018 Payload delivery md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, - filename|md5, filename|sha1, filename|sha224, filename|sha256, - filename|sha384, filename|sha512, filename|sha512/224, - filename|sha512/256, filename|authentihash, filename|ssdeep, - filename|tlsh, filename|imphash, filename|impfuzzy, - filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip- - dst|port, ip-src|port, hostname, domain, email-src, email-dst, - email-subject, email-attachment, email-body, url, user-agent, AS, - pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, - mime-type, attachment, malware-sample, link, malware-type, - comment, text, hex, vulnerability, x509-fingerprint-sha1, x509- - fingerprint-md5, x509-fingerprint-sha256, other, hostname|port, - email-dst-display-name, email-src-display-name, email-header, - email-reply-to, email-x-mailer, email-mime-boundary, email-thread- + ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, + filename, filename|md5, filename|sha1, filename|sha224, + filename|sha256, filename|sha384, filename|sha512, + filename|sha512/224, filename|sha512/256, filename|authentihash, + filename|ssdeep, filename|tlsh, filename|imphash, + filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip- + src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email- + src, email-dst, email-subject, email-attachment, email-body, url, + user-agent, AS, pattern-in-file, pattern-in-traffic, + stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, + link, malware-type, comment, text, hex, vulnerability, x509- + fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, + ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, + email-src-display-name, email-header, email-reply-to, email- - -Dulaunoy & Iklody Expires October 12, 2018 [Page 17] +Dulaunoy & Iklody Expires February 9, 2019 [Page 17] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 - index, email-message-id, mobile-application-id, whois-registrant- - email + x-mailer, email-mime-boundary, email-thread-index, email-message- + id, mobile-application-id, whois-registrant-email Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, - ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, filename, - filename|md5, filename|sha1, filename|sha224, filename|sha256, - filename|sha384, filename|sha512, filename|sha512/224, - filename|sha512/256, filename|authentihash, filename|ssdeep, - filename|tlsh, filename|imphash, filename|impfuzzy, - filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in- - memory, stix2-pattern, yara, sigma, vulnerability, attachment, - malware-sample, malware-type, comment, text, hex, x509- - fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - mobile-application-id, other, mime-type + ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, + filename, filename|md5, filename|sha1, filename|sha224, + filename|sha256, filename|sha384, filename|sha512, + filename|sha512/224, filename|sha512/256, filename|authentihash, + filename|ssdeep, filename|tlsh, filename|imphash, + filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in- + traffic, pattern-in-memory, stix2-pattern, yara, sigma, + vulnerability, attachment, malware-sample, malware-type, comment, + text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509- + fingerprint-sha256, mobile-application-id, other, mime-type Payload type comment, text, other @@ -1005,9 +1005,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 18] +Dulaunoy & Iklody Expires February 9, 2019 [Page 18] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.5.2.4. category @@ -1061,9 +1061,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 19] +Dulaunoy & Iklody Expires February 9, 2019 [Page 19] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.5.2.8. timestamp @@ -1117,9 +1117,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 20] +Dulaunoy & Iklody Expires February 9, 2019 [Page 20] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.5.2.13. data @@ -1173,9 +1173,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 21] +Dulaunoy & Iklody Expires February 9, 2019 [Page 21] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 template used for its creation within. Objects belong to a meta- @@ -1229,9 +1229,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 22] +Dulaunoy & Iklody Expires February 9, 2019 [Page 22] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.6.2. Object Attributes @@ -1285,9 +1285,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 23] +Dulaunoy & Iklody Expires February 9, 2019 [Page 23] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.6.2.7. template_version @@ -1341,9 +1341,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 24] +Dulaunoy & Iklody Expires February 9, 2019 [Page 24] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 Sharing Group @@ -1397,9 +1397,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 25] +Dulaunoy & Iklody Expires February 9, 2019 [Page 25] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.7.1. Sample ObjectReference object @@ -1453,9 +1453,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 26] +Dulaunoy & Iklody Expires February 9, 2019 [Page 26] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.7.2.5. event_id @@ -1509,9 +1509,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 27] +Dulaunoy & Iklody Expires February 9, 2019 [Page 27] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.7.2.11. object_uuid @@ -1565,9 +1565,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 28] +Dulaunoy & Iklody Expires February 9, 2019 [Page 28] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 element describes one singular instance of a sighting. A sighting @@ -1621,9 +1621,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 29] +Dulaunoy & Iklody Expires February 9, 2019 [Page 29] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 2.9.1. Sample Sighting @@ -1677,9 +1677,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 30] +Dulaunoy & Iklody Expires February 9, 2019 [Page 30] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "Galaxy": [ { @@ -1733,9 +1733,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 31] +Dulaunoy & Iklody Expires February 9, 2019 [Page 31] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 3. JSON Schema @@ -1789,9 +1789,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 32] +Dulaunoy & Iklody Expires February 9, 2019 [Page 32] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "type": "object", @@ -1845,9 +1845,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 33] +Dulaunoy & Iklody Expires February 9, 2019 [Page 33] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "items": { @@ -1901,9 +1901,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 34] +Dulaunoy & Iklody Expires February 9, 2019 [Page 34] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "type": "string" @@ -1957,9 +1957,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 35] +Dulaunoy & Iklody Expires February 9, 2019 [Page 35] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "type": "string" @@ -2013,9 +2013,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 36] +Dulaunoy & Iklody Expires February 9, 2019 [Page 36] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 }, @@ -2069,9 +2069,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 37] +Dulaunoy & Iklody Expires February 9, 2019 [Page 37] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 }, @@ -2125,9 +2125,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 38] +Dulaunoy & Iklody Expires February 9, 2019 [Page 38] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 }, @@ -2181,9 +2181,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 39] +Dulaunoy & Iklody Expires February 9, 2019 [Page 39] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 }, @@ -2237,9 +2237,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 40] +Dulaunoy & Iklody Expires February 9, 2019 [Page 40] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "additionalProperties": false, @@ -2293,9 +2293,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 41] +Dulaunoy & Iklody Expires February 9, 2019 [Page 41] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "type": "string" @@ -2349,9 +2349,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 42] +Dulaunoy & Iklody Expires February 9, 2019 [Page 42] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "type": "array", @@ -2405,9 +2405,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 43] +Dulaunoy & Iklody Expires February 9, 2019 [Page 43] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "additionalProperties": false, @@ -2461,9 +2461,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 44] +Dulaunoy & Iklody Expires February 9, 2019 [Page 44] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "value": { @@ -2517,9 +2517,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 45] +Dulaunoy & Iklody Expires February 9, 2019 [Page 45] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 4. Manifest @@ -2573,9 +2573,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 46] +Dulaunoy & Iklody Expires February 9, 2019 [Page 46] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 4.1.1. Sample Manifest @@ -2629,9 +2629,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 47] +Dulaunoy & Iklody Expires February 9, 2019 [Page 47] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 "threat_level_id": "3" @@ -2665,7 +2665,7 @@ Internet-Draft MISP core format April 2018 the creation of open standards in threat intelligence sharing. A special thank to Nicolas Bareil for the review of the JSON Schema. -8. Sample MISP file +8. References 9. References @@ -2685,9 +2685,9 @@ Internet-Draft MISP core format April 2018 -Dulaunoy & Iklody Expires October 12, 2018 [Page 48] +Dulaunoy & Iklody Expires February 9, 2019 [Page 48] -Internet-Draft MISP core format April 2018 +Internet-Draft MISP core format August 2018 [RFC4627] Crockford, D., "The application/json Media Type for @@ -2741,4 +2741,4 @@ Authors' Addresses -Dulaunoy & Iklody Expires October 12, 2018 [Page 49] +Dulaunoy & Iklody Expires February 9, 2019 [Page 49] From 41129890bd9504649918dca16c9a1519147ea4a7 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 30 Dec 2018 17:23:14 +0100 Subject: [PATCH 19/30] chg: [core] new ID for misp-core --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 5af3322..aa1f403 100755 --- a/README.md +++ b/README.md @@ -9,7 +9,7 @@ All the formats can be freely reused by everyone. ## MISP Formats in use and implemented in multiple software -* [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [04](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) +* [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [06](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) * [misp-taxonomy-format](misp-taxonomy-format/raw.md.txt) ([markdown source](misp-taxonomy-format/raw.md)) which describes the taxonomy JSON format of MISP. Current Internet-Draft: [06](https://tools.ietf.org/html/draft-dulaunoy-misp-taxonomy-format) * [misp-galaxy-format](misp-galaxy-format/raw.md.txt) which describes the [galaxy](https://github.com/MISP/misp-galaxy) template format used to expand the threat actor modelling of MISP. Current Internet-Draft: [05](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-galaxy-format/) * [misp-object-template-format](misp-object-template-format/raw.md.txt) which describes the [object](https://github.com/MISP/misp-objects) template format to add combinedand composite object to the MISP core format. Current Internet-Draft: [01](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-object-template-format/) From 566dfc25a6cf7d3bd35a4314fb346adc07eb10a6 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 6 Jan 2019 16:38:49 +0100 Subject: [PATCH 20/30] chg: [query] some more fields added --- misp-query-format/raw.md | 26 +++++++++++++++++--------- 1 file changed, 17 insertions(+), 9 deletions(-) diff --git a/misp-query-format/raw.md b/misp-query-format/raw.md index db3dd63..29acbe5 100755 --- a/misp-query-format/raw.md +++ b/misp-query-format/raw.md @@ -96,15 +96,15 @@ page **MAY** be present. If present, the page parameter **MUST** also be supplie ### value -value **MAY** be present. If set, the returned data set will be filtered on the attribute value field. value **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. +value **MAY** be present. If set, the returned data set will be filtered on the attribute value field. value **MUST** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. ### type -type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [@?MISP-C] in the attribute type section. +type **MAY** be present. If set, the returned data set will be filtered on the attribute type field. type **MUST** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid attribute types is described in the MISP core format [@?MISP-C] in the attribute type section. ### category -category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. +category **MAY** be present. If set, the returned data set will be filtered on the attribute category field. category **MUST** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. The list of valid categories is described in the MISP core format [@?MISP-C] in the attribute type section. A sample query to lookup for the last 30 days of indicators in the `Financial fraud` category and output in CSV format: @@ -122,7 +122,7 @@ org **MAY** be present. If set, the returned data set will be filtered by the or ### tags -tags **MAY** be present. If set, the returned data set will be filtered by tags. tags **MAY** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. +tags **MAY** be present. If set, the returned data set will be filtered by tags. tags **MUST** be a string or a sub-string, the latter of which starts with, ends with or is encapsulated in wildcard (\%) characters. ~~~~ { @@ -136,7 +136,7 @@ tags **MAY** be present. If set, the returned data set will be filtered by tags. ### from -from **MAY** be present. If set, the returned data set will be filtered from a starting date. from **MAY** be a string represented in the format year-month-date. +from **MAY** be present. If set, the returned data set will be filtered from a starting date. from **MUST** be a string represented in the format year-month-date. ~~~~ { @@ -150,18 +150,26 @@ from **MAY** be present. If set, the returned data set will be filtered from a s ### to -to **MAY** be present. If set, the returned data set will be filtered until the specified date. from **MAY** be a string represented in the format year-month-date. +to **MAY** be present. If set, the returned data set will be filtered until the specified date. from **MUST** be a string represented in the format year-month-date. ### last -last **MAY** be present. If set, the returned data set - +last **MAY** be present. If set, the returned data set will be filtered in the number of days, hours or minutes defined (such as 5d, 12h or 30m). last **MUST** be a string represented in the format expressing days, hours or minutes. ### eventid +eventid **MAY** be present. If set, the returned data set will be filtered to a specific event. eventid **MUST** be a string representing the event id as an integer. + +~~~~ +{ + "returnFormat": "json", + "eventid": 1 +} +~~~~ + ### withAttachments -### metadata +withAttachments **MAY** be present. If set to True (1), the returned data set will include the attachment(s) matching the query. withAttachments **MUST** be an integer set as 1 (True) to include the attachment(s). If not, the attachment(s) won't be included in the results. ### uuid From 602ea6ccde1f65726981aa3311cdd34d130f85ec Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 13 Jan 2019 12:27:47 +0100 Subject: [PATCH 21/30] chg: [datamodels] new types added --- misp-core-format/raw.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index c1554f5..76f7517 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -315,7 +315,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -324,13 +324,13 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** : md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type @@ -511,7 +511,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -520,13 +520,13 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email **Payload installation** : md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type From 0cb9a0f46e41d24512c6bfc73918aade0f4efc57 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 13 Jan 2019 12:34:24 +0100 Subject: [PATCH 22/30] chg: [datatypes] updated to the latest version --- misp-core-format/raw.md.txt | 48 ++++++++++++++++++------------------- 1 file changed, 24 insertions(+), 24 deletions(-) diff --git a/misp-core-format/raw.md.txt b/misp-core-format/raw.md.txt index a4ae974..5514a72 100755 --- a/misp-core-format/raw.md.txt +++ b/misp-core-format/raw.md.txt @@ -537,7 +537,7 @@ Internet-Draft MISP core format August 2018 traffic, pattern-in-memory, vulnerability, attachment, malware- sample, link, comment, text, x509-fingerprint-sha1, x509- fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, - github-repository, other, cortex + hassh-md5, hasshserver-md5, github-repository, other, cortex Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, @@ -552,8 +552,8 @@ Internet-Draft MISP core format August 2018 agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- - fingerprint-md5, other, hex, cookie, hostname|port, bro - + fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, + hostname|port, bro @@ -580,10 +580,11 @@ Internet-Draft MISP core format August 2018 stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509- fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, - email-src-display-name, email-header, email-reply-to, email- - x-mailer, email-mime-boundary, email-thread-index, email-message- - id, mobile-application-id, whois-registrant-email + ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, + hostname|port, email-dst-display-name, email-src-display-name, + email-header, email-reply-to, email-x-mailer, email-mime-boundary, + email-thread-index, email-message-id, mobile-application-id, + whois-registrant-email Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -609,7 +610,6 @@ Internet-Draft MISP core format August 2018 gender, passport-number, passport-country, passport-expiration, redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, - frequent-flyer-number, travel-details, payment-details, place- @@ -618,6 +618,7 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 11] Internet-Draft MISP core format August 2018 + frequent-flyer-number, travel-details, payment-details, place- port-of-original-embarkation, place-port-of-clearance, place-port- of-onward-foreign-destination, passenger-name-record-locator- number, comment, text, other, phone-number, identity-card-number @@ -668,7 +669,6 @@ Internet-Draft MISP core format August 2018 - Dulaunoy & Iklody Expires February 9, 2019 [Page 12] Internet-Draft MISP core format August 2018 @@ -909,7 +909,7 @@ Internet-Draft MISP core format August 2018 traffic, pattern-in-memory, vulnerability, attachment, malware- sample, link, comment, text, x509-fingerprint-sha1, x509- fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, - github-repository, other, cortex + hassh-md5, hasshserver-md5, github-repository, other, cortex Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, @@ -924,7 +924,8 @@ Internet-Draft MISP core format August 2018 agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- - fingerprint-md5, other, hex, cookie, hostname|port, bro + fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, + hostname|port, bro Other comment, text, other, size-in-bytes, counter, datetime, cpe, port, @@ -944,8 +945,7 @@ Internet-Draft MISP core format August 2018 stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509- fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - ja3-fingerprint-md5, other, hostname|port, email-dst-display-name, - email-src-display-name, email-header, email-reply-to, email- + ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, @@ -954,8 +954,10 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 17] Internet-Draft MISP core format August 2018 - x-mailer, email-mime-boundary, email-thread-index, email-message- - id, mobile-application-id, whois-registrant-email + hostname|port, email-dst-display-name, email-src-display-name, + email-header, email-reply-to, email-x-mailer, email-mime-boundary, + email-thread-index, email-message-id, mobile-application-id, + whois-registrant-email Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -998,9 +1000,7 @@ Internet-Draft MISP core format August 2018 target-user, target-email, target-machine, target-org, target- location, target-external, comment - Attributes are based on the usage within their different communities. - Attributes can be extended on a regular basis and this reference - document is updated accordingly. + @@ -1010,6 +1010,10 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 18] Internet-Draft MISP core format August 2018 + Attributes are based on the usage within their different communities. + Attributes can be extended on a regular basis and this reference + document is updated accordingly. + 2.5.2.4. category category represents the intent of what the attribute is describing as @@ -1054,10 +1058,6 @@ Internet-Draft MISP core format August 2018 the ShadowAttribute proposes the creation of a new Attribute, it should be set to 0. - old_id is represented as a JSON string. old_id MUST be present. - - - @@ -1066,6 +1066,8 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 19] Internet-Draft MISP core format August 2018 + old_id is represented as a JSON string. old_id MUST be present. + 2.5.2.8. timestamp timestamp represents a reference time when the attribute was created @@ -1115,8 +1117,6 @@ Internet-Draft MISP core format August 2018 - - Dulaunoy & Iklody Expires February 9, 2019 [Page 20] Internet-Draft MISP core format August 2018 From 96e49165a64476328be37fbe16df905f89d49586 Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Wed, 30 Jan 2019 23:19:23 +0100 Subject: [PATCH 23/30] chg: [core] zeek type added --- misp-core-format/raw.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index 76f7517..4e8c466 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -315,7 +315,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -324,7 +324,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean @@ -511,7 +511,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex **Financial fraud** : btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex @@ -520,7 +520,7 @@ type is represented as a JSON string. type **MUST** be present and it **MUST** b : text, link, comment, other, hex **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek **Other** : comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean From 27ded7460a4ce509fb67260cf32633324545830b Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 1 Feb 2019 07:26:22 +0100 Subject: [PATCH 24/30] chg: [add] anonymise type added --- misp-core-format/raw.md | 64 ++++++++++++++++++++--------------------- 1 file changed, 32 insertions(+), 32 deletions(-) diff --git a/misp-core-format/raw.md b/misp-core-format/raw.md index 4e8c466..c2efc68 100755 --- a/misp-core-format/raw.md +++ b/misp-core-format/raw.md @@ -306,52 +306,52 @@ type represents the means through which an attribute tries to describe the inten type is represented as a JSON string. type **MUST** be present and it **MUST** be a valid selection for the chosen category. The list of valid category-type combinations is as follows: **Antivirus detection** -: link, comment, text, hex, attachment, other +: link, comment, text, hex, attachment, other, anonymised **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type, anonymised **Attribution** -: threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email +: threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email, anonymised **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex, anonymised **Financial fraud** -: btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex +: btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex, anonymised **Internal reference** -: text, link, comment, other, hex +: text, link, comment, other, hex, anonymised **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek, anonymised **Other** -: comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean +: comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean, anonymised **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email, anonymised **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type, anonymised **Payload type** -: comment, text, other +: comment, text, other, anonymised **Persistence mechanism** -: filename, regkey, regkey|value, comment, text, other, hex +: filename, regkey, regkey|value, comment, text, other, hex, anonymised **Person** -: first-name, middle-name, last-name, date-of-birth, place-of-birth, gender, passport-number, passport-country, passport-expiration, redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place-port-of-original-embarkation, place-port-of-clearance, place-port-of-onward-foreign-destination, passenger-name-record-locator-number, comment, text, other, phone-number, identity-card-number +: first-name, middle-name, last-name, date-of-birth, place-of-birth, gender, passport-number, passport-country, passport-expiration, redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place-port-of-original-embarkation, place-port-of-clearance, place-port-of-onward-foreign-destination, passenger-name-record-locator-number, comment, text, other, phone-number, identity-card-number, anonymised **Social network** -: github-username, github-repository, github-organisation, jabber-id, twitter-id, email-src, email-dst, comment, text, other, whois-registrant-email +: github-username, github-repository, github-organisation, jabber-id, twitter-id, email-src, email-dst, comment, text, other, whois-registrant-email, anonymised **Support Tool** -: link, text, attachment, comment, other, hex +: link, text, attachment, comment, other, hex, anonymised **Targeting data** -: target-user, target-email, target-machine, target-org, target-location, target-external, comment +: target-user, target-email, target-machine, target-org, target-location, target-external, comment, anonymised Attributes are based on the usage within their different communities. Attributes can be extended on a regular basis and this reference document is updated accordingly. @@ -502,52 +502,52 @@ type represents the means through which an attribute tries to describe the inten type is represented as a JSON string. type **MUST** be present and it **MUST** be a valid selection for the chosen category. The list of valid category-type combinations is as follows: **Antivirus detection** -: link, comment, text, hex, attachment, other +: link, comment, text, hex, attachment, other, anonymised **Artifacts dropped** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, regkey, regkey|value, pattern-in-file, pattern-in-memory, pdb, stix2-pattern, yara, sigma, attachment, malware-sample, named pipe, mutex, windows-scheduled-task, windows-service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, cookie, gene, mime-type, anonymised **Attribution** -: threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email +: threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant-org, whois-registrar, whois-creation-date, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, other, dns-soa-email, anonymised **External analysis** -: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex +: md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac-address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, pattern-in-traffic, pattern-in-memory, vulnerability, attachment, malware-sample, link, comment, text, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, github-repository, other, cortex, anonymised **Financial fraud** -: btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex +: btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, prtn, phone-number, comment, text, other, hex, anonymised **Internal reference** -: text, link, comment, other, hex +: text, link, comment, other, hex, anonymised **Network activity** -: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek +: ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, domain|ip, mac-address, mac-eui-64, email-dst, url, uri, user-agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint-md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, hostname|port, bro, zeek, anonymised **Other** -: comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean +: comment, text, other, size-in-bytes, counter, datetime, cpe, port, float, hex, phone-number, boolean, anonymised **Payload delivery** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, mac-address, mac-eui-64, ip-src, ip-dst, ip-dst|port, ip-src|port, hostname, domain, email-src, email-dst, email-subject, email-attachment, email-body, url, user-agent, AS, pattern-in-file, pattern-in-traffic, stix2-pattern, yara, sigma, mime-type, attachment, malware-sample, link, malware-type, comment, text, hex, vulnerability, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, whois-registrant-email, anonymised **Payload installation** -: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type +: md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, ssdeep, imphash, impfuzzy, authentihash, pehash, tlsh, cdhash, filename, filename|md5, filename|sha1, filename|sha224, filename|sha256, filename|sha384, filename|sha512, filename|sha512/224, filename|sha512/256, filename|authentihash, filename|ssdeep, filename|tlsh, filename|imphash, filename|impfuzzy, filename|pehash, pattern-in-file, pattern-in-traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, mobile-application-id, other, mime-type, anonymised **Payload type** -: comment, text, other +: comment, text, other, anonymised **Persistence mechanism** -: filename, regkey, regkey|value, comment, text, other, hex +: filename, regkey, regkey|value, comment, text, other, hex, anonymised **Person** -: first-name, middle-name, last-name, date-of-birth, place-of-birth, gender, passport-number, passport-country, passport-expiration, redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place-port-of-original-embarkation, place-port-of-clearance, place-port-of-onward-foreign-destination, passenger-name-record-locator-number, comment, text, other, phone-number, identity-card-number +: first-name, middle-name, last-name, date-of-birth, place-of-birth, gender, passport-number, passport-country, passport-expiration, redress-number, nationality, visa-number, issue-date-of-the-visa, primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place-port-of-original-embarkation, place-port-of-clearance, place-port-of-onward-foreign-destination, passenger-name-record-locator-number, comment, text, other, phone-number, identity-card-number, anonymised **Social network** -: github-username, github-repository, github-organisation, jabber-id, twitter-id, email-src, email-dst, comment, text, other, whois-registrant-email +: github-username, github-repository, github-organisation, jabber-id, twitter-id, email-src, email-dst, comment, text, other, whois-registrant-email, anonymised **Support Tool** -: link, text, attachment, comment, other, hex +: link, text, attachment, comment, other, hex, anonymised **Targeting data** -: target-user, target-email, target-machine, target-org, target-location, target-external, comment +: target-user, target-email, target-machine, target-org, target-location, target-external, comment, anonymised Attributes are based on the usage within their different communities. Attributes can be extended on a regular basis and this reference document is updated accordingly. From 19717ddf9e6fa75aa4d7b5fa8e475978e7af4fab Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 1 Feb 2019 07:29:11 +0100 Subject: [PATCH 25/30] chg: [core] updated to the latest version --- misp-core-format/raw.md.txt | 462 ++++++++++++++++++++---------------- 1 file changed, 259 insertions(+), 203 deletions(-) diff --git a/misp-core-format/raw.md.txt b/misp-core-format/raw.md.txt index 5514a72..7d39d20 100755 --- a/misp-core-format/raw.md.txt +++ b/misp-core-format/raw.md.txt @@ -78,32 +78,32 @@ Table of Contents 2.4.2. Attribute Attributes . . . . . . . . . . . . . . . . 9 2.5. ShadowAttribute . . . . . . . . . . . . . . . . . . . . . 15 2.5.1. Sample Attribute Object . . . . . . . . . . . . . . . 15 - 2.5.2. ShadowAttribute Attributes . . . . . . . . . . . . . 15 + 2.5.2. ShadowAttribute Attributes . . . . . . . . . . . . . 16 2.5.3. Org . . . . . . . . . . . . . . . . . . . . . . . . . 21 - 2.6. Object . . . . . . . . . . . . . . . . . . . . . . . . . 21 + 2.6. Object . . . . . . . . . . . . . . . . . . . . . . . . . 22 2.6.1. Sample Object object . . . . . . . . . . . . . . . . 22 2.6.2. Object Attributes . . . . . . . . . . . . . . . . . . 23 - 2.7. Object References . . . . . . . . . . . . . . . . . . . . 25 + 2.7. Object References . . . . . . . . . . . . . . . . . . . . 26 2.7.1. Sample ObjectReference object . . . . . . . . . . . . 26 - 2.7.2. ObjectReference Attributes . . . . . . . . . . . . . 26 - 2.8. Tag . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 - 2.8.1. Sample Tag . . . . . . . . . . . . . . . . . . . . . 28 - 2.9. Sighting . . . . . . . . . . . . . . . . . . . . . . . . 28 - 2.9.1. Sample Sighting . . . . . . . . . . . . . . . . . . . 30 - 2.10. Galaxy . . . . . . . . . . . . . . . . . . . . . . . . . 30 - 2.10.1. Sample Galaxy . . . . . . . . . . . . . . . . . . . 30 - 3. JSON Schema . . . . . . . . . . . . . . . . . . . . . . . . . 32 - 4. Manifest . . . . . . . . . . . . . . . . . . . . . . . . . . 46 - 4.1. Format . . . . . . . . . . . . . . . . . . . . . . . . . 46 - 4.1.1. Sample Manifest . . . . . . . . . . . . . . . . . . . 47 - 5. Implementation . . . . . . . . . . . . . . . . . . . . . . . 48 - 6. Security Considerations . . . . . . . . . . . . . . . . . . . 48 - 7. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 48 - 8. References . . . . . . . . . . . . . . . . . . . . . . . . . 48 - 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 48 - 9.1. Normative References . . . . . . . . . . . . . . . . . . 48 - 9.2. Informative References . . . . . . . . . . . . . . . . . 49 - Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 49 + 2.7.2. ObjectReference Attributes . . . . . . . . . . . . . 27 + 2.8. Tag . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 + 2.8.1. Sample Tag . . . . . . . . . . . . . . . . . . . . . 29 + 2.9. Sighting . . . . . . . . . . . . . . . . . . . . . . . . 29 + 2.9.1. Sample Sighting . . . . . . . . . . . . . . . . . . . 31 + 2.10. Galaxy . . . . . . . . . . . . . . . . . . . . . . . . . 31 + 2.10.1. Sample Galaxy . . . . . . . . . . . . . . . . . . . 31 + 3. JSON Schema . . . . . . . . . . . . . . . . . . . . . . . . . 33 + 4. Manifest . . . . . . . . . . . . . . . . . . . . . . . . . . 47 + 4.1. Format . . . . . . . . . . . . . . . . . . . . . . . . . 47 + 4.1.1. Sample Manifest . . . . . . . . . . . . . . . . . . . 48 + 5. Implementation . . . . . . . . . . . . . . . . . . . . . . . 49 + 6. Security Considerations . . . . . . . . . . . . . . . . . . . 49 + 7. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 49 + 8. References . . . . . . . . . . . . . . . . . . . . . . . . . 49 + 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 49 + 9.1. Normative References . . . . . . . . . . . . . . . . . . 49 + 9.2. Informative References . . . . . . . . . . . . . . . . . 50 + Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 50 @@ -506,7 +506,7 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 9] Internet-Draft MISP core format August 2018 - link, comment, text, hex, attachment, other + link, comment, text, hex, attachment, other, anonymised Artifacts dropped md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -520,31 +520,32 @@ Internet-Draft MISP core format August 2018 sample, named pipe, mutex, windows-scheduled-task, windows- service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint- - sha256, other, cookie, gene, mime-type + sha256, other, cookie, gene, mime-type, anonymised Attribution threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant- org, whois-registrar, whois-creation-date, comment, text, x509- fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - other, dns-soa-email + other, dns-soa-email, anonymised External analysis md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac- address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, - regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in- - traffic, pattern-in-memory, vulnerability, attachment, malware- - sample, link, comment, text, x509-fingerprint-sha1, x509- + regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, + pattern-in-traffic, pattern-in-memory, vulnerability, attachment, + malware-sample, link, comment, text, x509-fingerprint-sha1, x509- fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, - hassh-md5, hasshserver-md5, github-repository, other, cortex + hassh-md5, hasshserver-md5, github-repository, other, cortex, + anonymised Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, - prtn, phone-number, comment, text, other, hex + prtn, phone-number, comment, text, other, hex, anonymised Internal reference - text, link, comment, other, hex + text, link, comment, other, hex, anonymised Network activity ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, @@ -552,8 +553,7 @@ Internet-Draft MISP core format August 2018 agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- - fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, - hostname|port, bro + @@ -562,9 +562,12 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 10] Internet-Draft MISP core format August 2018 + fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, + hostname|port, bro, zeek, anonymised + Other comment, text, other, size-in-bytes, counter, datetime, cpe, port, - float, hex, phone-number, boolean + float, hex, phone-number, boolean, anonymised Payload delivery md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -584,7 +587,7 @@ Internet-Draft MISP core format August 2018 hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, - whois-registrant-email + whois-registrant-email, anonymised Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -597,19 +600,16 @@ Internet-Draft MISP core format August 2018 traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509- - fingerprint-sha256, mobile-application-id, other, mime-type + fingerprint-sha256, mobile-application-id, other, mime-type, + anonymised Payload type - comment, text, other + comment, text, other, anonymised Persistence mechanism - filename, regkey, regkey|value, comment, text, other, hex + filename, regkey, regkey|value, comment, text, other, hex, + anonymised - Person - first-name, middle-name, last-name, date-of-birth, place-of-birth, - gender, passport-number, passport-country, passport-expiration, - redress-number, nationality, visa-number, issue-date-of-the-visa, - primary-residence, country-of-residence, special-service-request, @@ -618,22 +618,28 @@ Dulaunoy & Iklody Expires February 9, 2019 [Page 11] Internet-Draft MISP core format August 2018 + Person + first-name, middle-name, last-name, date-of-birth, place-of-birth, + gender, passport-number, passport-country, passport-expiration, + redress-number, nationality, visa-number, issue-date-of-the-visa, + primary-residence, country-of-residence, special-service-request, frequent-flyer-number, travel-details, payment-details, place- port-of-original-embarkation, place-port-of-clearance, place-port- of-onward-foreign-destination, passenger-name-record-locator- - number, comment, text, other, phone-number, identity-card-number + number, comment, text, other, phone-number, identity-card-number, + anonymised Social network github-username, github-repository, github-organisation, jabber- id, twitter-id, email-src, email-dst, comment, text, other, whois- - registrant-email + registrant-email, anonymised Support Tool - link, text, attachment, comment, other, hex + link, text, attachment, comment, other, hex, anonymised Targeting data target-user, target-email, target-machine, target-org, target- - location, target-external, comment + location, target-external, comment, anonymised Attributes are based on the usage within their different communities. Attributes can be extended on a regular basis and this reference @@ -658,6 +664,16 @@ Internet-Draft MISP core format August 2018 to_ids is represented as a JSON boolean. to_ids MUST be present. + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 12] + +Internet-Draft MISP core format August 2018 + + 2.4.2.6. event_id event_id represents a human-readable identifier referencing the Event @@ -667,13 +683,6 @@ Internet-Draft MISP core format August 2018 The event_id SHOULD be updated when the event is imported to reflect the newly created event's id on the instance. - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 12] - -Internet-Draft MISP core format August 2018 - - event_id is represented as a JSON string. event_id MUST be present. 2.4.2.7. distribution @@ -711,6 +720,16 @@ Internet-Draft MISP core format August 2018 timestamp is represented as a JSON string. timestamp MUST be present. + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 13] + +Internet-Draft MISP core format August 2018 + + 2.4.2.9. comment comment is a contextual comment field. @@ -721,15 +740,6 @@ Internet-Draft MISP core format August 2018 sharing_group_id represents a human-readable identifier referencing a Sharing Group object that defines the distribution of the attribute, - - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 13] - -Internet-Draft MISP core format August 2018 - - if distribution level "4" is set. A human-readable identifier MUST be represented as an unsigned integer. @@ -766,6 +776,16 @@ Internet-Draft MISP core format August 2018 RelatedAttribute MAY be present. + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 14] + +Internet-Draft MISP core format August 2018 + + 2.4.2.14. ShadowAttribute ShadowAttribute is an array of shadow attributes that serve as @@ -779,13 +799,6 @@ Internet-Draft MISP core format August 2018 containing attribute's ID in the old_id field and the event's ID in the event_id field. - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 14] - -Internet-Draft MISP core format August 2018 - - 2.4.2.15. value value represents the payload of an attribute. The format of the @@ -807,6 +820,28 @@ Internet-Draft MISP core format August 2018 2.5.1. Sample Attribute Object + + + + + + + + + + + + + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 15] + +Internet-Draft MISP core format August 2018 + + "ShadowAttribute": { "id": "8", "type": "ip-src", @@ -830,18 +865,6 @@ Internet-Draft MISP core format August 2018 2.5.2. ShadowAttribute Attributes - - - - - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 15] - -Internet-Draft MISP core format August 2018 - - 2.5.2.1. uuid uuid represents the Universally Unique IDentifier (UUID) [RFC4122] of @@ -868,8 +891,15 @@ Internet-Draft MISP core format August 2018 MUST be a valid selection for the chosen category. The list of valid category-type combinations is as follows: + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 16] + +Internet-Draft MISP core format August 2018 + + Antivirus detection - link, comment, text, hex, attachment, other + link, comment, text, hex, attachment, other, anonymised Artifacts dropped md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -883,40 +913,32 @@ Internet-Draft MISP core format August 2018 sample, named pipe, mutex, windows-scheduled-task, windows- service-name, windows-service-displayname, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint- - sha256, other, cookie, gene, mime-type + sha256, other, cookie, gene, mime-type, anonymised Attribution threat-actor, campaign-name, campaign-id, whois-registrant-phone, whois-registrant-email, whois-registrant-name, whois-registrant- org, whois-registrar, whois-creation-date, comment, text, x509- - - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 16] - -Internet-Draft MISP core format August 2018 - - fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, - other, dns-soa-email + other, dns-soa-email, anonymised External analysis md5, sha1, sha256, filename, filename|md5, filename|sha1, filename|sha256, ip-src, ip-dst, ip-dst|port, ip-src|port, mac- address, mac-eui-64, hostname, domain, domain|ip, url, user-agent, - regkey, regkey|value, AS, snort, bro, pattern-in-file, pattern-in- - traffic, pattern-in-memory, vulnerability, attachment, malware- - sample, link, comment, text, x509-fingerprint-sha1, x509- + regkey, regkey|value, AS, snort, bro, zeek, pattern-in-file, + pattern-in-traffic, pattern-in-memory, vulnerability, attachment, + malware-sample, link, comment, text, x509-fingerprint-sha1, x509- fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, - hassh-md5, hasshserver-md5, github-repository, other, cortex + hassh-md5, hasshserver-md5, github-repository, other, cortex, + anonymised Financial fraud btc, xmr, iban, bic, bank-account-nr, aba-rtn, bin, cc-number, - prtn, phone-number, comment, text, other, hex + prtn, phone-number, comment, text, other, hex, anonymised Internal reference - text, link, comment, other, hex + text, link, comment, other, hex, anonymised Network activity ip-src, ip-dst, ip-dst|port, ip-src|port, port, hostname, domain, @@ -924,12 +946,20 @@ Internet-Draft MISP core format August 2018 agent, http-method, AS, snort, pattern-in-file, stix2-pattern, pattern-in-traffic, attachment, comment, text, x509-fingerprint- md5, x509-fingerprint-sha1, x509-fingerprint-sha256, ja3- + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 17] + +Internet-Draft MISP core format August 2018 + + fingerprint-md5, hassh-md5, hasshserver-md5, other, hex, cookie, - hostname|port, bro + hostname|port, bro, zeek, anonymised Other comment, text, other, size-in-bytes, counter, datetime, cpe, port, - float, hex, phone-number, boolean + float, hex, phone-number, boolean, anonymised Payload delivery md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -946,18 +976,10 @@ Internet-Draft MISP core format August 2018 link, malware-type, comment, text, hex, vulnerability, x509- fingerprint-sha1, x509-fingerprint-md5, x509-fingerprint-sha256, ja3-fingerprint-md5, hassh-md5, hasshserver-md5, other, - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 17] - -Internet-Draft MISP core format August 2018 - - hostname|port, email-dst-display-name, email-src-display-name, email-header, email-reply-to, email-x-mailer, email-mime-boundary, email-thread-index, email-message-id, mobile-application-id, - whois-registrant-email + whois-registrant-email, anonymised Payload installation md5, sha1, sha224, sha256, sha384, sha512, sha512/224, sha512/256, @@ -970,13 +992,23 @@ Internet-Draft MISP core format August 2018 traffic, pattern-in-memory, stix2-pattern, yara, sigma, vulnerability, attachment, malware-sample, malware-type, comment, text, hex, x509-fingerprint-sha1, x509-fingerprint-md5, x509- - fingerprint-sha256, mobile-application-id, other, mime-type + fingerprint-sha256, mobile-application-id, other, mime-type, + anonymised Payload type - comment, text, other + comment, text, other, anonymised Persistence mechanism - filename, regkey, regkey|value, comment, text, other, hex + filename, regkey, regkey|value, comment, text, other, hex, + anonymised + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 18] + +Internet-Draft MISP core format August 2018 + Person first-name, middle-name, last-name, date-of-birth, place-of-birth, @@ -986,29 +1018,20 @@ Internet-Draft MISP core format August 2018 frequent-flyer-number, travel-details, payment-details, place- port-of-original-embarkation, place-port-of-clearance, place-port- of-onward-foreign-destination, passenger-name-record-locator- - number, comment, text, other, phone-number, identity-card-number + number, comment, text, other, phone-number, identity-card-number, + anonymised Social network github-username, github-repository, github-organisation, jabber- id, twitter-id, email-src, email-dst, comment, text, other, whois- - registrant-email + registrant-email, anonymised Support Tool - link, text, attachment, comment, other, hex + link, text, attachment, comment, other, hex, anonymised Targeting data target-user, target-email, target-machine, target-org, target- - location, target-external, comment - - - - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 18] - -Internet-Draft MISP core format August 2018 - + location, target-external, comment, anonymised Attributes are based on the usage within their different communities. Attributes can be extended on a regular basis and this reference @@ -1034,6 +1057,15 @@ Internet-Draft MISP core format August 2018 to_ids is represented as a JSON boolean. to_ids MUST be present. + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 19] + +Internet-Draft MISP core format August 2018 + + 2.5.2.6. event_id event_id represents a human-readable identifier referencing the Event @@ -1058,14 +1090,6 @@ Internet-Draft MISP core format August 2018 the ShadowAttribute proposes the creation of a new Attribute, it should be set to 0. - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 19] - -Internet-Draft MISP core format August 2018 - - old_id is represented as a JSON string. old_id MUST be present. 2.5.2.8. timestamp @@ -1088,6 +1112,16 @@ Internet-Draft MISP core format August 2018 proposal creator's Organisation object. A human-readable identifier MUST be represented as an unsigned integer. + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 20] + +Internet-Draft MISP core format August 2018 + + Whilst attributes can only be created by the event creator organisation, shadow attributes can be created by third parties. org_id tracks the creator organisation. @@ -1114,14 +1148,6 @@ Internet-Draft MISP core format August 2018 deleted is represented by a JSON boolean. deleted SHOULD be present. - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 20] - -Internet-Draft MISP core format August 2018 - - 2.5.2.13. data data contains the base64 encoded contents of an attachment or a @@ -1145,6 +1171,13 @@ Internet-Draft MISP core format August 2018 instance and used as reference in the event. A human-readable identifier MUST be represented as an unsigned integer. + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 21] + +Internet-Draft MISP core format August 2018 + + uuid, name and id are represented as a JSON string. uuid, name and id MUST be present. @@ -1169,15 +1202,6 @@ Internet-Draft MISP core format August 2018 within an event. Their main purpose is to describe more complex structures than can be described by a single attribute Each object is created using an Object Template and carries the meta-data of the - - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 21] - -Internet-Draft MISP core format August 2018 - - template used for its creation within. Objects belong to a meta- category and are defined by a name. @@ -1190,6 +1214,26 @@ Internet-Draft MISP core format August 2018 2.6.1. Sample Object object + + + + + + + + + + + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 22] + +Internet-Draft MISP core format August 2018 + + "Object": { "id": "588", "name": "file", @@ -1227,13 +1271,6 @@ Internet-Draft MISP core format August 2018 ] } - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 22] - -Internet-Draft MISP core format August 2018 - - 2.6.2. Object Attributes 2.6.2.1. uuid @@ -1243,6 +1280,16 @@ Internet-Draft MISP core format August 2018 of the same object. UUID version 4 is RECOMMENDED when assigning it to a new object. + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 23] + +Internet-Draft MISP core format August 2018 + + 2.6.2.2. id id represents the human-readable identifier associated to the object @@ -1282,14 +1329,6 @@ Internet-Draft MISP core format August 2018 for creation. UUID version 4 is RECOMMENDED when assigning it to a new object. - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 23] - -Internet-Draft MISP core format August 2018 - - 2.6.2.7. template_version template_version represents a numeric incrementing version of the @@ -1300,6 +1339,13 @@ Internet-Draft MISP core format August 2018 version is represented as a JSON string. version MUST be present. + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 24] + +Internet-Draft MISP core format August 2018 + + 2.6.2.8. event_id event_id represents the human-readable identifier of the event that @@ -1338,14 +1384,6 @@ Internet-Draft MISP core format August 2018 All Communities 4 - - - -Dulaunoy & Iklody Expires February 9, 2019 [Page 24] - -Internet-Draft MISP core format August 2018 - - Sharing Group 2.6.2.11. sharing_group_id @@ -1355,6 +1393,15 @@ Internet-Draft MISP core format August 2018 distribution level "4" is set. A human-readable identifier MUST be represented as an unsigned integer. + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 25] + +Internet-Draft MISP core format August 2018 + + sharing_group_id is represented by a JSON string and SHOULD be present. If a distribution level other than "4" is chosen the sharing_group_id MUST be set to "0". @@ -1394,16 +1441,23 @@ Internet-Draft MISP core format August 2018 All Object References MUST contain an object_uuid, a referenced_uuid and a relationship type. +2.7.1. Sample ObjectReference object -Dulaunoy & Iklody Expires February 9, 2019 [Page 25] + + + + + + + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 26] Internet-Draft MISP core format August 2018 -2.7.1. Sample ObjectReference object - "ObjectReference": { "id": "195", "uuid": "59c21a2c-c0ac-4083-93b3-363da07724d1", @@ -1453,7 +1507,9 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 26] + + +Dulaunoy & Iklody Expires February 9, 2019 [Page 27] Internet-Draft MISP core format August 2018 @@ -1509,7 +1565,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 27] +Dulaunoy & Iklody Expires February 9, 2019 [Page 28] Internet-Draft MISP core format August 2018 @@ -1565,7 +1621,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 28] +Dulaunoy & Iklody Expires February 9, 2019 [Page 29] Internet-Draft MISP core format August 2018 @@ -1621,7 +1677,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 29] +Dulaunoy & Iklody Expires February 9, 2019 [Page 30] Internet-Draft MISP core format August 2018 @@ -1677,7 +1733,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 30] +Dulaunoy & Iklody Expires February 9, 2019 [Page 31] Internet-Draft MISP core format August 2018 @@ -1733,7 +1789,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 31] +Dulaunoy & Iklody Expires February 9, 2019 [Page 32] Internet-Draft MISP core format August 2018 @@ -1789,7 +1845,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 32] +Dulaunoy & Iklody Expires February 9, 2019 [Page 33] Internet-Draft MISP core format August 2018 @@ -1845,7 +1901,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 33] +Dulaunoy & Iklody Expires February 9, 2019 [Page 34] Internet-Draft MISP core format August 2018 @@ -1901,7 +1957,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 34] +Dulaunoy & Iklody Expires February 9, 2019 [Page 35] Internet-Draft MISP core format August 2018 @@ -1957,7 +2013,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 35] +Dulaunoy & Iklody Expires February 9, 2019 [Page 36] Internet-Draft MISP core format August 2018 @@ -2013,7 +2069,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 36] +Dulaunoy & Iklody Expires February 9, 2019 [Page 37] Internet-Draft MISP core format August 2018 @@ -2069,7 +2125,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 37] +Dulaunoy & Iklody Expires February 9, 2019 [Page 38] Internet-Draft MISP core format August 2018 @@ -2125,7 +2181,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 38] +Dulaunoy & Iklody Expires February 9, 2019 [Page 39] Internet-Draft MISP core format August 2018 @@ -2181,7 +2237,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 39] +Dulaunoy & Iklody Expires February 9, 2019 [Page 40] Internet-Draft MISP core format August 2018 @@ -2237,7 +2293,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 40] +Dulaunoy & Iklody Expires February 9, 2019 [Page 41] Internet-Draft MISP core format August 2018 @@ -2293,7 +2349,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 41] +Dulaunoy & Iklody Expires February 9, 2019 [Page 42] Internet-Draft MISP core format August 2018 @@ -2349,7 +2405,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 42] +Dulaunoy & Iklody Expires February 9, 2019 [Page 43] Internet-Draft MISP core format August 2018 @@ -2405,7 +2461,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 43] +Dulaunoy & Iklody Expires February 9, 2019 [Page 44] Internet-Draft MISP core format August 2018 @@ -2461,7 +2517,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 44] +Dulaunoy & Iklody Expires February 9, 2019 [Page 45] Internet-Draft MISP core format August 2018 @@ -2517,7 +2573,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 45] +Dulaunoy & Iklody Expires February 9, 2019 [Page 46] Internet-Draft MISP core format August 2018 @@ -2573,7 +2629,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 46] +Dulaunoy & Iklody Expires February 9, 2019 [Page 47] Internet-Draft MISP core format August 2018 @@ -2629,7 +2685,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 47] +Dulaunoy & Iklody Expires February 9, 2019 [Page 48] Internet-Draft MISP core format August 2018 @@ -2685,7 +2741,7 @@ Internet-Draft MISP core format August 2018 -Dulaunoy & Iklody Expires February 9, 2019 [Page 48] +Dulaunoy & Iklody Expires February 9, 2019 [Page 49] Internet-Draft MISP core format August 2018 @@ -2741,4 +2797,4 @@ Authors' Addresses -Dulaunoy & Iklody Expires February 9, 2019 [Page 49] +Dulaunoy & Iklody Expires February 9, 2019 [Page 50] From 1b8a0fcbf3af99d6137a0f193318f03e0aaec26e Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Sun, 3 Feb 2019 14:12:19 +0100 Subject: [PATCH 26/30] chg: [core-format] updated to the latest version 07 --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index aa1f403..5ef820d 100755 --- a/README.md +++ b/README.md @@ -9,7 +9,7 @@ All the formats can be freely reused by everyone. ## MISP Formats in use and implemented in multiple software -* [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [06](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) +* [misp-core-format](misp-core-format/raw.md.txt) ([markdown source](misp-core-format/raw.md)) which describes the core JSON format of MISP. Current Internet-Draft: [07](https://tools.ietf.org/html/draft-dulaunoy-misp-core-format) * [misp-taxonomy-format](misp-taxonomy-format/raw.md.txt) ([markdown source](misp-taxonomy-format/raw.md)) which describes the taxonomy JSON format of MISP. Current Internet-Draft: [06](https://tools.ietf.org/html/draft-dulaunoy-misp-taxonomy-format) * [misp-galaxy-format](misp-galaxy-format/raw.md.txt) which describes the [galaxy](https://github.com/MISP/misp-galaxy) template format used to expand the threat actor modelling of MISP. Current Internet-Draft: [05](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-galaxy-format/) * [misp-object-template-format](misp-object-template-format/raw.md.txt) which describes the [object](https://github.com/MISP/misp-objects) template format to add combinedand composite object to the MISP core format. Current Internet-Draft: [01](https://datatracker.ietf.org/doc/draft-dulaunoy-misp-object-template-format/) From 811ec18053a385421e1e6dd8ee8c6cbdd53c32fa Mon Sep 17 00:00:00 2001 From: Alexandre Dulaunoy Date: Fri, 15 Feb 2019 09:20:43 +0100 Subject: [PATCH 27/30] chg: [misp-galaxy-format] updated galaxy schema --- misp-galaxy-format/raw.md | 45 +++++++++++++++++++++++++++++++++++++++ 1 file changed, 45 insertions(+) diff --git a/misp-galaxy-format/raw.md b/misp-galaxy-format/raw.md index 2548f18..ac09319 100644 --- a/misp-galaxy-format/raw.md +++ b/misp-galaxy-format/raw.md @@ -239,6 +239,51 @@ Example use of the cfr-suspected-victims, cfr-suspected-state-sponsor, cfr-type- The JSON Schema [@?JSON-SCHEMA] below defines the overall MISP galaxy formats. The main format is the MISP galaxy format used for the clusters. +## MISP galaxy format - galaxy + +~~~~ +{ + "$schema": "http://json-schema.org/schema#", + "title": "Validator for misp-galaxies - Galaxies", + "id": "https://www.github.com/MISP/misp-galaxies/schema_galaxies.json", + "type": "object", + "additionalProperties": false, + "properties": { + "description": { + "type": "string" + }, + "type": { + "type": "string" + }, + "version": { + "type": "integer" + }, + "name": { + "type": "string" + }, + "icon": { + "type": "string" + }, + "uuid": { + "type": "string" + }, + "namespace": { + "type": "string" + }, + "kill_chain_order": { + "type": "object" + } + }, + "required": [ + "description", + "type", + "version", + "name", + "uuid" + ] +} +~~~~ + ## MISP galaxy format - clusters ~~~~ From 4d4940c08511002be88e1f950072700f75228b7d Mon Sep 17 00:00:00 2001 From: Hannah Ward Date: Tue, 19 Feb 2019 17:34:11 +0000 Subject: [PATCH 28/30] fix: Allow building on non-adulau system --- .gitignore | 2 ++ README.md | 20 +++++++++++++++++++- misp-core-format/Makefile | 3 +-- misp-galaxy-format/Makefile | 2 +- misp-object-template-format/Makefile | 2 +- misp-query-format/Makefile | 2 +- misp-taxonomy-format/Makefile | 2 +- 7 files changed, 26 insertions(+), 7 deletions(-) create mode 100644 .gitignore diff --git a/.gitignore b/.gitignore new file mode 100644 index 0000000..28d4854 --- /dev/null +++ b/.gitignore @@ -0,0 +1,2 @@ +*.html +*.xml diff --git a/README.md b/README.md index 5ef820d..021f567 100755 --- a/README.md +++ b/README.md @@ -30,7 +30,25 @@ If you want to see how a threat intelligence can be easily expressed in MISP sta [Installing MISP](https://www.misp-project.org/download/) is also another option to see the MISP standards in action. The MISP standards are actively used in the MISP threat intelligence platform to support the complete chain from intelligence creation, sharing, distribution and synchronisation. +## Building the RFCs + +These RFCs use [mmark](https://mmark.nl/) to generate - get a release [from the Github Repo](https://github.com/miekg/mmark/releases) and make sure it's in your PATH. + +You'll also need `xml2rfc` - install using `sudo pip3 isntall xml2rfc` + +```bash +for directory in $(find . -type d -iname "misp*"); do; + echo "Building $directory..."; + cd $directory; + make; + cd ..; +done; +``` + +cd misp-core-format +make +``` + # Contribution If you want to contribute to the MISP specifications, feel free to [open an issue](https://github.com/MISP/misp-rfc/issues). - diff --git a/misp-core-format/Makefile b/misp-core-format/Makefile index 210eb88..73b05d7 100644 --- a/misp-core-format/Makefile +++ b/misp-core-format/Makefile @@ -1,4 +1,4 @@ -MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page +MMARK:=mmark -xml2 -page docs = $(wildcard *.md) @@ -6,4 +6,3 @@ all: $(docs) $(MMARK) $< > $<.xml xml2rfc --text $<.xml xml2rfc --html $<.xml - diff --git a/misp-galaxy-format/Makefile b/misp-galaxy-format/Makefile index 210eb88..8a7138f 100644 --- a/misp-galaxy-format/Makefile +++ b/misp-galaxy-format/Makefile @@ -1,4 +1,4 @@ -MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page +MMARK:=mmark -xml2 -page docs = $(wildcard *.md) diff --git a/misp-object-template-format/Makefile b/misp-object-template-format/Makefile index 210eb88..8a7138f 100644 --- a/misp-object-template-format/Makefile +++ b/misp-object-template-format/Makefile @@ -1,4 +1,4 @@ -MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page +MMARK:=mmark -xml2 -page docs = $(wildcard *.md) diff --git a/misp-query-format/Makefile b/misp-query-format/Makefile index 210eb88..8a7138f 100644 --- a/misp-query-format/Makefile +++ b/misp-query-format/Makefile @@ -1,4 +1,4 @@ -MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page +MMARK:=mmark -xml2 -page docs = $(wildcard *.md) diff --git a/misp-taxonomy-format/Makefile b/misp-taxonomy-format/Makefile index 210eb88..8a7138f 100644 --- a/misp-taxonomy-format/Makefile +++ b/misp-taxonomy-format/Makefile @@ -1,4 +1,4 @@ -MMARK:=/home/adulau/git/mmark/mmark/mmark -xml2 -page +MMARK:=mmark -xml2 -page docs = $(wildcard *.md) From f634b87a77e331d77b8acc930ee39f29808ec421 Mon Sep 17 00:00:00 2001 From: Hannah Ward Date: Tue, 19 Feb 2019 17:37:16 +0000 Subject: [PATCH 29/30] fix: Typo in build instructions --- README.md | 4 ---- 1 file changed, 4 deletions(-) diff --git a/README.md b/README.md index 021f567..54ae9c8 100755 --- a/README.md +++ b/README.md @@ -45,10 +45,6 @@ for directory in $(find . -type d -iname "misp*"); do; done; ``` -cd misp-core-format -make -``` - # Contribution If you want to contribute to the MISP specifications, feel free to [open an issue](https://github.com/MISP/misp-rfc/issues). From c00895d1ca7ce5e05dcc0b99452c9cff36e49d22 Mon Sep 17 00:00:00 2001 From: Hannah Ward Date: Tue, 19 Feb 2019 17:38:40 +0000 Subject: [PATCH 30/30] Revert: Remove gitignore --- .gitignore | 2 -- 1 file changed, 2 deletions(-) delete mode 100644 .gitignore diff --git a/.gitignore b/.gitignore deleted file mode 100644 index 28d4854..0000000 --- a/.gitignore +++ /dev/null @@ -1,2 +0,0 @@ -*.html -*.xml