# Automation API Automation functionality is designed to automatically generate signatures for intrusion detection systems. To enable signature generation for a given attribute, Signature field of this attribute must be set to Yes. Note that not all attribute types are applicable for signature generation, currently we only support NIDS signature generation for IP, domains, host names, user agents etc., and hash list generation for MD5/SHA1 values of file artefacts. Support for more attribute types is planned. To make this functionality available for automated tools an authentication key is used. This makes it easier for your tools to access the data without further form-based-authentication. The API key can be found and managed under My Profile page (`/users/view/me`) on a MISP instance. ## General ### Automation URL The documentation will include a default MISP URL in the examples. Don't forget to replace it with your MISP URL. Default MISP URL in the documentation: ~~~~ https:/// ~~~~ ### Automation key The authentication of the automation is performed via a secure key available in the MISP UI interface. Make sure you keep that key secret as it gives access to the entire database! The API key is available in the event actions menu under automation. Since version 2.2 the usage of the authentication key in the URL is deprecated. Instead, pass the auth key in an Authorization header in the request. The legacy option of having the auth key in the URL is temporarily still supported but not recommended. The authorization is performed by using the following header: ~~~~ Authorization: YOUR API KEY ~~~~ #### Creating an automation key (using advanced authkeys) Using the menu, go to Global Actions > My Profile and click "Auth keys" to show the auth keys view. ![Screenshot of My Profile view with Auth keys expanded](./figures/create-authkey-1.png) The following form will be displayed: ![Screenshot of add authkey form](./figures/create-authkey-2-fill-form.png) You can add an optional comment to indicate what the key will be used for. You can also limit the usage of the key to specific IPs or subnets (one per line), by adding them in the Allowed IPs field. On some instances it is mandatory to set an IP allowlist. When adding subnets, please note that you need to use the format network_ip/subnet_mask . You can optionally set an expiration time for the key. Finally, it is also possible to make this key read-only, meaning that it will not be possible to do any changes on this instance using this automation key. After clicking submit you will get a confirmation that the auth key was created, the key will be shown only one time. ![Screenshot showing success message that is displayed when an ip was successfully pinned for an authkey](./figures/create-authkey-3-authkey-displayed.png) The same fields are available when editing an automation key. #### Pinning an allowed IP for an automation key (using advanced authkeys) MISP will keep track of the unique IPs that were seen for a specific automation key. You can easily limit future usage of an automation key to one of the IPs that was seen in the past. To do so, using the menu, go to Global Actions > My Profile and click "Auth keys" to show the auth keys view. If the automation key was used in the past, you will see the "Seen IPs" listed per key. Click on the pin button next to the IP you want to limit usage to. ![Screenshot showing auth keys view with the pin button available for seen IPs](./figures/pin-step-1.png) You will get a pop up requesting confirmation that you want to pin this IP for the key: ![Screenshot showing pop up which is displayed, requesting user confirmation after clicking the pin IP button](./figures/pin-step-2-confirm.png) After confirmation, if all goes well, you will get a confirmation that the allowed IP was set for the automation key: ![Screenshot showing success message that is displayed when an ip was successfully pinned for an authkey](./figures/pin-step-3-success-message.png) ### Accept and Content-Type headers When performing your request, depending on the type of request, you might need to explicitly specify in what content type you want to get your results. This is done by setting one of the below Accept headers: ~~~~ Accept: application/json Accept: application/xml ~~~~ When submitting data in a POST, PUT or DELETE operation you also need to specify in what content-type you encoded the payload. This is done by setting one of the below Content-Type headers: ~~~~ Content-Type: application/json Content-Type: application/xml ~~~~ Example: ~~~~ curl --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https:/// ~~~~ By appending .json or .xml the content type can also be set without the need for a header. ## Automation using PyMISP PyMISP is a Python library to access MISP platforms via their REST API. PyMISP allows you to fetch events, add or update events/attributes, add or update samples or search for attributes. [PyMISP is available](https://github.com/MISP/PyMISP) including a documentation with various examples. ## Status Codes To be done - 50x - 400 - 499 ## Error Handling ### Wrong endpoint chosen #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/servers/gaaa ~~~~ ~~~~json {"name":"Not Found","message":"Not Found","url":"\/servers\/gaaa"} ~~~~ ## Search It is possible to search in the database for a list of attributes or events based on a list of criteria. To return attributes or events in a desired format, use the following URL and header settings: URL: ~~~~ YOUR_MISP_URL/attributes/restSearch YOUR_MISP_URL/events/restSearch ~~~~ Headers: ~~~~ Accept: application/json Content-type: application/json Authorization: YOUR_API_KEY ~~~~ The next feature to take care of then is the body of the query. This is where you are going to put your filters. As an example, if we want to export all the IP addresses that have a TLP marking and not marked as TLP:red, you can find below the corresponding filters to use: ~~~~json { "returnFormat": "json", "type": { "OR": [ "ip-src", "ip-dst" ] }, "tags": { "NOT": [ "tlp:red" ], "OR": [ "tlp:%" ] } } ~~~~ Find below a non exhaustive list of parameters that can be used to filter data in your search (some parameters specific to given export formats are not mentioned): - **returnFormat**: Set the return format of the search (Currently supported: json, xml, openioc, suricata, snort - more formats are being moved to restSearch with the goal being that all searches happen through this API). Can be passed as the first parameter after restSearch or via the JSON payload. - **limit**: Limit the number of results returned, depending on the scope (for example 10 attributes or 10 full events). - **page**: If a limit is set, sets the page to be returned. page 3, limit 100 will return records 201->300). - **value**: Search for the given value in the attributes' value field. - **type**: The attribute type, any valid MISP attribute type is accepted. - **category**: The attribute category, any valid MISP attribute category is accepted. - **org**: Search by the creator organisation by supplying the organisation identifier. - **tags**: To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. - **quickfilter**: Enabling this (by passing "1" as the argument) will make the search ignore all of the other arguments, except for the auth key and value. MISP will return an xml / json (depending on the header sent) of all events that have a sub-string match on value in the event info, event orgc, or any of the attribute value1 / value2 fields, or in the attribute comment. - **from**: Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event. - **to**: Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event. - **eventid**: The events that should be included / excluded from the search - **withAttachments**: If set, encodes the attachments / zipped malware samples as base64 in the data field within each attribute - **metadata**: Only the metadata (event, tags, relations) is returned, attributes and proposals are omitted. - **uuid**: Restrict the results by uuid. - **publish_timestamp**: Restrict the results by the timestamp of the last publishing of the event. The input can be a timsetamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **last**: (Deprecated synonym for publish_timestamp) Restrict the results by the timestamp of the last publishing of the event. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **timestamp**: Restrict the results by the timestamp (last edit). Any event with a timestamp newer than the given timestamp will be returned. In case you are dealing with /attributes as scope, the attribute's timestamp will be used for the lookup. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **published**: Set whether published or unpublished events should be returned. Do not set the parameter if you want both. - **enforceWarninglist**: Remove any attributes from the result that would cause a hit on a warninglist entry. - **to_ids**: By default (0) all attributes are returned that match the other filter parameters, regardless of their to_ids setting. To restrict the returned data set to to_ids only attributes set this parameter to 1. You can only use the special "exclude" setting to only return attributes that have the to_ids flag disabled. - **deleted**: Default value 0. If set to 1, only deleted attributes will be returned. If set to [0,1] , both deleted and non-deleted attributes wil be returned. - **includeEventUuid**: Instead of just including the event ID, also include the event UUID in each of the attributes. - **event_timestamp**: Only return attributes from events that have received a modification after the given timestamp. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **sgReferenceOnly**: If this flag is set, sharing group objects will not be included, instead only the sharing group ID is set. - **eventinfo**: Filter on the event's info field. - **searchall**: Search for a full or a substring (delimited by % for substrings) in the event info, event tags, attribute tags, attribute values or attribute comment fields. - **attackGalaxy**: Select the ATT&CK matrix like galaxy to use when using returnFormat = attack. Defaults to the Mitre ATT&CK library via mitre-attack-pattern. - **order**: Only available for /events/restSearch. Sorts the results, can be useful in combination with limit. The accepted values to sort on are "Event.[any_field_in_the_events_table] [asc|desc]". You can also sort on multiple columns, see example below. ~~~ { "returnFormat": "json", "limit": "3", "order": "Event.attribute_count desc, Event.date desc" } ~~~ ## Events management ### /events #### Accepted Methods - GET - POST - PUT - DELETE #### Description Receive, update or delete Events. There is also a good amount of special output formats that can be triggered. ### GET /events #### Description Receive events based on criteria #### URL Arguments - event_id: Event id to receive - event_uuid : Event uuid to receive #### Output ~~~~json [{"id":"1","org_id":"1","date":"2014-12-10","info":"OSINT - F-Secure W32\/Regin, Stage #1","uuid":"54884656-2da8-4625-bf07-43ef950d210b","published":true,"analysis":"2","attribute_count":"39","orgc_id":"2","timestamp":"1418217625","distribution":"3","sharing_group_id":"0","proposal_email_lock":false,"locked":false,"threat_level_id":"1","publish_timestamp":"1515749192","disable_correlation":false,"Org":{"id":"1","name":"ORGNAME"},"Orgc":{"id":"2","name":"CIRCL"},"EventTag":[{"id":"1","event_id":"1","tag_id":"1","Tag":{"id":"1","name":"Type:OSINT","colour":"#1eed40","exportable":true}}],"SharingGroup":{"id":null,"name":null}}] ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https:/// ~~~~ ### POST /events #### Example ~~~~ curl -i -H "Accept: application/json" -H "content-type: application/json" -H "Authorization: YOUR API KEY" --data "@event.json" -X POST http://10.50.13.60/events ~~~~ That is how an event JSON object should look like ~~~~json {"Event":{"date":"2015-01-01","threat_level_id":"1","info":"testevent","published":false,"analysis":"0","distribution":"0","Attribute":[{"type":"domain","category":"Network activity","to_ids":false,"distribution":"0","comment":"","value":"test.com"}]}} ~~~~ ### DELETE /events #### Description Delete events based on criteria #### URL Arguments - event_id: Event id to receive - event_uuid : Event uuid to receive #### Output ~~~~json { "name": "Event deleted.", "message": "Event deleted.", "url": "\/events\/delete\/1" } ~~~~ #### Example curl --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https:/// ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X "DELETE" http://10.50.13.60/events/1 ~~~~ ### GET /events/index #### Description Return the event index. - Warning, there's a limit on the number of results #### Output ~~~~json [{"id":"1","org_id":"1","date":"2014-12-10","info":"OSINT - F-Secure W32\/Regin, Stage #1","uuid":"54884656-2da8-4625-bf07-43ef950d210b","published":true,"analysis":"2","attribute_count":"39","orgc_id":"2","timestamp":"1418217625","distribution":"3","sharing_group_id":"0","proposal_email_lock":false,"locked":false,"threat_level_id":"1","publish_timestamp":"1515749192","disable_correlation":false,"Org":{"id":"1","name":"ORGNAME"},"Orgc":{"id":"2","name":"CIRCL"},"EventTag":[{"id":"1","event_id":"1","tag_id":"1","Tag":{"id":"1","name":"Type:OSINT","colour":"#1eed40","exportable":true}}],"SharingGroup":{"id":null,"name":null}}] ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/events/index ~~~~ ### POST /events/AddTag Add a tag or a tag collection to an existing event. #### URL Arguments - event (id) - tag (id, name or collection_[collection_id]) Examples: ~~~ curl \ -d '{"event":"1210","tag":"tlp:green"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/addTag ~~~ ~~~ curl \ -d '{"event":"1210","tag":"383"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/addTag ~~~ ~~~ curl \ -d '{"event":"1210","tag":"collection_1"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/addTag ~~~ ### POST /events/removeTag Remove a tag from an existing event. Note that removing a tag collection in one go is not possible. #### URL Arguments - event (id) - tag (id, name). Examples: ~~~ curl \ -d '{"event":"1210","tag":"tlp:amber"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/removeTag ~~~ ~~~ curl \ -d '{"event":"1210","tag":"987"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/removeTag ~~~ ### GET /events/pushEventToZMQ/ #### Description Will push an Event to ZMQ #### URL Arguments - event_id #### Example ~~~~ curl --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https://events/pushEventToZMQ/223 ~~~~ ### GET /events/nids NIDS rules export Automatic export of all network related attributes is available under the Snort or Suricata rule format. Only published events and attributes marked as IDS Signature are exported. You can configure your tools to automatically download the following file: ~~~~ https:///events/nids/suricata/download https:///events/nids/snort/download ~~~~ The full API syntax is as follows: ~~~~ https:///events/nids/[format]/download/[eventid]/[frame]/[tags]/[from]/[to]/[last] ~~~~
format
The export format, can be "suricata" or "snort"
eventid
Restrict the download to a single event
frame
Some commented out explanation framing the data. The reason to disable this would be if you would like to concatenate a list of exports from various select events in order to avoid unnecessary duplication of the comments.
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). For example, to include tag1 and tag2 but exclude tag3 you would use:
~~~~ https:///events/nids/snort/download/false/false/tag1&&tag2&&!tag3 ~~~~
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 6d or 12h or 30m). This filter will use the published timestamp of the event.
The keywords false or null should be used for optional empty parameters in the URL. An example for a Suricata export for all events excluding those tagged tag1, without all of the commented information at the start of the file would look like this: ~~~~ https:///events/nids/suricata/download/null/true/!tag1 ~~~~ Administration is able to maintain an allowedlist containing host, domain name and IP numbers to exclude from the NIDS export. ### GET /events/hids Hash - HIDS database export Automatic export of MD5/SHA1 checksums contained in file-related attributes. This list can be used to feed forensic software when searching for suspicious files. Only published events and attributes marked as IDS Signature are exported. You can configure your tools to automatically download all the MD5 hashes from MISP: ~~~~ https:///events/hids/md5/download ~~~~ Or the SHA1 hashes: ~~~~ https:///events/hids/sha1/download ~~~~ The API's full format is as follow: ~~~~ https:///events/hids/[format]/download/[tags]/[from]/[to]/[last] ~~~~
format
The export format, can be "md5" or "sha1"
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). For example, to include tag1 and tag2 but exclude tag3 you would use:
~~~~ https:///events/hids/md5/download/tag1&&tag2&&!tag3 ~~~~
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
The keywords false or null should be used for optional empty parameters in the URL. For example, to only show sha1 values from events tagged tag1, use: ~~~~ https:///events/hids/sha1/download/tag1 ~~~~ ### GET /events/stix STIX export You can export MISP events in MITRE's STIX format (to read more about [STIX](https://stix.mitre.org/)). The STIX XML export is currently very slow and can lead to timeouts with larger events or collections of events. The STIX JSON return format does not suffer from this issue. Usage of the API: ~~~~ https:///events/stix/download ~~~~ Search parameters can be passed to the function via URL parameters or by POSTing an xml or json object (depending on the return type). The following parameters can be passed to the STIX export tool: id, withAttachments, tags. Both id and tags can use the && (and) and ! (not) operators to build queries. Using the URL parameters, the syntax is as follows: ~~~~ https:///events/stix/download/[id]/[withAttachments]/[tags]/[from]/[to]/[last] ~~~~
id
The event's ID
withAttachments
Encode attachments where applicable
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead).
For example, to include tag1 and tag2 but exclude tag3 you would use: ~~~~ https:///events/stix/download/false/true/tag1&&tag2&&!tag3 ~~~~
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
You can post an XML or JSON object containing additional parameters in the following formats. If you use JSON query objects: ~~~~ https:///events/stix/download.json ~~~~ ~~~~json {"request": {"id":["!51","!62"],"withAttachment":false,"tags":["APT1","!OSINT"],"from":false,"to":"2015-02-15"}} ~~~~ If you use XML query objects: ~~~~ https:///events/stix/download ~~~~ ~~~~xml !51!62falseAPT1!OSINTfalse2015-02-15 ~~~~ #### Various ways to narrow down the search results of the STIX export For example, to retrieve all events tagged "APT1" but excluding events tagged "OSINT" and excluding events #51 and #62 without any attachments: ~~~~ https:///events/stix/download/!51&&!62/false/APT1&&!OSINT/2015-02-15 ~~~~ To export the same events using a POST request use: ~~~~ https:///events/stix/download.json ~~~~ Together with this JSON object in the POST message: ~~~~json {"request": {"id":["!51","!62"],"tags":["APT1","!OSINT"],"from":"2015-02-15"}} ~~~~ XML is automatically assumed when using the STIX export: ~~~~ https:///events/stix/download ~~~~ The same search could be accomplished using the following POSTed XML object (note that ampersands need to be escaped, or alternatively separate id and tag elements can be used): ~~~~xml !51!62APT1!OSINT2015-02-15 ~~~~ ## Tag management ### POST /tags/add #### Description Add a tag on the instance #### URL Arguments ##### Mandatory - name ##### Optional - colour : A valid hexadecimal colour, for example #51961a, if not set, a random colour is chosen - exportable : whether the tag is exported when synchronising with other instances, default true - hide_tag : if set, the tag will not be selectable, default false - org_id : if set, only users from this organisation will be able to add the tag to objects - user_id : if set, only this user will be able to add the tag to objects #### Example ~~~ curl \ -d '{"name":"tag_only_name"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/tags/add ~~~ ~~~ curl \ -d '{"name":"tag_doc","colour":"#51961a","exportable":1,"hide_tag":0,"org_id":1}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/tags/add ~~~ ### POST /tags/attachTagToObject #### Description Attaches a tag to an object by a given UUID. Note that adding a tag collection via this endpoint is not possible. Please refer to /events/addTag and /attributes/addTag for that functionality. This endpoint exists for convenience reasons and might be slightly less performant than /events/addTag and /attributes/addTag. #### URL Arguments - UUID - tag (as id or name) #### Response ~~~json { "name": "Tag tlp3Awhite(7) successfully attached to Attribute(153).", "message": "Tag tlp3Awhite(7) successfully attached to Attribute(153).", "url": "\/tags\/attachTagToObject" } ~~~ #### Example ~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X POST http://10.50.13.60/tags/attachTagToObject/5a0d68b3-6da0-4ced-8233-77bb950d210f/tlp3Awhite ~~~ ~~~ curl --header "Authorization: YOUR API KEY " -d "{"uuid"="5a0d68b3-6da0-4ced-8233-77bb950d210f" "tag"="tlp:white"}" --header "Accept: application/json" --header "Content-Type: application/json" -X POST http://10.50.13.60/tags/attachTagToObject/ ~~~ ~~~ curl \ -d '{"uuid":"e76949e6-5ccb-4483-bef2-0e4cac73d236","tag":"6"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/tags/attachTagToObject ~~~ ### POST /tags/removeTagFromObject #### Description Removes a tag from an object (attribute or event) with given UUID. This endpoint exists for convenience reasons and might be slightly less performant than /events/removeTag and /attributes/removeTag. #### URL Arguments - UUID - tag (as id or name) #### Response ~~~~json { "name": "Tag tlp3Awhite(7) successfully removed from Attribute(153).", "message": "Tag tlp3Awhite(7) successfully removed from Attribute(153).", "url": "\/tags\/removeTagFromObject" } ~~~~ #### Example ~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X POST http://10.50.13.60/tags/removeTagFromObject/5a0d68b3-6da0-4ced-8233-77bb950d210f/tlp3Awhite ~~~ ~~~ curl \ -d '{"uuid":"85752e06-7644-40c8-8190-f8bbe9e7b2c7","tag":"tlp:white"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/tags/removeTagFromObject ~~~ ~~~ curl \ -d '{"uuid":"85752e06-7644-40c8-8190-f8bbe9e7b2c7","tag":7}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/tags/removeTagFromObject ~~~ ### GET /tags/tagStatistics/ #### Description Will give an overview of the used attribute tags #### Output ~~~~json { "tags": { "Type:OSINT": "1", "tlp:white": "1", "osint:source-type=\"technical-report\"": "1", "misp-galaxy:threat-actor=\"Lazarus Group\"": "1", "misp-galaxy:rat=\"FALLCHILL\"": "1" }, "taxonomies": [] } ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X GET http://10.50.13.60/tags/tagStatistics/ ~~~~ ## Attribute management ### POST /attributes/add/ Adds an Attribute to an event #### URL Arguments - event id #### Output #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -d "{"event_id":"3542","value":"1.2.3.4","category":"Network activity","type":"ip-dst"}" http://10.50.13.60/attributes/add/3542 ~~~~ ### GET /attributes Get an attribute #### URL Arguments - attribute uuid #### URL Attributes #### Output ~~~~json {"Attribute":{"id":"39","event_id":"1","object_id":"0","object_relation":null,"category":"Payload installation","type":"md5","to_ids":true,"uuid":"548847db-060c-4275-a0c7-15bb950d210b","timestamp":"1418217435","distribution":"3","sharing_group_id":"0","comment":"Regin samples collected.","deleted":false,"disable_correlation":false,"value":"049436bb90f71cf38549817d9b90e2da","event_uuid":"54884656-2da8-4625-bf07-43ef950d210b"}} ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/attributes/548847db-060c-4275-a0c7-15bb950d210b ~~~~ ### POST /attributes/delete/ #### Description Delete attributes. #### URL Arguments - attribute uuid - attribute id - attribute id/1 <-- hard delete #### Output ~~~~json {"message":"Attribute deleted."} ~~~~ #### Example ~~~~ curl -X POST --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https:///attributes/delete/12345 ~~~~ ~~~~ curl -X POST --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/attributes/delete/548847db-060c-4275-a0c7-15bb950d210b ~~~~ Hard delete: ~~~~ curl -X POST --header "Authorization: YOUR API KEY" --header "Accept: application/json" --header "Content-Type: application/json" https:///attributes/delete/12345/1 ~~~~ ### POST /attributes/addTag Add a tag or a tag collection to an existing attribute. #### URL Arguments - attribute (id) - tag (id, name or collection_[collection_id]) Examples: ~~~ curl \ -d '{"attribute":"256919","tag":"tlp:green"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/attributes/addTag ~~~ ~~~ curl \ -d '{"attribute":"256919","tag":"987"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/attributes/addTag ~~~ ~~~ curl \ -d '{"attribute":"256919","tag":"collection_1"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/attributes/addTag ~~~ ### POST /attributes/removeTag Remove a tag from an existing event. Note that removing a tag collection in one go is not possible. #### URL Arguments - attribute (id) - tag (id, name). Examples: ~~~ curl \ -d '{"event":"1210","tag":"tlp:amber"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/removeTag ~~~ ~~~ curl \ -d '{"event":"1210","tag":"987"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/events/removeTag ~~~ ### GET /attributes/attributeStatistics #### Description Will give an overview of the used attribute types #### Output ~~~~json { "attachment": "1", "comment": "1", "filename": "2", "float": "2", "ip-dst": "90", "ip-dst|port": "3", "link": "3", "md5": "16", "port": "3", "sha1": "2", "sha256": "2", "size-in-bytes": "1", "ssdeep": "2" } ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X GET http://10.50.13.60/attributes/attributeStatistics/ ~~~~ ### GET /attributes/describeTypes Describe types API MISP can procedurally describe all attribute types and attribute categories it currently supports including the category - type mappings. To access this information simply send a GET request to: #### Example ~~~~ https:///attributes/describeTypes ~~~~ Depending on the headers passed the returned data will be a JSON object or an XML, with 3 main sections: types, categories, category\_type\_mappings. ### POST /attributes/restSearch Do not use this function with GET! #### Parameters - **returnFormat**: The format to return data in. Allowed formats: - **attack-sightings**: Returns ATTA&CK Sightings in json format for attributes with mitre-attack-pattern galaxies attached. For further details on the ATT&CK Sightings, please visit the related [MITRE website page](https://attack.mitre.org/resources/sightings/). - **cache**: Hashes the attributes and returns them as txt. A hashing algorithm can be chosen by also adding the hash_type parameter. Supported hashing algorithms can be found on the [PHP website](https://www.php.net/manual/en/function.hash-algos.php]). - **count**: Returns the attribute count as txt. - **csv** - **hashes**: Returns hash attributes in txt format. For composite attributes, only the hash part is returned. - **json** - **netfilter**: Returns netfilter rules for IPs. Action can be set with the netfilter_action parameter. The default action is DROP. - **opendata**: Please refer to the related MISP project [blog post](https://www.misp-project.org/2020/07/30/publishing-open-data-using-MISP.html). - **openioc** - **rpz** - **snort** - **suricata** - **text**: Returns only the attribute values in text format. - **xml** - **yara**: - **yara-json** - **value**: Search for the given value in the attributes' value field. - **type**: The attribute type, any valid MISP attribute type is accepted. - **category**: The attribute category, any valid MISP attribute category is accepted. - **org**: Search by the creator organisation by supplying the organisation identifier. - **tags**: Include or exclude attributes with certain tags. See example below. It is strongly recommended to specifically exclude the tags you want to avoid, even if the tags should be exclusive, for example tlp:red and tlp:green. ~~~~json { "returnFormat": "json", "tags": { "NOT": [ "tlp:red" ], "OR": [ "tlp:green" ] } } ~~~~ - **from**: Will return attributes from events with the date set to a date after the one specified in the from field (format: 2015-02-15). - **to**: Will return attributes with the date set to a date before the one specified in the to field (format: 2015-02-15). - **last**: ***Deprecated!!!*** (synonym for publish_timestamp) Restrict the results by the timestamp of the last publication of the event. Any attribute with a last publication timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **eventid**: The events that should be included / excluded from the search. - **withAttachments**: If set, encodes the attachments / zipped malware samples as base64 in the data field within each attribute - **uuid**: Restrict the results by uuid. - **publish_timestamp**: Restrict the results by the timestamp of the last publication of the event. Any attribute with a last publication timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **published**: Set whether published or unpublished events should be returned. Do not set the parameter if you want both. - **timestamp**: ***Deprecated!!!*** (synonym for attribute_timestamp) Restrict the results by the timestamp (last edit). Any attribute with a timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **enforceWarninglist**: Remove any attributes from the result that would cause a hit on a warninglist entry. - **to_ids**: By default (0) all attributes are returned that match the other filter parameters, regardless of their to_ids setting. To restrict the returned data set to to_ids only attributes set this parameter to 1. You can only use the special "exclude" setting to only return attributes that have the to_ids flag disabled. - **deleted**: Default value 0. If set to 1, only deleted attributes will be returned. If set to [0,1] , both deleted and non-deleted attributes wil be returned. - **includeEventUuid**: Instead of just including the event ID, also include the event UUID in each of the attributes. - **event_timestamp**: Only return attributes from events that have received a modification after the given timestamp. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **threat_level_id**: Only return attributes of events with the given threat level id(s). 1 = High, 2 = Medium, 3=Low, 4 = Undefined. See example below. ``` { "returnFormat": "json", "threat_level_id": [1,2] } ``` - **includeEventTags**: If set to 1, the event tags of the event the attribute belongs to will be added to the attribute. - **limit**: Limit the number of results returned, for example 10 attributes. - **page**: If a limit is set, sets the page to be returned. page 3, limit 100 will return records 201->300). - **requested_attributes**: Only for CSV export. Choose the fields you want in the csv output. Available fields are (*non-exhaustive list, more fields can be available depending on the values of other parameters*): - uuid - event_id - category - type - value - comment - to_ids - date - object_relation - attribute_tag - object_uuid - object_name - object_meta_category - event_info. Only available if includeContext parameter is set to 1. - event_member_org. Only available if includeContext parameter is set to 1. - event_source_org. Only available if includeContext parameter is set to 1. - event_distribution. Only available if includeContext parameter is set to 1. - event_threat_level_id. Only available if includeContext parameter is set to 1. - event_analysis. Only available if includeContext parameter is set to 1. - event_date. Only available if includeContext parameter is set to 1. - event_tag. Only available if includeContext parameter is set to 1. - event_timestamp. Only available if includeContext parameter is set to 1. - **includeContext**: Adds extra event level context to the output. For each attribute more details are added to the Event object in the output. Please note that this significantly bloats the output data. Example below. ``` "Event": { "id": "31", "orgc_id": "1", "org_id": "1", "date": "2021-03-11", "threat_level_id": "1", "info": "Correlation 2", "published": true, "uuid": "0bfe7bf3-f793-4761-8450-8b30ca9d9964", "analysis": "0", "timestamp": "1616972381", "distribution": "1", "publish_timestamp": "1616972392", "sharing_group_id": "0", "extends_uuid": "", "Tag": [], "Orgc": { "id": "1", "name": "SHARINGORG", "uuid": "26867ddf-5a9b-4af0-b552-e4020a913b95", "local": true } } ``` - **headerless**: Only for CSV export. The CSV created when this setting is set to true will not contain the header row. - **includeWarninglistHits**: Adds a warnings block to an attribute if it has warninglist hits. See example below. ``` "warnings": [ { "match": "10.0.0.0/8", "value": "10.0.0.1", "warninglist_name": "List of RFC 5735 CIDR blocks", "warninglist_id": "46" }, { "match": "10.0.0.0/8", "value": "10.0.0.1", "warninglist_name": "List of RFC 1918 CIDR blocks", "warninglist_id": "44" } ] ``` - **object_relation**: Search on the object_relation field of attributes. You can search for 'malware-sample' attributes of file objects for example. Searching for multiple values at the same time is possible as well. ``` { "returnFormat": "json", "object_relation": ["malware-sample", "institution-name"] } ``` - **includeSightings**: Adds a list of sightings for attributes that have sightings. See example below. ``` "Sighting": [ { "id": "1", "attribute_id": "29", "event_id": "31", "org_id": "1", "date_sighting": "1617017091", "uuid": "48d21518-6b2a-4615-8c4e-91fbe4f08fe7", "source": "", "type": "0", "attribute_uuid": "b3c25257-7f47-41af-a29b-89188e583b5c", "Organisation": { "id": "1", "uuid": "26867ddf-5a9b-4af0-b552-e4020a913b95", "name": "SHARINGORG" } } ] ``` - **includeCorrelations**: Adds a list of correlated attributes for attributes that have correlations. See example below. ``` "RelatedAttribute": [ { "id": "31", "event_id": "30", "object_id": "0", "object_relation": null, "category": "Network activity", "type": "ip-dst", "uuid": "f3b54c94-89ff-4fcf-9f47-52f70c6540b8", "timestamp": "1616961683", "distribution": "5", "sharing_group_id": "0", "to_ids": false, "comment": "", "value": "10.0.0.1", "Event": { "id": "30", "uuid": "8cca9f2f-9281-49fd-9b30-e16a8dbf6855", "threat_level_id": "1", "analysis": "0", "info": "Correlation 1", "extends_uuid": "", "distribution": "1", "sharing_group_id": "0", "published": false, "date": "2021-03-11", "orgc_id": "1", "org_id": "1" } } ] ``` - **includeDecayScore**: If set to 1, decay score information will be included for attributes that are affected by decaying. See example below. Note that includeEventTags will be set to 1 automatically if includeDecayScore is true. ``` "decay_score": [ { "score": 77.40239901751683, "base_score": 80, "decayed": false, "DecayingModel": { "id": "2", "name": "NIDS Simple Decaying Model" } } ], ``` - **decayingModel**: Allows you to set the decaying model(s) to use to calculate the decay score. You can use a model that is not enabled. The value should be set to the id of the model. If this value is not set, a decay score entry will be added for all enabled decaying models that apply to the attribute type. - **excludeDecayed**: Filter out all expired IOCs. Note that includeDecayScore will be set to 1 automatically if excludeDecayed is true. - **modelOverrides**: JSON that can be used to modify Model parameters on-the-fly. Example can be found beow. ``` { "type": "ip-src", "tags": ["tlp:%","phishing:%"], "includeDecayScore": 1, "excludeDecayed": 1, "modelOverrides": { "threshold": 30 } "decayingModel": [84, 12], } ``` - **includeFullModel**: If set to 1, includes the full decaying model details instead of just the id and name. - **score**: Overrides the model threshold value with the one you set. This means attributes for which the decay score calculated for all relevant models is lower than this value, will be considered decayed. - **attribute_timestamp**: Restrict the results by the timestamp (last edit). Any attribute with a timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **first_seen**: Restrict the results by the first_seen timestamp of the attribute. Any attribute with a first_seen timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **last_seen**: Restrict the results by the last_seen timestamp of the attribute. Any attribute with a first_seen timestamp newer than the given timestamp will be returned. The input can be a timestamp or a short-hand time description (7d or 24h for example). You can also pass a list with two values to set a time range (for example ["14d", "7d"]). - **searchall**: Search for a full or a substring (delimited by % for substrings) in the attribute tags, attribute values or attribute comment fields. #### Example ~~~~ curl \ -d '{"returnFormat":"json","value":"foobar"}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.220/attributes/restSearch ~~~~ ~~~~json {"response": {"Attribute": [{"id":"44","event_id":"30","object_id":"0","object_relation":null,"category":"Other","type":"comment","to_ids":false,"uuid":"7a5d856c-048a-4dbd-8e6d-41d1790c5ad0","timestamp":"1617056037","distribution":"5","sharing_group_id":"0","comment":"","deleted":false,"disable_correlation":false,"first_seen":null,"last_seen":null,"value":"foobar","Event":{"org_id":"1","distribution":"1","id":"30","info":"Correlation 1","orgc_id":"1","uuid":"8cca9f2f-9281-49fd-9b30-e16a8dbf6855"}}]}} ~~~~ ## Objects management ### POST /objects/delete/[object_id]/[hard_delete] #### Description Delete an object. #### URL Arguments - object_id : mandatory - hard_delete : if set to 1 or true, the object will be hard deleted. Defaults to false. #### Example ~~~ curl \ -d '{}' \ -H "Authorization: YOUR API KEY" \ -H "Accept: application/json" \ -H "Content-type: application/json" \ -X POST https://192.168.0.223/objects/delete/18732/1 ~~~ ## Server management ### GET /servers/getPyMISPVersion #### Result ~~~~json {"version":"2.4.85"} ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/servers/getPyMISPVersion.json ~~~~ ### GET /servers/getVersion #### Result ~~~~json {"version":"2.4.85","perm_sync":true} ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" http://10.50.13.60/servers/getPyMISPVersion.json ~~~~ ## Sightings ### POST /sightings/add/ - attribute_id - attribute_uuid The different sightings types are: ~~~~php 0 => 'sighting', 1 => 'false-positive', 2 => 'expiration' ~~~~ ## User management MISP allows administrators to create and manage users via its REST API ~~~~ https:///admin/users/view/[user id] ~~~~ ### POST /admin/users/add To create a new user, send a POST request to: ####Sample input ~~~~ { "email":"andras.iklody@circl.lu", "org\_id":1, "role\_id":1 } ~~~~ To view the mandatory and optional fields, use a GET request on the above URL. ####Sample output ~~~~json { "name": "\/admin\/users\/add API description", "description": "POST a User object in JSON format to this API to create a new user.", "mandatory_fields": [ "email", "org_id", "role_id" ], "optional_fields": [ "password", "external_auth_required", "external_auth_key", "enable_password", "nids_sid", "server_id", "gpgkey", "certif_public", "autoalert", "contactalert", "disabled", "change_pw", "termsaccepted", "newsread" ], "url": "\/admin\/users\/add" } ~~~~ ### POST admin/users/edit/ To edit an existing user send a POST request to: ~~~~ https:///admin/users/edit/[user id] ~~~~ Only the fields POSTed will be updated, the rest is left intact. To view all possible parameters, simply send a GET request to the above URL. ### POST admin/users/delete/ You can also delete users by POSTing to the below URL, but keep in mind that disabling users (by setting the disabled flag via an edit) is always preferred to keep user associations to events intact. #### Parameters - [user id] #### Example ~~~~ https:///admin/users/delete/[user id] ~~~~ ### GET admin/users #### Description Will output all users #### Output ~~~~json [ { "User": { "id": "1", "password": "FOOOOOOOOOO", "org_id": "1", "server_id": "0", "email": "admin@admin.test", "autoalert": false, "authkey": "YOUR API KEY", "invited_by": "0", "gpgkey": null, "certif_public": "", "nids_sid": "4000000", "termsaccepted": true, "newsread": "0", "role_id": "1", "change_pw": "0", "contactalert": false, "disabled": false, "expiration": null, "current_login": "1515752313", "last_login": "1515748671", "force_logout": false, "date_created": null, "date_modified": null, "org_ci": "ORGNAME" }, "Role": { "id": "1", "name": "admin", "perm_auth": true }, "Organisation": { "id": "1", "name": "ORGNAME" } } ] ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X GET http://10.50.13.60/admin/users ~~~~ ### GET admin/users/view/ #### Description Will return a single user. To view a user simply send a GET request. #### Parameters - id #### Output ~~~~json { "User": { "id": "1", "password": "*****", "org_id": "1", "server_id": "0", "email": "admin@admin.test", "autoalert": false, "authkey": "YOUR API KEY", "invited_by": "0", "gpgkey": null, "certif_public": "", "nids_sid": "4000000", "termsaccepted": true, "newsread": "0", "role_id": "1", "change_pw": "0", "contactalert": false, "disabled": false, "expiration": null, "current_login": "1515752313", "last_login": "1515748671", "force_logout": false, "orgAdmins": [] } } ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X GET http://10.50.13.60/admin/users/view/1 ~~~~ ### POST admin/users/add/ ## Discussion API If you would like to fetch a discussion thread including all of its posts, simply send a GET request to: ~~~~ https:///threads/view/ ~~~~ Using the following headers: ~~~~ Authorization: [Your auth key] Content-type: application/json Accept: application/json ~~~~ To get all posts related to an event simply send a GET request to: ~~~~ https:///threads/viewEvent/ ~~~~ ## Organisation management MISP allows administrators to create and manage organisations via its REST API The API is available in JSON format so make sure you use the following headers: ~~~~ Authorization: [Your auth key] Content-type: application/json Accept: application/json ~~~~ To fetch all organisations send a GET request to: ~~~~ https:///organisations ~~~~ To view an individual organisation, send a get request to: ~~~~ https:///organisations/view/id ~~~~ The management of users happens via three apis: ~~~ https:///admin/organisations/add https:///admin/organisations/edit/[org id] https:///admin/organisations/delete/[org id] ~~~ To delete an organisation simply send a POST or DELETE request to the above URL. For creating or modifying an organisation, simply POST a JSON containing the relevant fields to the appropriate API. The only mandatory field is the organisation name, with a host of optional parameters An example for a simple organisation object: ~~~ { "name": "Blizzard", "nationality": "US" } ~~~ Not setting a field will assume the default settings for the given field in the case of a new organisation whilst it would retain the existing setting for existing organisations. The above example would create the following object in MISP: ~~~ { "Organisation": { "id": "1108", "name": "Blizzard", "alias": "", "anonymise": false, "date_created": "2017-01-22 17:32:29", "date_modified": "2017-01-22 17:32:29", "description": "", "type": "", "nationality": "US", "sector": "", "created_by": "1", "uuid": "5884de9d-04f0-4d7d-bf15-0b88c0a83865", "contacts": "", "local": true, "landingpage": "" } } ~~~ To query the add or edit APIs for the valid parameters, simply send a GET requests to either API. The result currently looks like this (which might change when new fields are added): ~~~ { "name": "\/admin\/organisations\/add API description", "description": "POST an Organisation object in JSON format to this API to create a new organisation.", "mandatory_fields": [ "name" ], "optional_fields": [ "anonymise", "description", "type", "nationality", "sector", "uuid", "contacts", "local" ], "url": "\/admin\/organisations\/add" } ~~~ ## Special Cases ### XML Export An automatic export of all events and attributes (except file attachments) is available under a custom XML format. You can configure your tools to automatically download the following file: ~~~~ https:///events/xml/download ~~~~ If you only want to fetch a specific event append the eventid number: ~~~~ https:///events/xml/download/1 ~~~~ You can post an XML or JSON object containing additional parameters in the JSON query format or XML query format. Query parameters provide a way to filter the output to specific parameters. #### JSON query format The URL is appended with json: ~~~~ https:///events/xml/download.json ~~~~ The query parameters can be the following: ~~~~json {"request": {"eventid":["!51","!62"],"withAttachment":false,"tags":["APT1","!OSINT"],"from":false,"to":"2015-02-15"}} ~~~~ #### XML query format The URL is path is: ~~~~ https:///events/xml/download ~~~~ The query parameters can be the following: ~~~~xml !51!62falseAPT1!OSINTfalse2015-02-15 ~~~~ #### XML download and URL parameters The XML download also accepts two additional the following optional parameters in the url: ~~~~ https:///events/xml/download/[eventid]/[withattachments]/[tags]/[from]/[to]/[last] ~~~~
eventid
Restrict the download to a single event
withattachments
A boolean field that determines whether attachments should be encoded and a second parameter that controls the eligible tags.
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). For example, to include tag1 and tag2 but exclude tag3 you would use:
~~~~ https:///events/xml/download/false/true/tag1&&tag2&&!tag3 ~~~~
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
The keywords false or null should be used for optional empty parameters in the URL. Also check out the User Guide to read about the [REST API](../using-the-system/README.md#rest-api). ### CSV export An automatic export of attributes is available as CSV. Only attributes that are flagged "to_ids" will get exported. You can configure your tools to automatically download the following file: ~~~~ https:///events/csv/download ~~~~ This will download all the valid attributes in your MISP instance (might take some time). You can also configure your tools to download the attributes from a specific event. Here is the old legacy CSV export that will work like exporting all attributes: ~~~~ https:///events/csv/download/ ~~~~ You can specify additional flags for CSV exports as follows: POST to: ~~~~ https:///events/csv/download ~~~~ Headers: ~~~~ Authorization: Content-type: application/json ~~~~ Body: ~~~~json {"parameter1":"value1", "parameter2":1, "parameter3":["value3", "value4", "!value5"]} ~~~~
eventid
Restrict the download to a single event
ignore
Setting this flag to true will include attributes that are not marked "to_ids".
tags
Simply add a list of tags that should be included or negated (by prepending the tag name with a "!"). Any event with a negated tag will be ignored, even if an included tag is matching. An example is included further down.
category
The attribute category, any valid MISP attribute category is accepted.
type
The attribute type, any valid MISP attribute type is accepted.
includeContext
Include the event data with each attribute.
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
For example, to only download a csv generated of the "domain" type and the "Network activity" category attributes all events except for the one and further restricting it to events that are tagged "tag1" or "tag2" but not "tag3", only allowing attributes that are IDS flagged use the following syntax: POST to: ~~~~ https:///events/csv/download ~~~~ Headers: ~~~~ Authorization: Content-type: application/json ~~~~ Body: ~~~~json {"tags":["tag1", "tag2", "!tag3"], "category":"Network activity", "type": "domain"} ~~~~ Alternatively you can fall back to the deprecated syntax of passing parameters in a GET request via the URL, however this is discouraged: ~~~~ https:///events/csv/download/[eventid]/[ignore]/[tags]/[category]/[type]/[includeContext]/[from]/[to]/[last] ~~~~ If you use the deprecated URL parameter method, keep in mind that the keywords false or null should be used for optional empty parameters. To export the attributes of all events that are of the type "domain", use the following syntax: ~~~~ https:///events/csv/download/false/false/false/false/domain ~~~~ #### Update 2.4.82 Since version 2.4.82, the new export format allows to select more columns using the following query format: ~~~~ https:///events/csv/download/?attributes=timestamp,type,uuid,value ~~~~ The order of columns will be honoured including those related to object level information. To select object level columns, simply prepend the given object column's name by object_, such as: ~~~~ https:///events/csv/download/?attributes=timestamp,type,uuid,value&object_attributes=uuid,name ~~~~ The following columns will be returned (all columns related to objects will be prefixed with object_): ~~~~ timestamp,type,uuid,value,object_uuid,object_name ~~~~ includeContext option includes the tags for the event for each line. ## RPZ export You can export RPZ zone files for DNS level firewall by using the RPZ export functionality of MISP. The file generated will include all of the IDS flagged domain, hostname and IP-src/IP-dst attribute values that you have access to. It is possible to further restrict the exported values using the following filters:
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search when passed through the URL. Use semicolons instead (the search will automatically search for colons instead).
id
The event's ID
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-03)
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-03)
MISP will inject header values into the zone file as well as define the action taken for each of the values that can all be overwritten. By default these values are either the default values shipped with the application, or ones that are overwritten by your site administrator. The values are as follows: | Value name | Default value | | --- | :---: | |RPZ_policy| DROP| |RPZ_walled_garden| 127.0.0.1| |RPZ_serial| $date00| |RPZ_refresh| 2h| |RPZ_retry| 30m| |RPZ_expiry| 30d| |RPZ_minimum_ttl| 1h| |RPZ_ttl| 1w| |RPZ_ns| localhost.| |RPZ_ns_alt|| |RPZ_email| root.localhost| To override the above values, either use the URL parameters as described below: ~~~~ https:///attributes/rpz/download/[tags]/[eventId]/[from]/[to]/[policy]/[walled_garden]/[ns]/[ns_alt]/[email]/[serial]/[refresh]/[retry]/[expiry]/[minim um_ttl]/[ttl] ~~~~ Or POST an XML or JSON object with the above listed options: ~~~~xml OSINT&&!OUTDATEDwalled-gardenteamliquid.net5h ~~~~ ~~~~json {"request": {"tags": ["OSINT", "!OUTDATED"], "policy": "walled-garden", "walled_garden": "teamliquid.net", "refresh": "5h"} ~~~~ ## Text export An export of all attributes of a specific type to a plain text file. By default only published and IDS flagged attributes are exported. You can configure your tools to automatically download the following files: ~~~~ https:///attributes/text/download/md5 https:///attributes/text/download/sha1 https:///attributes/text/download/sha256 https:///attributes/text/download/filename https:///attributes/text/download/filename|md5 https:///attributes/text/download/filename|sha1 https:///attributes/text/download/filename|sha256 https:///attributes/text/download/ip-src https:///attributes/text/download/ip-dst https:///attributes/text/download/hostname https:///attributes/text/download/domain https:///attributes/text/download/email-src https:///attributes/text/download/email-dst https:///attributes/text/download/email-subject https:///attributes/text/download/email-attachment https:///attributes/text/download/url https:///attributes/text/download/http-method https:///attributes/text/download/user-agent https:///attributes/text/download/regkey https:///attributes/text/download/regkey|value https:///attributes/text/download/AS https:///attributes/text/download/snort https:///attributes/text/download/pattern-in-file https:///attributes/text/download/pattern-in-traffic https:///attributes/text/download/pattern-in-memory https:///attributes/text/download/yara https:///attributes/text/download/vulnerability https:///attributes/text/download/attachment https:///attributes/text/download/malware-sample https:///attributes/text/download/link https:///attributes/text/download/comment https:///attributes/text/download/text https:///attributes/text/download/other https:///attributes/text/download/named pipe https:///attributes/text/download/mutex https:///attributes/text/download/target-user https:///attributes/text/download/target-email https:///attributes/text/download/target-machine https:///attributes/text/download/target-org https:///attributes/text/download/target-location https:///attributes/text/download/target-external ~~~~ To restrict the results by tags, use the usual syntax. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). To get ip-src values from events tagged tag1 but not tag2 use: ~~~~ https:///attributes/text/download/ip-src/tag1&& ~~~~ It is possible to restrict the text exports on additional flags. The first allows the user to restrict based on event ID, whilst the second is a boolean switch allowing non IDS flagged attributes to be exported. Additionally, choosing "all" in the type field will return all eligible attributes. ~~~~ https:///attributes/text/download/[type]/[tags]/[event_id]/[allowNonIDS]/[from]/[to]/[last] ~~~~
type
The attribute type, any valid MISP attribute type is accepted.
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead).
allowNonIDS
Include attributes that would normally be excluded due to the IDS flag not being set or due to being allowlisted
from
Set the lowest "date" field value that should be included in the export (format YYYY-MM-DD)
to
Set the highest "date" field value that should be included in the export (format YYYY-MM-DD)
last
Set the timeframe of the export based on the "timestamp" value. The parameter uses a time + metric notation (valid examples: "2w", "60m", "24h")
For example, to include tag1 and tag2 but exclude tag3 you would use: ~~~~ https:///attributes/text/download/all/tag1&&tag2&&!tag3 ~~~~
event_id
Restrict the results to the given event IDs.
allowNonIDS
Allow attributes to be exported that are not marked as "to_ids".
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
The keywords false or null should be used for optional empty parameters in the URL. For example, to retrieve all attributes for event #5, including non IDS marked attributes too, use the following line: ~~~~ https:///attributes/text/download/all/null/5/true ~~~~ ## RESTful searches with XML result export It is possible to search the database for attributes based on a list of criteria. To return an event with all of its attributes, relations, shadowAttributes, use the following syntax: ~~~~ https:///events/restSearch/download/[value]/[type]/[category]/[org]/[tag]/[quickfilter]/[from]/[to]/[last]/[eventid]/[withAttachments]/[metadata]/[uuid] ~~~~
value
Search for the given value in the attributes' value field.
type
The attribute type, any valid MISP attribute type is accepted.
category
The attribute category, any valid MISP attribute category is accepted.
org
Search by the creator organisation by supplying the organisation idenfitier.
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead).
For example, to include tag1 and tag2 but exclude tag3 you would use: ~~~~ https:///events/restSearch/download/null/null/null/null/tag1&&tag2&&!tag3 ~~~~
quickfilter
Enabling this (by passing "1" as the argument) will make the search ignore all of the other arguments, except for the auth key and value. MISP will return an xml / json (depending on the header sent) of all events that have a sub-string match on value in the event info, event orgc, or any of the attribute value1 / value2 fields, or in the attribute comment.
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
eventid
The events that should be included / excluded from the search
withAttachments
Include the attachments/encrypted samples in the export
metadata
Only fetch the event metadata (event data, tags, relations) and skip the attributes
limit
Limit the number of results returned; use together with page.
page
If a limit is set, sets the page to be returned, starting at 1; page 3, limit 100 will return records 201->300). When requesting a page beyond the number of available pages, the returned results list will be empty.
The keywords false or null should be used for optional empty parameters in the URL. For example, to find any event with the term "red october" mentioned, use the following syntax (the example is shown as a POST request instead of a GET, which is highly recommended): POST to: ~~~~ https:///events/restSearch/download ~~~~ POST message payload (XML): ~~~~xml red october1!15 ~~~~ POST message payload (JSON): ~~~~json {"request": {"value":"red october","searchall":1,"eventid":"!15"}} ~~~~ To just return a list of attributes, use the following syntax:
value
Search for the given value in the attributes' value field.
type
The attribute type, any valid MISP attribute type is accepted.
category
The attribute category, any valid MISP attribute category is accepted.
org
Search by the creator organisation by supplying the organisation identifier.
tags
To include a tag in the results just write its names into this parameter. To exclude a tag prepend it with a '!'. You can also chain several tag commands together with the '&&' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead).
from
Events with the date set to a date after the one specified in the from field (format: 2015-02-15). This filter will use the date of the event.
to
Events with the date set to a date before the one specified in the to field (format: 2015-02-15). This filter will use the date of the event.
last
Events published within the last x amount of time, where x can be defined in days, hours, minutes (for example 5d or 12h or 30m). This filter will use the published timestamp of the event.
eventid
The events that should be included / excluded from the search.
uuid
The returned events must include an attribute with the given UUID, or alternatively the event's UUID must match the value(s) passed.
The keywords false or null should be used for optional empty parameters in the URL. ~~~~ https:///attributes/restSearch/download/[value]/[type]/[category]/[org]/[tag]/[from]/[to]/[last]/[eventid]/[withattachments]/[uuid] ~~~~ Value, type, category and org are optional. It is possible to search for several terms in each category by joining them with the '&&' operator. It is also possible to negate a term with the '!' operator. Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). For example, in order to search for all attributes created by your organisation that contain 192.168 or 127.0 but not 0.1 and are of the type ip-src, excluding the events that were tagged tag1 use the following syntax: ~~~~ https:///attributes/restSearch/download/192.168&&127.0&&!0.1/ip-src/false/CIRCL/!tag1 ~~~~ You can also use search for IP addresses using CIDR. Make sure that you use '|' (pipe) instead of '/' (slashes). Please be aware the colons (:) cannot be used in the tag search. Use semicolons instead (the search will automatically search for colons instead). See below for an example: ~~~~ https:///attributes/restSearch/download/192.168.1.1|16/ip-src/null/CIRCL ~~~~ ## Export attributes of event with specified type as XML If you want to export all attributes of a pre-defined type that belong to an event, use the following syntax: ~~~~ https:///attributes/returnAttributes/download/[id]/[type]/[sigOnly] ~~~~ sigOnly is an optional flag that will block all attributes from being exported that don't have the IDS flag turned on. It is possible to search for several types with the '&&' operator and to exclude values with the '!' operator. For example, to get all IDS signature attributes of type md5 and sha256, but not filename|md5 and filename|sha256 from event 25, use the following: ~~~~ https:///attributes/returnAttributes/download/25/md5&&sha256&&!filename/true ~~~~ ## Filtering event metadata As described in the REST section, it is possible to retrieve a list of events along with their metadata by sending a GET request to the /events API. However, this API in particular is a bit more versatile. You can pass search parameters along to search among the events on various fields and retrieve a list of matching events (along with their metadata). Use the following URL: ~~~~ https:///events/index ~~~~ POST a JSON object with the desired lookup fields and values to receive a JSON back. An example for a valid lookup: ~~~~ Authorization: Accept: application/json Content-type: application/json ~~~~ Body: ~~~~json {"searchinfo":"Locky", "searchpublished":1, "searchdistribution":0} ~~~~ The list of valid parameters:
searchpublished:
Filters on published or unpulished events [0,1] - negatable
searchinfo:
Filters on strings found in the event info - negatable
searchtag:
Filters on attached tag names - negatable
searcheventid:
Filters on specific event IDs - negatable
searchthreatlevel:
Filters on a given event threat level [1,2,3,4] - negatable
searchdistribution:
Filters on the distribution level [0,1,2,3] - negatable
searchanalysis:
Filters on the given analysis phase of the event [0,1,2,3] - negatable
searchattribute:
Filters on a contained attribute value - negatable
searchorg:
Filters on the creator organisation - negatable
searchemail:
Filters on the creator user's email address (admin only) - negatable
searchDatefrom:
Filters on the date, anything newer than the given date in YYYY-MM-DD format is taken - non-negatable
searchDateuntil:
Filters on the date, anything older than the given date in YYYY-MM-DD format is taken - non-negatable
## Download attachment or malware sample If you know the attribute ID of a malware-sample or an attachment, you can download it with the following syntax: ~~~~ https:///attributes/downloadAttachment/download/[Attribute_id] ~~~~ ## Download malware sample by hash You can also download samples by knowing its MD5 hash. Simply pass the hash along as a JSON/XML object or in the URL (with the URL having overruling the passed objects) to receive a JSON/XML object back with the zipped sample base64 encoded along with some contextual information. You can also use this API to get all samples from events that contain the passed hash. For this functionality, just pass the "allSamples" flag along. Note that if you are getting all samples from matching events, you can use all supported hash types (md5, sha1, sha256) for the lookup. You can also get all the samples from an event with a given event ID, by passing along the eventID parameter. Make sure that either an event ID or a hash is passed along, otherwise an error message will be returned. Also, if no hash is set, the allSamples flag will get set automatically. https:///attributes/downloadSample/[hash]/[allSamples]/[eventID] POST message payload (XML): ~~~~ 7c12772809c1c0c3deda6103b10fdfa0113 ~~~~ POST message payload (json): ~~~~ {"request": {"hash": "7c12772809c1c0c3deda6103b10fdfa0", "allSamples": 1, "eventID": 13}} ~~~~ A description of all the parameters in the passed object:
hash
A hash in MD5 format. If allSamples is set, this can be any one of the following: md5, sha1, sha256.
allSamples
If set, it will return all samples from events that have a match for the hash provided above.
eventID
If set, it will only fetch data from the given event ID.
## Upload malware samples using the "Upload Sample" API ~~~~ https:///events/upload_sample/[Event_id] ~~~~ This API will allow you to populate an event that you have modify rights to with malware samples (and all related hashes). Alternatively, if you do not supply an event ID, it will create a new event for you. The files have to be base64 encoded and POSTed as explained below. All samples will be zipped and password protected (with the password being "infected"). The hashes of the original file will be captured as additional attributes. For sample upload (for objects in general) there is no check for duplicates. The event ID is optional. MISP will accept either a JSON or an XML object posted to the above URL. The general structure of the expected objects is as follows: ~~~~json {"request": {"files": [{"filename": filename1, "data": base64encodedfile1}, {"filename": filename2, "data": base64encodedfile2}], "optional_parameter1", "optional_parameter2", "optional_parameter3"}} ~~~~ JSON: ~~~~json {"request":{"files": [{"filename": "test1.txt", "data": "dGVzdA=="}, {"filename": "test2.txt", "data": "dGVzdDI="}], "distribution": 1, "info" : "test", "event_id": 15}} ~~~~ XML: ~~~~xml test3.txtdGVzdA==test4.txtdGVzdDI=test115 ~~~~ The following optional parameters are expected:
event_id
The Event's ID is optional. It can be either supplied via the URL or the POSTed object, but the URL has priority if both are provided. Not supplying an event ID will cause MISP to create a single new event for all of the POSTed malware samples. You can define the default settings for the event, otherwise a set of default settings will be used.
distribution
The distribution setting used for the attributes and for the newly created event, if relevant. [0-3]
to_ids
You can flag all attributes created during the transaction to be marked as "to_ids" or not.
category
The category that will be assigned to the uploaded samples. Valid options are: Payload delivery, Artifacts dropped, Payload Installation, External Analysis.
info
Used to populate the event info field if no event ID supplied. Alternatively, if not set, MISP will simply generate a message showing that it's a malware sample collection generated on the given day.
analysis
The analysis level of the newly created event, if applicable. [0-2] threat_level_id: The threat level ID of the newly created event, if applicatble. [0-3]
comment
This will populate the comment field of any attribute created using this API.
The **threat_level_id** is mapped as such: ``` 0 = high 1 = medium 2 = low 3 = undefined ``` ## Proposals API You can interact with the proposals via the API directly since version 2.3.148. |HTTP|URL|Explanation|Expected Payload|Response| |----|---|-----------|----------------|--------| |GET|/shadow_attributes/view/[proposal_id]|View a proposal|N/A|ShadowAttribute object| |POST|/shadow_attributes/add/[event_id]|Propose a new attribute to an event|ShadowAttribute object|ShadowAttribute object| |POST|/shadow_attributes/edit/[attribute_id]|Propose an edit to an attribute|ShadowAttribute object|ShadowAttribute object| |POST|/shadow_attributes/accept/[proposal_id]|Accept a proposal|N/A|Message| |POST|/shadow_attributes/discard/[proposal_id]|Discard a proposal|N/A|Message| When posting a shadow attribute object, use the following format JSON: ~~~~json {"request": {"ShadowAttribute": {"value": "5.5.5.5", "to_ids": false, "type": "ip-dst", "category": "Network activity"}}} ~~~~ XML: ~~~~xml 5.5.5.50ip-srcNetwork activity ~~~~ None of the above fields are mandatory, but at least one of them has to be provided. ## Sharing groups MISP allows sharing groups to be retrieved via the API. ~~~~ https:///sharing_groups/index.json ~~~~ Based on the API key used, the list of visible sharing groups will be returned in a JSON file. The JSON includes the organization parts of a given sharing group along with the associated server. ## Enable, disable and fetching feeds via the API The MISP feeds can be enabled via the API. A feed can be enabled by POSTing on the following URL (feed_id is the id of the feed): ~~~~ /feeds/enable/feed_id ~~~~ A feed can be disabled by POSTing on the following URL (feed_id is the id of the feed): ~~~~ /feeds/disable/feed_id ~~~~ All feeds can cached via the API: ~~~~ /feeds/cacheFeeds/all ~~~~ or you can replace `all` by the feed format to fetch like `misp` or `freetext`. `all` can be replaced with the `id` value of the feed to fetch a specific feed. To fetch a feed or all feeds: ~~~~ /feeds/fetchFromFeed/feed_id /feeds/fetchFromAllFeeds ~~~~ This API can be also used to download feeds at regular interval via cronjobs or alike. ## Sightings API MISP allows Sightings data to be conveyed in several ways. The most basic way is to POST a blank message to the Sightings API with the attribute ID or attribute UUID. This will create a sightings entry with the creation of the entry as the timestamp for the organisation of the authenticated user. ~~~~ https:///sightings/add/[attribute_id] https:///sightings/add/[attribute_uuid] ~~~~ Alternatively, it is possible to POST a JSON object and gain additional granularity. The following fields are recognised by the API:
id
The attribute's ID
uuid
The attribute's UUID
value
Will create a sighting for any attribute with the given value or for composite attributes, for the value matching any element of the attribute value
values
Expects a list, MISP will create sightings for any attribute matching any of the given values or for composite attributes, for any of the values matching any element of the attribute value
timestamp
Unix timestamp of the sighting, overrides the current time
Some examples: To create a sighting for attribute #9001: ~~~~json {"id":"9001"} ~~~~ To create a sighting for any attribute with the value being teamliquid.net or 173.231.136.216 with the time of sighting being : ~~~~json {"values":["teamliquid.net", "173.231.136.216"], "timestamp":1460558710} ~~~~ It is also possible to POST a STIX indicator with sighting data to the following URL (keep in mind that the content type has to be XML): ~~~~ https:///sightings/add/stix ~~~~ MISP will use the sightings related observables to gather all values and create sightings for each attribute that matches any of the values. If no related observables are provided in the Sighting object, then MISP will fall back to the Indicator itself and use its observables' values to create the sightings. The time of the sighting is the current time, unless the timestamp attribute is set on the Sightings object, in which case that is taken. An example STIX sightings document: ~~~~xml Example watchlist that contains IP information. Indicators - Watchlist Domain Watchlist malicious1.example.com##comma##malicious2.example.com##comma##malicious3.example.com FooBar Inc. malicious2.example.com ~~~~ POSTing this as the message's body to MISP will sight any attributes visible to the user with he value "malicious2.example.com". For composite types, a match on a component will also trigger a sighting (so for example for attributes of type domain|ip a domain match would be sufficient). If no Related observables are set in the Sighting itself, MISP will fall back to the observable directly contained in the indicator. So in the following example: ~~~~xml Example watchlist that contains IP information. Indicators - Watchlist Domain Watchlist malicious1.example.com##comma##malicious2.example.com##comma##malicious3.example.com FooBar Inc. ~~~~ MISP would create sightings for attributes matching any of the following: malicious1.example.com, malicious2.example.com, malicious3.example.com ## Warninglists API ### GET warninglists/index #### Description Return the index of warninglists enabled on the MISP instance #### Parameters - id #### Output ~~~~json ... {"Warninglists":[{"Warninglist":{"id":"17","name":"List of known Office 365 URLs and IP address ranges","type":"string","description":"Office 365 URLs and IP address ranges","version":"20170212","enabled":true,"warninglist_entry_count":"1516","valid_attributes":"ip-src, ip-dst, domain|ip, hostname"}},{"Warninglist":{"id":"16","name":"List of known google domains","type":"string","description":"Event contains one or more entries of known google domains","version":"3","enabled":true,"warninglist_entry_count":"665","valid_attributes":"domain, hostname, domain|ip"}},{"Warninglist":{"id":"15","name":"List of hashes for EICAR test virus","type":"string","description":"Event contains one or more entries based on hashes for EICAR test virus","version":"1","enabled":true,"warninglist_entry_count":"15","valid_attributes":"md5, sha1, sha256, sha512, filename|md5, filename|sha1, filename|sha256, filename|sha512"}},{"Warninglist":{"id":"14","name":"Top 1000 website from Alexa","type":"string","description":"Event contains one or more entries from the top 1000 of the most used website (Alexa).","version":"20170212","enabled":true,"warninglist_entry_count":"1000","valid_attributes":"hostname, domain"}},{"Warninglist":{"id":"13","name":"TLDs as known by IANA","type":"string","description":"Event contains one or more TLDs as attribute with an IDS flag set","version":"2","enabled":true,"warninglist_entry_count":"1290","valid_attributes":"hostname, domain, domain|ip"}},{"Warninglist":{"id":"12","name":"Second level TLDs as known by Mozilla Foundation","type":"string","description":"Event contains one or more second level TLDs as attribute with an IDS flag set","version":"2","enabled":true,"warninglist_entry_count":"6462","valid_attributes":"hostname, domain, domain|ip"}},{"Warninglist":{"id":"11","name":"List of RFC 5735 CIDR blocks","type":"cidr","description":"Event contains one or more entries part of the RFC 5735 CIDR blocks - Special Use IPv4 Addresses","version":"2","enabled":true,"warninglist_entry_count":"15","valid_attributes":"ip-src, ip-dst, domain|ip"}},{"Warninglist":{"id":"10","name":"List of RFC 3849 CIDR blocks","type":"cidr","description":"Event contains one or more entries part of the IPv6 documentation prefix (RFC 3849)","version":"2","enabled":true,"warninglist_entry_count":"1","valid_attributes":"ip-src, ip-dst, domain|ip"}},{"Warninglist":{"id":"9","name":"List of RFC 1918 CIDR blocks","type":"cidr","description":"Event contains one or more entries part of the RFC 1918 CIDR blocks","version":"2","enabled":true,"warninglist_entry_count":"3","valid_attributes":"ip-src, ip-dst, domain|ip"}},{"Warninglist":{"id":"8","name":"List of known IPv6 public DNS resolvers","type":"string","description":"Event contains one or more public IPv6 DNS resolvers as attribute with an IDS flag set","version":"20160803","enabled":true,"warninglist_entry_count":"172","valid_attributes":"ALL"}},{"Warninglist":{"id":"7","name":"List of known IPv4 public DNS resolvers","type":"string","description":"Event contains one or more public IPv4 DNS resolvers as attribute with an IDS flag set","version":"20160803","enabled":true,"warninglist_entry_count":"77857","valid_attributes":"ALL"}},{"Warninglist":{"id":"6","name":"List of RFC 5771 multicast CIDR blocks","type":"cidr","description":"Event contains one or more entries part of the RFC 5771 multicast CIDR blocks","version":"2","enabled":true,"warninglist_entry_count":"16","valid_attributes":"ip-src, ip-dst, domain|ip"}},{"Warninglist":{"id":"5","name":"List of known microsoft domains","type":"string","description":"Event contains one or more entries of known microsoft domains","version":"1","enabled":true,"warninglist_entry_count":"152","valid_attributes":"domain, hostname, domain|ip"}},{"Warninglist":{"id":"4","name":"List of IPv6 link local blocks","type":"cidr","description":"Event contains one or more entries part of the IPv6 link local prefix (RFC 4291)","version":"1","enabled":true,"warninglist_entry_count":"1","valid_attributes":"ip-src, ip-dst, domain|ip"}} .... ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X "GET" https://10.50.13.60/warninglists/index ~~~~ ### GET warninglists/view/1 #### Description Return the a warninglist by id #### Parameters - id #### Output ~~~~json to long ~~~~ #### Example ~~~~ curl --header "Authorization: YOUR API KEY " --header "Accept: application/json" --header "Content-Type: application/json" -X "GET" https://10.50.13.60/warninglists/view/17 ~~~~ # Attribute statistics API If you are interested in the attribute type or attribute category data distribution on your instance, MISP offers an API that will create an aggregates list. To access the API, simple sent a GET request to: ~~~~ https:///attributes/attributeStatistics/[context]/[percentage] ~~~~ Where the following parameters can be set:
Context
Set whether you are interested in the type or category statistics of your instance. This parameter can be either set to "type" or "category", with type being the default setting if the parameter is not set.
Percentage
An optional field, if set, it will return the results in percentages instead of the count.
The results are always returned as JSON. Sample output of the types in percentages from CIRCL's MISP instance: ~~~~json { "AS": "0.015%", "attachment": "0.177%", "btc": "0.005%", "campaign-name": "0.005%", "comment": "1.47%", "domain": "15.992%", "domain|ip": "0.005%", "email-attachment": "0.207%", "email-dst": "0.121%", "email-src": "0.192%", "email-subject": "0.146%", "filename": "3.698%", "filename|md5": "0.349%", "filename|sha1": "0.894%", "filename|sha256": "0.652%", "hostname": "17.558%", "http-method": "0.045%", "ip-dst": "7.087%", "ip-src": "2.707%", "link": "5.748%", "malware-sample": "0.702%", "malware-type": "0.005%", "md5": "21.064%", "mutex": "0.278%", "named pipe": "0.03%", "other": "1.495%", "pattern-in-file": "0.192%", "pattern-in-memory": "0.303%", "pattern-in-traffic": "0.051%", "regkey": "0.126%", "regkey|value": "0.187%", "sha1": "8.921%", "sha256": "5.597%", "snort": "0.045%", "target-machine": "0.248%", "target-org": "0.01%", "target-user": "0.106%", "text": "0.934%", "threat-actor": "0.005%", "url": "2.258%", "user-agent": "0.081%", "vulnerability": "0.182%", "whois-registrant-email": "0.01%", "x509-fingerprint-sha1": "0.01%", "yara": "0.086%" } ~~~~ # Additional statistics Additional statistics are available as JSON which are the statistics also usable via the user interface. A ".json" can be appended to the following URLs: ~~~~ - https:///users/statistics/tags.json - https:///users/statistics.json - https:///users/statistics/attributehistogram.json - https:///users/statistics/orgs.json ~~~~ An example output of https:///users/statistics.json: ~~~~ { "stats": { "event_count": 5233, "event_count_month": 21, "attribute_count": 645498, "attribute_count_month": 723, "correlation_count": 207152, "proposal_count": 48944, "user_count": 1073, "org_count": 587, "thread_count": 191, "thread_count_month": 0, "post_count": 337, "post_count_month": 0 } } ~~~~ # MISP modules ## Description It is possible call misp-modules directly from API. If the module needs credentials, API will get the information directly from MISP configuration. ### GET /modules/ Retrieve a list of all modules enabled. #### Example ~~~bash curl --header "Authorization: " --header "Accept: application/json" --header "Content-Type: application/json" -X GET http:///modules/ ~~~ #### Output ~~~json [ { "name": "passivetotal", "type": "expansion", "mispattributes": { "input": [ "hostname", "domain", "ip-src", "ip-dst" ], "output": [ "ip-src", "ip-dst", "hostname", "domain" ] }, "meta": { "description": "PassiveTotal expansion service to expand values with multiple Passive DNS sources", "config": [ "username", "password" ], "author": "Alexandre Dulaunoy", "version": "0.1" } }, { "name": "sourcecache", "type": "expansion", "mispattributes": { "input": [ "link" ], "output": [ "link" ] }, "meta": { "description": "Module to cache web pages of analysis reports, OSINT sources. The module returns a link of the cached page.", "author": "Alexandre Dulaunoy", "version": "0.1" } }, { "name": "dns", "type": "expansion", "mispattributes": { "input": [ "hostname", "domain" ], "output": [ "ip-src", "ip-dst" ] }, "meta": { "description": "Simple DNS expansion service to resolve IP address from MISP attributes", "author": "Alexandre Dulaunoy", "version": "0.1" } } ] ~~~ ### POST /modules/queryEnrichment Call any enabled module. #### Example Content of dns.json ~~~json { "hostname": "www.foo.be", "module": "dns" } ~~~ Query using MISP API ~~~bash curl --header "Authorization: " --header "Accept: application/json" --header "Content-Type: application/json" --data @dns.json -X POST http:///modules/queryEnrichment ~~~ The output will be following JSON: ~~~json { "results": [ { "types": [ "ip-src", "ip-dst" ], "values": [ "188.65.217.78" ] } ] } ~~~