Python library using the MISP Rest API
Go to file
Raphaël Vinot d06313a653 chg: Force a few packages versions 2020-11-25 12:30:53 +01:00
.github/workflows fix: Remove python 3.9 from action (lief not supported yet) 2020-11-24 12:35:39 +01:00
docs fix typo 2020-10-01 13:45:29 +02:00
examples chg: Add path to CSV sample files 2020-11-24 11:28:36 +01:00
pymisp fix: Typing edge case 2020-11-25 09:23:33 +01:00
tests fix: Add attribute dict as proposal 2020-11-24 20:03:01 +01:00
travis chg: Bump version, travis install 2020-11-24 11:17:23 +01:00
.gitchangelog.rc chg: Bump version 2019-03-01 10:46:48 -08:00
.gitignore chg: Update gitignore 2020-11-17 14:42:09 +01:00
.gitmodules Add viper-test-files repository as Git submodule 2019-10-04 09:00:01 +02:00
.readthedocs.yml chg: Build all formats for the documentation 2019-03-01 10:37:47 -08:00
.travis.yml chg: Improve error handling for Outlook emails 2020-11-19 11:38:35 +01:00
CHANGELOG.txt chg: Bump changelog 2020-11-24 15:03:56 +01:00
LICENSE add license 2014-12-09 14:54:45 +01:00
MANIFEST.in Include documentation and examples in source dist 2017-12-18 11:25:11 +01:00
README.md chg: [doc] add a reference to the license 2020-09-16 15:07:38 +02:00
poetry.lock chg: Force a few packages versions 2020-11-25 12:30:53 +01:00
pyproject.toml chg: Force a few packages versions 2020-11-25 12:30:53 +01:00
setup.cfg Fix PyPi package. 2015-08-05 17:48:15 +02:00
setup.py fix: Make lief optional again 2020-02-07 11:51:48 +01:00

README.md

IMPORTANT NOTE: This library will require at least python 3.6 starting the 1st of January 2020. If you have legacy versions of python, please use PyMISP v2.4.119.1, and consider updating your system(s). Anything released within the last 2 years will do, starting with Ubuntu 18.04.

PyMISP - Python Library to access MISP

Documentation Status Build Status Coverage Status Python 3.6 PyPi version Number of PyPI downloads

PyMISP is a Python library to access MISP platforms via their REST API.

PyMISP allows you to fetch events, add or update events/attributes, add or update samples or search for attributes.

Install from pip

It is strongly recommended to use a virtual environment

If you want to know more about virtual environments, python has you covered

Only basic dependencies:

pip3 install pymisp

With optional dependencies:

pip3 install pymisp[fileobjects,openioc,virustotal]

Install the latest version from repo from development purposes

Note: poetry is required; e.g., "pip3 install poetry"

git clone https://github.com/MISP/PyMISP.git && cd PyMISP
git submodule update --init
poetry install -E fileobjects -E openioc -E virustotal -E docs -E pdfexport

Running the tests

poetry run nosetests-3.4 --with-coverage --cover-package=pymisp,tests --cover-tests tests/test_*.py

If you have a MISP instance to test against, you can also run the live ones:

Note: You need to update the key in tests/testlive_comprehensive.py to the automation key of your admin account.

poetry run nosetests-3.4 --with-coverage --cover-package=pymisp,tests --cover-tests tests/testlive_comprehensive.py

Samples and how to use PyMISP

Various examples and samples scripts are in the examples/ directory.

In the examples directory, you will need to change the keys.py.sample to enter your MISP url and API key.

cd examples
cp keys.py.sample keys.py
vim keys.py

The API key of MISP is available in the Automation section of the MISP web interface.

To test if your URL and API keys are correct, you can test with examples/last.py to fetch the events published in the last x amount of time (supported time indicators: days (d), hours (h) and minutes (m)). last.py

cd examples
python3 last.py -l 10h # 10 hours
python3 last.py -l 5d  #  5 days
python3 last.py -l 45m # 45 minutes

Debugging

You have two options here:

  1. Pass debug=True to PyMISP and it will enable logging.DEBUG to stderr on the whole module

  2. Use the python logging module directly:


import logging
logger = logging.getLogger('pymisp')

# Configure it as you wish, for example, enable DEBUG mode:
logger.setLevel(logging.DEBUG)

Or if you want to write the debug output to a file instead of stderr:

import pymisp
import logging

logger = logging.getLogger('pymisp')
logging.basicConfig(level=logging.DEBUG, filename="debug.log", filemode='w', format=pymisp.FORMAT)

Test cases

  1. The content of mispevent.py is tested on every commit
  2. The test cases that require a running MISP instance can be run the following way:
# From poetry

nosetests-3.4 -s --with-coverage --cover-package=pymisp,tests --cover-tests tests/testlive_comprehensive.py:TestComprehensive.[test_name]

Documentation

The documentation is available here.

Jupyter notebook

A series of Jupyter notebooks for PyMISP tutorial are available in the repository.

Everything is a Mutable Mapping

... or at least everything that can be imported/exported from/to a json blob

AbstractMISP is the master class, and inherits from collections.MutableMapping which means the class can be represented as a python dictionary.

The abstraction assumes every property that should not be seen in the dictionary is prepended with a _, or its name is added to the private list __not_jsonable (accessible through update_not_jsonable and set_not_jsonable.

This master class has helpers that make it easy to load, and export to, and from, a json string.

MISPEvent, MISPAttribute, MISPObjectReference, MISPObjectAttribute, and MISPObject are subclasses of AbstractMISP, which mean that they can be handled as python dictionaries.

MISP Objects

Creating a new MISP object generator should be done using a pre-defined template and inherit AbstractMISPObjectGenerator.

Your new MISPObject generator must generate attributes and add them as class properties using add_attribute.

When the object is sent to MISP, all the class properties will be exported to the JSON export.

License

PyMISP is distributed under an open source license. A simplified 2-BSD license.