misp-dashboard/doc/internals.md

Message passing

The MISP instance is producing data that is send through ZMQ.

The script zmq_subscriber.py tries to subscribe to it. Depending on the received message, it forwards the message to function that will handle it. Usually, these messages are parsed and useful functions in *_helper might be called.

Real time data are sent to their respective server's Redis pubsub channel

Redis database

Geolocalisation

Module	Feature	Key name	Key type	Key content
geo_helper	Coordinate per day	GEO_COORD:date	zset	{lat: xx, lon: yy}
geo_helper	Country per day	GEO_COUNTRY:date	zset	ISO_CODE
geo_helper	Coordinate and value per radius	GEO_RAD:date	geo	{ categ: xx, value: yy }

Contribution

Module	Feature	Key name	Key type	Key content
contributor_helper	Contribution per day (monthly points)	CONTRIB_DAY:date	zset	org
contributor_helper	Category contributed per day	CONTRIB_CATEG:date:categ	zset	org
contributor_helper	Last org that contributed	CONTRIB_LAST:date	zset	org
contributor_helper	All org collected from the ZMQ	CONTRIB_ALL_ORG	set	org
contributor_helper	Acquired contribution requirement	CONTRIB_ORG:org:req	string	integer
	req is one of:	points CONTRIB_REQ_i ATTR_WEEK_COUNT PROP_WEEK_COUNT SIGHT_WEEK_COUNT EVENT_WEEK_COUNT EVENT_MONTH_COUNT BADGE_i		with TTL set accordingly
contributor_helper	Acquired trophy points	CONTRIB_TROPHY:categ	zset	org
contributor_helper	Last org to get a trophy or badge	CONTRIB_LAST_AWARDS:date	zset	org

Users

Module	Feature	Key name	Key type	Key content
users_helper	Use to get when orgs connect to MISP	LOGIN_TIMESTAMP:org	zset	timestamp
users_helper	Num. of time an org connected on a date	LOGIN_ORG:date	zset	org
users_helper	All ORG that has logged	LOGIN_ALL_ORG	set	org

Trendings

Module	Feature	Key name	Key type	Key content
trendings_helper	Popularity of type	TRENDINGS_type:date	zset	type_name
	type is one of:	EVENTS CATEGS TAGS DISC
trendings_helper	Popularity of type	TRENDINGS_SIGHT_type:date	string	integer
	type is one of:	sightings false_positive