AIL-framework/bin/packages/modules.cfg

[Mixer]
subscribe = ZMQ_Global
publish = Redis_Mixer,Redis_preProcess1

[Importer_Json]
publish = Redis_Mixer,Redis_Tags

[Global]
subscribe = Redis_Mixer
publish = Redis_Global,Redis_ModuleStats

#[PreProcessFeed]
#subscribe = Redis_preProcess1
#publish = Redis_Mixer

[Duplicates]
subscribe = Redis_Duplicate

[Indexer]
subscribe = Redis_Global

[DomClassifier]
subscribe = Redis_Global

[TermTrackerMod]
subscribe = Redis_Global
publish = Redis_Tags

[RegexTracker]
subscribe = Redis_Global
publish = Redis_Tags

[Tracker_Yara]
subscribe = Redis_Global
publish = Redis_Tags

[Tools]
subscribe = Redis_Global
publish = Redis_Tags

[Telegram]
subscribe = Redis_Global
publish = Redis_Tags

[Languages]
subscribe = Redis_Global

[Categ]
subscribe = Redis_Global
publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve,Redis_ApiKey

[CreditCards]
subscribe = Redis_CreditCards
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[BankAccount]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Mail]
subscribe = Redis_Mail
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[Onion]
subscribe = Redis_Onion
publish = Redis_ValidOnion,Redis_Tags,Redis_Crawler
#publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_Tags,Redis_Crawler

# TODO remove me
[DumpValidOnion]
subscribe = Redis_ValidOnion

[Web]
subscribe = Redis_Web
publish = Redis_Url
#publish = Redis_Url,ZMQ_Url

[WebStats]
subscribe = Redis_Url

[LibInjection]
subscribe = Redis_Url
publish = Redis_Duplicate,Redis_Tags

[SQLInjectionDetection]
subscribe = Redis_Url
publish = Redis_Duplicate,Redis_Tags

[ModuleStats]
subscribe = Redis_ModuleStats

[Tags]
subscribe = Redis_Tags
publish = Redis_Tags_feed

[MISP_The_hive_feeder]
subscribe = Redis_Tags_feed

#[send_to_queue]
#subscribe = Redis_Cve
#publish = Redis_Tags

[SentimentAnalysis]
subscribe = Redis_Global

[Release]
subscribe = Redis_Global

[Credential]
subscribe = Redis_Credential
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[Cve]
subscribe = Redis_Cve
publish = Redis_Duplicate,Redis_Tags

[Phone]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Keys]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_PgpDump,Redis_Tags

[PgpDump]
subscribe = Redis_PgpDump
publish = Redis_Duplicate,Redis_Tags

[ApiKey]
subscribe = Redis_ApiKey
publish = Redis_Duplicate,Redis_Tags

[Decoder]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Bitcoin]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[submit_paste]
subscribe = Redis
publish = Redis_Mixer

[Crawler]
subscribe = Redis_Crawler
publish = Redis_Mixer,Redis_Tags

[IP]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 10:31:26 +01:00			`[Mixer]`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`subscribe = ZMQ_Global`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 14:12:26 +01:00			`publish = Redis_Mixer,Redis_preProcess1`
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 10:31:26 +01:00
chg: [core import] add AIL JSON import format, API endpoint added (AIL feeders) 2020-04-28 14:14:45 +02:00			`[Importer_Json]`
			`publish = Redis_Mixer,Redis_Tags`

Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 10:31:26 +01:00			`[Global]`
			`subscribe = Redis_Mixer`
Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00			`publish = Redis_Global,Redis_ModuleStats`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
fix: [MISP feeder] typo filename-config name 2018-09-21 11:02:08 +02:00			`#[PreProcessFeed]`
			`#subscribe = Redis_preProcess1`
			`#publish = Redis_Mixer`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 14:12:26 +01:00
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`[Duplicates]`
Duplicate module takes its messages from other modules and no more from Global. 2016-07-18 16:22:33 +02:00			`subscribe = Redis_Duplicate`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Indexer]`
			`subscribe = Redis_Global`

Add Domain Classifier module. Cleanup in the config files. 2014-09-05 10:41:00 +02:00			`[DomClassifier]`
			`subscribe = Redis_Global`

fix: [Term Tracker module] chg module flow 2019-08-07 12:19:42 +02:00			`[TermTrackerMod]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg: [Term Tracker] refractor term tracker word/set/regex modules + remove old modules 2019-08-09 14:20:13 +02:00			`[RegexTracker]`
Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00			`subscribe = Redis_Global`
chg: [Terms] tag tracked terms 2018-11-06 13:38:37 +01:00			`publish = Redis_Tags`
New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
chg: [trackers] add yara trackers 2020-08-12 09:28:36 +02:00			`[Tracker_Yara]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

fix: [Tools] fix loop 2019-09-25 23:48:30 +02:00			`[Tools]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg [telegram + correlation] new module: telegram (username + login code + join_chat) + add simple_correlation backend 2020-04-10 10:49:21 +02:00			`[Telegram]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg: [Languages]detect + search domains languages 2020-12-11 21:02:07 +01:00			`[Languages]`
			`subscribe = Redis_Global`

Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`[Categ]`
Categ now listen to the Global queue 2014-09-05 17:05:45 +02:00			`subscribe = Redis_Global`
add apiKeys module 2018-04-26 14:42:39 +02:00			`publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve,Redis_ApiKey`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[CreditCards]`
Added script module-dataflow-graph + fixed bug in module.cfg preventing the credential module to receive data. 2016-08-24 11:32:48 +02:00			`subscribe = Redis_CreditCards`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
add: [BankAccount] iban detection 2018-07-26 15:31:58 +02:00			`[BankAccount]`
			`subscribe = Redis_Global`
			`publish = Redis_Duplicate,Redis_Tags`

Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`[Mail]`
			`subscribe = Redis_Mail`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Onion]`
			`subscribe = Redis_Onion`
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 14:58:27 +01:00			`publish = Redis_ValidOnion,Redis_Tags,Redis_Crawler`
			`#publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_Tags,Redis_Crawler`
Fix the onion module, log the valid onions. 2014-09-01 16:18:06 +02:00
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 14:58:27 +01:00			`# TODO remove me`
Fix the onion module, log the valid onions. 2014-09-01 16:18:06 +02:00			`[DumpValidOnion]`
			`subscribe = Redis_ValidOnion`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Web]`
			`subscribe = Redis_Web`
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 14:58:27 +01:00			`publish = Redis_Url`
			`#publish = Redis_Url,ZMQ_Url`
Add modules Credential and Release 2016-02-05 16:15:09 +01:00
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00			`[WebStats]`
			`subscribe = Redis_Url`

add LibInjection Module 2018-07-04 14:28:10 +02:00			`[LibInjection]`
			`subscribe = Redis_Url`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
add LibInjection Module 2018-07-04 14:28:10 +02:00
Added SQLInjectionDetection module 2016-08-02 15:43:11 +02:00			`[SQLInjectionDetection]`
			`subscribe = Redis_Url`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
Add modules Credential and Release 2016-02-05 16:15:09 +01:00
Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00			`[ModuleStats]`
			`subscribe = Redis_ModuleStats`
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00
add tag js and css 2018-05-16 14:48:15 +02:00			`[Tags]`
			`subscribe = Redis_Tags`
misp event creation, auto and manual + the hive alert auto creation, manual case creation 2018-06-14 16:51:06 +02:00			`publish = Redis_Tags_feed`

fix: [MISP feeder] typo filename-config name 2018-09-21 11:02:08 +02:00			`[MISP_The_hive_feeder]`
misp event creation, auto and manual + the hive alert auto creation, manual case creation 2018-06-14 16:51:06 +02:00			`subscribe = Redis_Tags_feed`
add tag js and css 2018-05-16 14:48:15 +02:00
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`#[send_to_queue]`
Prod config 2016-07-25 09:49:14 +02:00			`#subscribe = Redis_Cve`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`#publish = Redis_Tags`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00
Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8). 2016-08-16 16:33:02 +02:00			`[SentimentAnalysis]`
			`subscribe = Redis_Global`
Added sentiment analyser module (draft) 2016-08-13 15:24:57 +02:00
Add modules Credential and Release 2016-02-05 16:15:09 +01:00			`[Release]`
			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00
Add modules Credential and Release 2016-02-05 16:15:09 +01:00			`[Credential]`
Add new category (Credential) 2016-02-10 16:39:56 +01:00			`subscribe = Redis_Credential`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00			`[Cve]`
			`subscribe = Redis_Cve`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 10:13:44 +01:00
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00			`[Phone]`
			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 10:13:44 +01:00
Add module to find PGP encrypted blobs 2016-02-05 16:03:37 +01:00			`[Keys]`
			`subscribe = Redis_Global`
chg: [PgpDump] add PgpDump backend TODO: UI 2019-05-14 17:49:31 +02:00			`publish = Redis_Duplicate,Redis_PgpDump,Redis_Tags`

			`[PgpDump]`
			`subscribe = Redis_PgpDump`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
add Base64 module 2018-04-20 10:48:44 +02:00
add apiKeys module 2018-04-26 14:42:39 +02:00			`[ApiKey]`
			`subscribe = Redis_ApiKey`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
add apiKeys module 2018-04-26 14:42:39 +02:00
fix: decoder bdd 2018-07-20 09:43:09 +02:00			`[Decoder]`
add Base64 module 2018-04-20 10:48:44 +02:00			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
add bitcoin module 2018-04-23 14:51:53 +02:00
			`[Bitcoin]`
			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00			`publish = Redis_Duplicate,Redis_Tags`
submit users input paste 2018-06-05 16:58:04 +02:00
			`[submit_paste]`
fix: [Queues] module with no subscriber 2018-07-24 15:57:18 +02:00			`subscribe = Redis`
submit users input paste 2018-06-05 16:58:04 +02:00			`publish = Redis_Mixer`
chg: [Onion] add onion splash crawler 2018-08-09 17:42:21 +02:00
			`[Crawler]`
			`subscribe = Redis_Crawler`
			`publish = Redis_Mixer,Redis_Tags`
modules.cfg: Minor: Added \n to seperate sections 2019-09-24 10:30:33 +02:00
Added: IP matching module 2019-09-23 18:22:25 +02:00			`[IP]`
			`subscribe = Redis_Global`
			`publish = Redis_Duplicate,Redis_Tags`