AIL-framework/bin/packages/modules.cfg

[Mixer]
subscribe = ZMQ_Global
publish = Redis_Mixer,Redis_preProcess1

[Global]
subscribe = Redis_Mixer
publish = Redis_Global,Redis_ModuleStats

[PreProcessFeed]
subscribe = Redis_preProcess1
publish = Redis_Mixer

[Duplicates]
subscribe = Redis_Duplicate

[Indexer]
subscribe = Redis_Global

[Attributes]
subscribe = Redis_Global

[Lines]
subscribe = Redis_Global
publish = Redis_LinesShort,Redis_LinesLong

[DomClassifier]
subscribe = Redis_Global

[Tokenize]
subscribe = Redis_LinesShort
publish = Redis_Words

[Curve]
subscribe = Redis_Words
publish = Redis_CurveManageTopSets

[RegexForTermsFrequency]
subscribe = Redis_Global

[SetForTermsFrequency]
subscribe = Redis_Global

[CurveManageTopSets]
subscribe = Redis_CurveManageTopSets

[Categ]
subscribe = Redis_Global
publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve

[CreditCards]
subscribe = Redis_CreditCards
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Mail]
subscribe = Redis_Mail
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Onion]
subscribe = Redis_Onion
publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_BrowseWarningPaste
#publish = Redis_Global,Redis_ValidOnion,ZMQ_FetchedOnion,Redis_BrowseWarningPaste

[DumpValidOnion]
subscribe = Redis_ValidOnion

[Web]
subscribe = Redis_Web
publish = Redis_Url,ZMQ_Url

[WebStats]
subscribe = Redis_Url

[SQLInjectionDetection]
subscribe = Redis_Url
publish = Redis_BrowseWarningPaste,Redis_Duplicate

[ModuleStats]
subscribe = Redis_ModuleStats

[BrowseWarningPaste]
subscribe = Redis_BrowseWarningPaste

#[send_to_queue]
#subscribe = Redis_Cve
#publish = Redis_BrowseWarningPaste

[SentimentAnalysis]
subscribe = Redis_Global

[Release]
subscribe = Redis_Global

[Credential]
subscribe = Redis_Credential
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Cve]
subscribe = Redis_Cve
publish = Redis_BrowseWarningPaste,Redis_Duplicate

[Phone]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_BrowseWarningPaste

[Keys]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_BrowseWarningPaste
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 10:31:26 +01:00			`[Mixer]`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`subscribe = ZMQ_Global`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 14:12:26 +01:00			`publish = Redis_Mixer,Redis_preProcess1`
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 10:31:26 +01:00
			`[Global]`
			`subscribe = Redis_Mixer`
Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00			`publish = Redis_Global,Redis_ModuleStats`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 14:12:26 +01:00			`[PreProcessFeed]`
			`subscribe = Redis_preProcess1`
			`publish = Redis_Mixer`

Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`[Duplicates]`
Duplicate module takes its messages from other modules and no more from Global. 2016-07-18 16:22:33 +02:00			`subscribe = Redis_Duplicate`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Indexer]`
			`subscribe = Redis_Global`

			`[Attributes]`
			`subscribe = Redis_Global`

			`[Lines]`
			`subscribe = Redis_Global`
			`publish = Redis_LinesShort,Redis_LinesLong`

Add Domain Classifier module. Cleanup in the config files. 2014-09-05 10:41:00 +02:00			`[DomClassifier]`
			`subscribe = Redis_Global`

Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00			`[Tokenize]`
			`subscribe = Redis_LinesShort`
			`publish = Redis_Words`

			`[Curve]`
			`subscribe = Redis_Words`
Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00			`publish = Redis_CurveManageTopSets`
New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
			`[RegexForTermsFrequency]`
Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00			`subscribe = Redis_Global`
New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
			`[SetForTermsFrequency]`
			`subscribe = Redis_Global`
Added terms trending module and web interface: - Curve module has been rewritten - Added new module curve_manage_top_set - Added all web-pages 2016-08-22 13:35:49 +02:00
			`[CurveManageTopSets]`
			`subscribe = Redis_CurveManageTopSets`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Categ]`
Categ now listen to the Global queue 2014-09-05 17:05:45 +02:00			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00			`publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[CreditCards]`
Added script module-dataflow-graph + fixed bug in module.cfg preventing the credential module to receive data. 2016-08-24 11:32:48 +02:00			`subscribe = Redis_CreditCards`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Mail]`
			`subscribe = Redis_Mail`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Onion]`
			`subscribe = Redis_Onion`
Added support of onion in browseWarningPaste 2017-04-26 11:47:02 +02:00			`publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_BrowseWarningPaste`
			`#publish = Redis_Global,Redis_ValidOnion,ZMQ_FetchedOnion,Redis_BrowseWarningPaste`
Fix the onion module, log the valid onions. 2014-09-01 16:18:06 +02:00
			`[DumpValidOnion]`
			`subscribe = Redis_ValidOnion`
Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
			`[Web]`
			`subscribe = Redis_Web`
			`publish = Redis_Url,ZMQ_Url`
Add modules Credential and Release 2016-02-05 16:15:09 +01:00
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00			`[WebStats]`
			`subscribe = Redis_Url`

Added SQLInjectionDetection module 2016-08-02 15:43:11 +02:00			`[SQLInjectionDetection]`
			`subscribe = Redis_Url`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_BrowseWarningPaste,Redis_Duplicate`
Add modules Credential and Release 2016-02-05 16:15:09 +01:00
Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00			`[ModuleStats]`
			`subscribe = Redis_ModuleStats`
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00
Added support of PID in ModuleInformation and index.html 2016-08-26 15:27:37 +02:00			`[BrowseWarningPaste]`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`subscribe = Redis_BrowseWarningPaste`

			`#[send_to_queue]`
Prod config 2016-07-25 09:49:14 +02:00			`#subscribe = Redis_Cve`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`#publish = Redis_BrowseWarningPaste`

Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8). 2016-08-16 16:33:02 +02:00			`[SentimentAnalysis]`
			`subscribe = Redis_Global`
Added sentiment analyser module (draft) 2016-08-13 15:24:57 +02:00
Add modules Credential and Release 2016-02-05 16:15:09 +01:00			`[Release]`
			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00
Add modules Credential and Release 2016-02-05 16:15:09 +01:00			`[Credential]`
Add new category (Credential) 2016-02-10 16:39:56 +01:00			`subscribe = Redis_Credential`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00
Getting Started: Initial configuration working on the laptop 2016-06-30 14:36:47 +02:00			`[Cve]`
			`subscribe = Redis_Cve`
Fixed bug CVE, CVE was not sending its data to BrowseWarningPaste. 2016-08-08 10:05:21 +02:00			`publish = Redis_BrowseWarningPaste,Redis_Duplicate`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 10:13:44 +01:00
Update module.cfg (adding Keys and Phone section) 2016-02-05 20:00:41 +01:00			`[Phone]`
			`subscribe = Redis_Global`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_Duplicate,Redis_BrowseWarningPaste`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 10:13:44 +01:00
Add module to find PGP encrypted blobs 2016-02-05 16:03:37 +01:00			`[Keys]`
			`subscribe = Redis_Global`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 09:17:44 +02:00			`publish = Redis_Duplicate,Redis_BrowseWarningPaste`