CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
1,995 Commits
6 Branches
43 Tags
110 MiB
Commit Graph

15 Commits (20727fff7737c404ca70404f577cb107f44245b7)

Author SHA1 Message Date
Olivier SAGIT f88e53925e fix: stuck queues and submit paste 2021-04-28 15:24:33 +02:00
Terrtia f950e700bd
chg: [SentimentAnalysis] clean 2020-02-10 11:06:39 +01:00
Terrtia 4097d95237
fix: [SentimentAnalysis] download nltk punkt 2020-02-10 11:04:24 +01:00
Terrtia c8d5ce9a28
chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader 2019-11-05 15:18:03 +01:00
Terrtia 4e680aabf0
chg: [Overview] add doc 2018-11-20 14:39:45 +01:00
Terrtia 108fdb868e
chg: update Overview 2018-11-15 10:39:41 +01:00
Terrtia 16c700ddb4
new: add base64 display on paste + base64 statistics 2018-06-29 10:02:29 +02:00
Terrtia 3841c159a0
change leveldb to ardb 2018-05-07 14:50:40 +02:00
Terrtia 96a3df42bc
decode with redis connection 2018-05-04 13:53:29 +02:00
Terrtia 9c82dd90ec python 3 backend upgrade 2018-04-16 14:50:04 +02:00
Mokaddem 3a4dcd691d Improved description of modules inside the scripts 2017-05-09 11:13:16 +02:00
Alexandre Dulaunoy 2f4e5b9016 Merge branch 'master' of github.com:CIRCL/AIL-framework 2017-01-26 07:16:44 +00:00
Alexandre Dulaunoy cf903cc212 (partially fix #90 too) using a simple Alarm (SIGNAL) when exec-timeout 
Introducing a timer (in this case 60 seconds) to ensure that the
execution time of the analysis takes less than 60 seconds. This
is a simple and standard POSIX signal handler. If the timeout
is reached, the module will process the next one.

This approach fixes the specific issues we have currently
with some inputs where the sentiment analysis takes too much time. This
fix should be improved and be more generic:

 - Introducing statistics of content which timeouts.
 - Keeping a list/queue to further process those files using a different
   analysis approach. Maybe a set of "dirty" processes to handle the edge cases
   and to not impact the overall processing and analysis.
 - Make the timer configurable per module (at least for this one).
 2017-01-26 07:11:18 +00:00
Olivier MEDOC 9f9c265cb0 SentimentAnalysis: use lexicon file path from the ail configuration file 2017-01-11 11:07:08 +01:00
Mokaddem 64bf481480 Added moduleInfo + Renamed modules 2016-08-24 17:28:39 +02:00