CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
707 Commits
7 Branches
44 Tags
110 MiB
Commit Graph

328 Commits (48fc8e346441ea0eb828c2429d4d65a888e96ea2)

Author SHA1 Message Date
= a8dc9231c6 Typo2.. 2017-08-24 16:43:42 +02:00
= b2d4dd4a1f Typo 2017-08-24 16:43:05 +02:00
= 74ff401e1d Fixed bug: No CR between indexes in all_index.txt file 2017-08-24 16:41:30 +02:00
Alexandre Dulaunoy bb128a5e94 Merge pull request #138 from mokaddem/import_dir_update 
Improvement of import_dir
 2017-08-24 09:40:52 +02:00
= 429cc96d2a Improvement of import_dir.py. Added feed name parameter, send the correct path (without potential ../) and gzipEncode it if needed. 2017-08-23 15:10:26 +02:00
= e7c66d1aac Updated individual launch scripts 2017-08-23 12:28:12 +02:00
= d632335760 Automatically start redis_levelDB with the correct date 2017-08-23 10:16:56 +02:00
= 64ec44085d Dynamically choose correct port for LevelDB in script 2017-08-22 17:52:15 +02:00
= 66d60a1f01 Added LevelDB Curve for 2017 (3017, used for backward compatibility) 2017-08-21 13:54:44 +02:00
= 92adea38d0 Semi-automated directory creation with date as name in LAUNCH and installing_deps 2017-08-21 13:48:02 +02:00
= bc35747f00 Updated KillAll in LAUNCH 2017-08-21 13:19:26 +02:00
Mokaddem c3632c7d86 Added operation mode 3 for Mixer (do not filter) and added possibility to recurse through dir for import_dir 2017-08-03 00:34:53 +02:00
Mokaddem cbb2909156 Added comments 2017-07-20 10:24:48 +02:00
Mokaddem 05417f405c Finished basic link web interface + solved some bugs 2017-07-20 10:04:30 +02:00
Mokaddem ef741f85c0 Added similarity checks + started link webInterface 2017-07-19 11:52:06 +02:00
Mokaddem 882ab88b00 Draft module + web link 2017-07-18 16:57:15 +02:00
Mokaddem 9558aafe67 Prevent the loss of the 1 message in import_dir.py 2017-07-17 16:14:27 +02:00
Mokaddem 4d59871f00 Merged with previous changes for PR 2017-07-17 13:48:16 +02:00
Alexandre Dulaunoy 4986352099 Merge pull request #120 from PaulSec/master 
Added Python Phonenumbers module to parse numbers and retrieves stats…
 2017-06-08 07:05:52 +02:00
Alexandre Dulaunoy 446a97c47a Merge pull request #115 from mokaddem/regexInTerms 
New features for terms frequency
 2017-06-08 07:04:17 +02:00
Mokaddem 3a4dcd691d Improved description of modules inside the scripts 2017-05-09 11:13:16 +02:00
Paul A 747fff1df1 Added Python Phonenumbers module to parse numbers and retrieves stats from countrycode 2017-05-03 14:25:18 +02:00
Mokaddem 3ea0924120 Improved phone regex to handle end with 4 digits and presence of parenthesis. 2017-04-26 12:41:23 +02:00
Mokaddem b60e164380 Added support of onion in browseWarningPaste 2017-04-26 11:47:02 +02:00
Mokaddem 318a557c56 Added possibility to keep a backup of the old config + check if config is valid before starting scripts. 2017-04-25 09:32:05 +02:00
Mokaddem 72c1d903eb Merge branch 'newIndexer' into auto-conf 2017-04-25 08:14:31 +02:00
Mokaddem eccc8fc88b modified check_size timeout + utilisation of shutil instead of os.system() 2017-04-19 16:37:04 +02:00
Mokaddem da081bae42 Merge branch 'regexInTerms' into production 2017-04-18 16:59:40 +02:00
Mokaddem 2d907ae784 Merge branch 'newIndexer' into auto-conf 2017-04-18 16:20:00 +02:00
Mokaddem b0f1cf84b7 remplaced usage of global variable by a function param 2017-04-18 16:02:22 +02:00
Mokaddem 6e8509a0ba Removed wierd line 2017-04-18 15:57:07 +02:00
Mokaddem c8baabd882 Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00
Mokaddem 2da4c572c7 New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
Mokaddem 6e80eb0954 Typo 2017-03-28 09:55:59 +02:00
Mokaddem c79d4d65c8 Keep original section order while updating 2017-03-28 09:54:24 +02:00
Mokaddem e225090e07 Added script that checks configuration and may auto-fix it + added missing field in config.cfg.sample 2017-03-15 16:36:51 +01:00
Mokaddem be93af6f5a Merge branch 'terms-improvements' 2017-03-15 14:55:44 +01:00
Mokaddem 3261eca836 Fixed all_index newline bug + added print of what's happening 2017-03-15 14:29:49 +01:00
Mokaddem 5b7d047622 Changed os.system by os.mkdir + fixed bug during rotation 2017-03-15 14:05:13 +01:00
Mokaddem adc37ab50e Indexer max size now in config 2017-03-15 12:14:41 +01:00
Mokaddem 4005b72180 Added backward support + renamed index with timestamp 2017-03-15 11:51:35 +01:00
Mokaddem 248469d61e Indexer now create an index_dir when it became too large (search in index not updated yet) 2017-03-14 10:37:31 +01:00
Alexandre Dulaunoy 1540b719ed Merge pull request #108 from mokaddem/newModuleInformation 
New version of ModuleInformation
 2017-03-14 08:29:09 +01:00
Mokaddem 3c9cdac39a Merge branch 'terms-improvements' into production 2017-02-28 16:51:39 +01:00
Mokaddem dadc872f9f Merge branch 'newModuleInformation' into production 2017-02-28 16:51:08 +01:00
Mokaddem a2849c1bcd Added a catch for psutils if process get stopped by user 2017-02-28 16:13:01 +01:00
Mokaddem 4071bf2e91 fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value 2017-02-28 15:01:48 +01:00
Mokaddem a1c47d7a13 Merge branch 'production' into terms-improvements 2017-02-28 11:15:56 +01:00
Mokaddem fd4feb374f Merge branch 'newModuleInformation' into production 2017-02-28 11:12:06 +01:00
Mokaddem 75b4037519 Fixed bug - If we move the cursor from a line that has dissapear 2017-02-28 11:11:17 +01:00