CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
83 Commits
7 Branches
44 Tags
110 MiB
Commit Graph

83 Commits (99c8cc7941b1277b9a4c0bb629ab11183ff9bd92)

Author SHA1 Message Date
Raphaël Vinot 99c8cc7941 completely remove ZMQ_PubSub.py 2014-08-20 15:14:57 +02:00
Raphaël Vinot 8d9ffbaa53 Do not create a ZMQ sub if it is not required. 2014-08-19 19:53:33 +02:00
Raphaël Vinot 45b0bf3983 Improve the cleanup. Still some to do. 2014-08-19 19:07:07 +02:00
Raphaël Vinot f1753d67c6 Cleanup the queues. 2014-08-19 16:05:37 +02:00
Raphaël Vinot 078c8ea836 Big cleanup, pep8 2014-08-14 18:07:18 +02:00
Jules 715adb4546 Merge pull request #14 from adulau/master 
Requirements updated for CC/ASN lookup in URL module
 2014-08-14 15:07:40 +02:00
Alexandre Dulaunoy 0d23a3952c Requirements updated for CC/ASN lookup in URL module 2014-08-14 14:56:33 +02:00
Jules ab6765315e Merge pull request #13 from adulau/master 
Log where URLs are hosted - cc_critical option added
 2014-08-14 14:28:01 +02:00
Alexandre Dulaunoy 762def3a23 Log where URLs are hosted - cc_critical option added 
It logs where the hostname of the URL is hosted (ASN and geographic location).
A simple option cc_critical added to set the country code to log as critical.
 2014-08-14 14:22:11 +02:00
Raphaël Vinot 4a1f300a1a Cleanup (remove unused imports, more pep8 compatible) 2014-08-14 14:11:07 +02:00
Starow 04a8f1bdf2 maxi cleanup old code :'( 2014-08-14 11:48:46 +02:00
Starow 7a3c216787 Adding a js library for the tag cloud (to install with update_thirdparty.sh 2014-08-14 10:04:39 +02:00
Starow 6cce9f7dac Javascript modif (Tagclouds) ... 2014-08-13 17:32:24 +02:00
Starow 29b24b6466 printing set of domain for debugging 2014-08-13 16:35:27 +02:00
Starow 663cc75369 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-13 16:33:14 +02:00
Raphaël Vinot ece3bc173e Cleanup of main Paste module 2014-08-13 11:56:22 +02:00
Raphaël Vinot 5b17d416c8 remove script installed by pubsublogger 2014-08-13 11:55:59 +02:00
Starow 0d25b960af logs display modifications 2014-08-13 10:59:47 +02:00
Raphaël Vinot 935e51c961 Remove 3rd party code (pubsublogger), add it in the deps. 2014-08-13 10:19:43 +02:00
Starow 37033ca3a6 Minor logs modifications 2014-08-13 10:08:44 +02:00
Starow 1df2ffd094 Splitting the graph in two one for words, one for paste monitoring 2014-08-12 16:44:35 +02:00
Starow 731141c723 Padding log hours + adding some super nice bootstrap icon :) 2014-08-12 16:11:11 +02:00
Starow 5a4218035a minor javascript update 2014-08-12 15:48:53 +02:00
Starow 6aa4d7cb7d Harmonising logs messages + Changing some dygraph options 2014-08-12 15:42:16 +02:00
Starow c3948867ad Adding an option to have better view of the curves 2014-08-12 14:51:03 +02:00
Starow 088574a048 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-12 14:01:58 +02:00
Starow 8d6c2f4288 Improving javascript and Fixing minor curves drawing bug 
Everything now is fully "dynamic"
 2014-08-12 14:00:00 +02:00
Jules 52ea36ee21 Merge pull request #12 from adulau/master 
Indexer script updated to dump documents and find similar documents
 2014-08-12 13:45:58 +02:00
Alexandre Dulaunoy 0b4a80b7ea -s option added to find similar documents 
By default, the index is not storing the vector of the document (Whoosh
document schema). It won't work if you don't change the schema of the
index for the content. It depends of your storage strategy.
 2014-08-12 13:42:26 +02:00
Alexandre Dulaunoy fd6e1a8436 -f option added: dump full document for each match 2014-08-12 13:26:56 +02:00
Alexandre Dulaunoy 6d196e5022 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-12 11:45:17 +02:00
Starow ef6bece82c Major javascript update: Queues curves are now being set dynamically. 
Now the javacript part is a little bit less disgusting than before.
 2014-08-12 11:41:56 +02:00
Alexandre Dulaunoy 7d396b5649 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-11 16:57:48 +02:00
Starow 60cfc9789f Adding logging proc time inside the table 2014-08-11 16:29:38 +02:00
Starow a4302b54ad Updating the screenshot 2014-08-11 15:54:48 +02:00
Starow e96be56b82 Checkbox default checked at true. 2014-08-11 15:30:44 +02:00
Alexandre Dulaunoy f28ad491e4 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-11 15:18:35 +02:00
Jules 802804ea6d Merge pull request #11 from adulau/master 
Indexer tool - statistics added
 2014-08-11 15:09:23 +02:00
Alexandre Dulaunoy e0ffdfdff5 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-11 15:09:03 +02:00
Starow f02cb10cac Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-08-11 15:08:16 +02:00
Starow 25cebf314c Index.html log table modification 2014-08-11 15:07:55 +02:00
Alexandre Dulaunoy 0a6664ffba Indexer: Some index statistics added 
usage: indexer_lookup.py [-h] [-q Q] [-n] [-t] [-l]

Fulltext search for AIL

optional arguments:
  -h, --help  show this help message and exit
  -q Q        query to lookup (one or more)
  -n          return number of indexed documents
  -t          dump top 500 terms
  -l          dump all terms encountered in indexed documents
 2014-08-11 15:07:12 +02:00
Starow 7cf05f959d Javascript modification dashboard log table 2014-08-11 15:06:38 +02:00
Alexandre Dulaunoy f65a94d47b -l added -> dumping all terms indexed 2014-08-11 14:56:15 +02:00
Alexandre Dulaunoy f3d1ca052e Return the number of indexed documents 2014-08-11 14:50:35 +02:00
Jules 12dd16daf9 Merge pull request #10 from adulau/master 
Whoosh requirements added for Indexer modules
 2014-08-11 14:27:43 +02:00
Alexandre Dulaunoy 611d2a466f Configuration that should not be there... 2014-08-11 14:24:27 +02:00
Alexandre Dulaunoy 38860db284 Whoosh requirements added 2014-08-11 14:13:36 +02:00
Alexandre Dulaunoy 72b232366b Whoosh added for the indexer modules 2014-08-11 14:13:09 +02:00
Alexandre Dulaunoy 2b8f2689bf Indexer queue and script added to "BBS-like" LAUNCH script 2014-08-11 14:06:52 +02:00