CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,848 Commits
7 Branches
43 Tags
110 MiB
Commit Graph

2848 Commits (1b0a2b46ca39aeb804f45164c5c8e2634d9eba6b)

Author SHA1 Message Date
Raphaël Vinot 8803c8447a Publish the fetched onions on a ZMQ feed. 2014-09-30 16:55:16 +02:00
Alexandre Dulaunoy 3c6b03b3fa Update README.md 2014-09-22 13:36:13 +02:00
Alexandre Dulaunoy 8c64f41392 Update README.md 2014-09-22 13:35:46 +02:00
Alexandre Dulaunoy 2dff1c5a15 Merge pull request #30 from adulau/master 
A simple feeder script feeding data from pystemon to AIL.
 2014-09-19 14:06:42 +02:00
Alexandre Dulaunoy 25757b0fff A simple feeder script feeding data from pystemon to AIL. 
The configuration matches the default Redis parameters used
in the pystemon configuration.

https://github.com/cvandeplas/pystemon/blob/master/pystemon.yaml#L16
 2014-09-19 14:03:05 +02:00
Sascha Rommelfangen b0db0e7f74 Spelling/language corrections 2014-09-18 13:28:25 +02:00
Alexandre Dulaunoy f15caa70f5 ultag removed 2014-09-17 17:24:08 +02:00
Alexandre Dulaunoy b36cf76889 Removed ultag 2014-09-17 17:24:08 +02:00
Raphaël Vinot 65b9a01644 Add config file for DomainClassifier, proper reporting 2014-09-17 17:22:56 +02:00
Alexandre Dulaunoy f5a7b3be96 Merge pull request #29 from adulau/master 
Old tag cloud removed
 2014-09-10 16:45:58 +02:00
Alexandre Dulaunoy b331ff6492 ultag removed 2014-09-10 16:40:38 +02:00
Alexandre Dulaunoy dfba5900db Removed ultag 2014-09-10 16:38:58 +02:00
Alexandre Dulaunoy 119213a265 Merge pull request #27 from adulau/master 
Add proper publisher for classified domains/hostnames
 2014-09-10 09:40:50 +02:00
Alexandre Dulaunoy f8de847985 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-09-10 09:28:20 +02:00
Alexandre Dulaunoy 27b134ec03 Add proper publisher for classified domains/hostnames 2014-09-10 09:27:47 +02:00
Raphaël Vinot f017680365 fix onions, cc and domain classifier modules 2014-09-08 16:51:43 +02:00
Alexandre Dulaunoy f229e2fbee Merge pull request #26 from adulau/master 
DomainClassifier module added
 2014-09-08 16:49:58 +02:00
Alexandre Dulaunoy de6e21d5a7 DomainClassifier sample configuration added 2014-09-08 16:44:05 +02:00
Alexandre Dulaunoy 246621f663 First version of the DomainClassifier 2014-09-08 16:43:21 +02:00
Alexandre Dulaunoy 3055b0deae DomainClassifier requirements added 2014-09-08 11:52:34 +02:00
Alexandre Dulaunoy 8c86c3b731 Merge branch 'master' of https://github.com/CIRCL/AIL-framework 2014-09-08 11:51:05 +02:00
Alexandre Dulaunoy 1397db9691 Global queue for DomainClassifier 2014-09-08 11:07:45 +02:00
Raphaël Vinot e983c839ad Categ now listen to the Global queue 2014-09-05 17:05:45 +02:00
Raphaël Vinot 46f27ada4e More cleanup 2014-09-05 10:42:01 +02:00
Raphaël Vinot fca00beed9 Add Domain Classifier module. 
Cleanup in the config files.
 2014-09-05 10:41:00 +02:00
Raphaël Vinot b7c9e489c9 Fix the exceptions 2014-09-04 11:46:07 +02:00
Raphaël Vinot 9e8611a42d stop killing the disk when creating the word curve 2014-09-02 18:20:28 +02:00
Raphaël Vinot 7542eaf739 Update starting script. 2014-09-02 15:21:36 +02:00
Raphaël Vinot 0c6b09f379 Fix the onion module, log the valid onions. 2014-09-01 16:18:06 +02:00
Raphaël Vinot f4b89669fc The onion module now fetches the URLs it finds. 2014-08-31 22:42:12 +02:00
Raphaël Vinot abfe13436b Big refactoring, make the queues more flexible 2014-08-29 19:37:56 +02:00
Raphaël Vinot 623e876f3b Cleanup. 
* Remove useless subscriber
* Fix typo in the config file
* Update Helper accordingly
 2014-08-26 17:36:57 +02:00
Raphaël Vinot d7a7da4814 Make sure the webserver fails properly if there is no config file. 
Create the queue list in a more pythonesque fashion.
 2014-08-26 17:33:28 +02:00
Alexandre Dulaunoy 910e0be9be Merge pull request #23 from adulau/master 
ZMQ Publisher removed
 2014-08-26 16:12:44 +02:00
Alexandre Dulaunoy 3b499a2ec8 ZMQ Publisher removed 
ZMQ Publisher removed to allow concurrent use of the scripts.
In short term, we would replace all publishing part within AIL
into pub-sub Redis to avoid ZMQ limitation.
 2014-08-26 14:38:49 +02:00
Alexandre Dulaunoy 264da48768 Merge pull request #22 from adulau/master 
Cleanup: removed unused parameter
 2014-08-26 09:29:21 +02:00
Alexandre Dulaunoy 1567e452f5 Cleanup: removed unused parameter 2014-08-26 09:25:28 +02:00
Starow 55999d3058 Readme updated 2014-08-25 15:02:53 +02:00
Starow 80bf7a4762 Add missing dependencies 2014-08-25 14:44:40 +02:00
Raphaël Vinot b5bf4583e3 automatically copy the config file if there is no. 2014-08-25 14:12:06 +02:00
Jules 93006243c9 Merge pull request #21 from adulau/master 
cymruwhois uses dotted decimal format
 2014-08-25 10:09:00 +02:00
Alexandre Dulaunoy f070ac2005 cymruwhois uses dotted decimal format 2014-08-25 10:05:36 +02:00
Jules 87a57e1f05 Merge pull request #20 from CIRCL/testing 
Big refactoring, make the workflow much easyer to follow.
 2014-08-22 18:36:15 +02:00
Raphaël Vinot 7934c7c8f3 Update deps and install script to work out of the box. 2014-08-22 17:39:58 +02:00
Raphaël Vinot de207e4bb3 Disable the sockets and the pid files from the redis config files. 2014-08-22 17:39:13 +02:00
Raphaël Vinot 3886d1b834 Small fixes to make the refactoring production ready 
* the port for the logging is 6380
* use os.environ properly
* fix typos
 2014-08-22 17:35:40 +02:00
Raphaël Vinot 4f2575723a Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00
Raphaël Vinot 78125db4ea Use env variables everywhere 2014-08-22 14:52:02 +02:00
Raphaël Vinot 277d138a5d cleanup, add FIXME 2014-08-21 14:39:17 +02:00
Raphaël Vinot 63b29176c1 move Redis_Data_Merging to Paste 2014-08-21 12:22:07 +02:00