CIRCL
/
AIL-framework
mirror of https://github.com/CIRCL/AIL-framework
2
1
Fork 0
Code Issues Releases Wiki Activity
2,339 Commits
7 Branches
44 Tags
110 MiB
Commit Graph

29 Commits (dea270f91498f94893a1f56cf2f89ca8e040c797)

Author SHA1 Message Date
Terrtia 6f9e0c2f66
chg: [AIL queues] rewrite module queues. remove PUBSUB 2023-04-13 14:25:02 +02:00
Terrtia aac024565f
chg: [tags] refactor tags + cleanup 2022-11-22 10:47:15 +01:00
Terrtia 50f7a31820
chg: [Kvrocks migration] add users + updates + trackers + retro_hunts + investigation migration 2022-07-08 09:47:47 +02:00
Terrtia 9974823464
chg: [passiveDns D4 Client] add passiveDns D4 Client 2021-03-31 11:25:09 +02:00
Terrtia 056b6006f6
fix: [gitignore] 2021-02-10 15:27:31 +01:00
Terrtia 89e95ca030
fix: [redis cache] remove old paste_name db 2021-02-03 14:22:26 +01:00
Terrtia 712de0d88a
chg: [Update v2.4] cp config 2019-11-05 16:44:10 +01:00
Terrtia c8d5ce9a28
chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader 2019-11-05 15:18:03 +01:00
Terrtia 32efbfa019
fix: [doc] typo 2019-08-06 11:43:18 +02:00
Terrtia a9837c6e27
chg: [user_management 2.0] add update scripts + fix create_default_user 2019-06-20 14:47:59 +02:00
Terrtia 35c188829f
chg: [config update] refractor, auto update, create config if file doesnt exist 2019-04-23 15:04:45 +02:00
Terrtia b4bee29a33
Merge branch 'master' into advanced_crawler 2019-04-10 15:37:42 +02:00
Jason Hedden 23fb91d326 Add docker-compose support 
This commit separates the AIL Framework services into individual Docker
containers that can be managed with docker-compose. It's intended to ease the
installation, development and troubleshooting procedures for all-in-one
deployments.

No changes to architecture or base code are required in this commit.

Changes to existing files:
.gitignore
  * Ignore pystemon archive directory

Dockerfile:
  * Add AIL shell environment variables
  * Install pystemon and crawler pip requirements into AIL virtual environment

Docker-compose notes:
  * All containers are participating in a service network `network_mode:
  service:flask`.  This allows the containers to share the same IP namespace
  to accommodate hard-coded localhost entries.
  * By default persistent data is saved to the following directories in the
  local AIL framework git directory: PASTES, HASHS, CRAWLED_SCREENSHOTS,
  pystemon/archives

This was tested with docker-ce on Ubuntu 16.04 and MacOS. A typical deployment
would look like:
```
git clone https://github.com/CIRCL/AIL-framework.git
cd AIL-framework
cp bin/packages/config.cfg.docker-compose-sample bin/packages/config.cfg
	(optionally enable activate_crawler in config.cfg)
docker-compose build
docker-compose up -d
```
 2019-03-11 19:46:34 -05:00
Terrtia 3ae47a8659
chg: [gitignore] add update version 2018-11-15 10:43:19 +01:00
Terrtia e4a5f66a10
Merge branch 'master' into onion_crawler 2018-09-24 16:35:04 +02:00
Terrtia 204e996fc3
chg: [statistics] clean scripts 2018-09-12 11:21:11 +02:00
Terrtia 6f0817365a
chg: [Crawler UI] display domain information 2018-09-12 09:55:49 +02:00
Terrtia ed559d9f4a
chg: [Showpaste] add screenshot + improve onion db 2018-08-16 17:24:39 +02:00
Terrtia 39f54d4420
chg: [Mail] add country statistic 2018-07-30 09:21:22 +02:00
Terrtia 0ee36e484f
fix hive connection + submitted dir creation 2018-06-19 11:31:30 +02:00
Terrtia c41a56e4a2
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00
= 409eb25a64 Deleted data-flow graph and header.html from the index + Added fixed typo where 10min was in fact 3min 2017-08-21 10:51:56 +02:00
Mokaddem e75d6afdd9 Added all_modules.txt rule in gitignore 2017-04-25 08:34:21 +02:00
Mokaddem 8ca5009e76 Added new file in gitignore 2016-08-10 09:42:15 +02:00
Mokaddem 3345124219 Added pannel in search modal + small fix related to config 2016-07-06 14:48:27 +02:00
Blackbern 1aa7698420 ajout d'un script d'installation pour archlinux via pacman et yaourt. 2016-02-05 13:14:52 +01:00
Raphaël Vinot 4f2575723a Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00
Raphaël Vinot 45b0bf3983 Improve the cleanup. Still some to do. 2014-08-19 19:07:07 +02:00
Raphaël Vinot f1753d67c6 Cleanup the queues. 2014-08-19 16:05:37 +02:00