AIL-framework/.gitignore

# Temp files
*.swp
*.pyc
*.swo
.idea
.coverage

# Install Dirs
AILENV
redis
ardb
kvrocks
DATA_KVROCKS
faup
tlsh
Blooms
PASTES
CRAWLED_SCREENSHOT
IMAGES
FAVICONS
BASE64
HASHS
DATA_ARDB
indexdir/
logs/
old/
pgpdump/
temp/


DEFAULT_PASSWORD

# Webstuff
var/www/static/
!var/www/static/css/dygraph_gallery.css
!var/www/static/js/indexjavascript.js
!var/www/static/js/moduleTrending.js
!var/www/static/js/plot-graph.js
!var/www/static/js/trendingchart.js
var/www/templates/header.html
var/www/submitted
var/www/server.crt
var/www/server.key

# Local config
configs/keys
configs/core.cfg
configs/core.cfg.backup
configs/update.cfg
update/current_version
files
configs/d4client_passiveDNS_conf/uuid

# Trackers
bin/trackers/yara/custom-rules/*

# Helper
tools/gen_cert/rootCA.*
tools/gen_cert/server.*


# Pystemon archives
pystemon/archives

# installed files
nltk_data/
doc/all_modules.txt
# auto generated
doc/module-data-flow.png
doc/data-flow.png
doc/ail_queues.dot
doc/ail_queues.svg
doc/statistics
Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00			`# Temp files`
Cleanup the queues. 2014-08-18 18:35:08 +02:00			`*.swp`
Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00			`*.pyc`
Added pannel in search modal + small fix related to config 2016-07-06 14:48:27 +02:00			`*.swo`
chg: [tags] refactor tags + cleanup 2022-11-22 10:47:15 +01:00			`.idea`
fix: [tests] fix tests 2023-05-23 13:38:33 +02:00			`.coverage`
Cleanup the queues. 2014-08-18 18:35:08 +02:00
			`# Install Dirs`
			`AILENV`
			`redis`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`ardb`
chg: [Kvrocks migration] add users + updates + trackers + retro_hunts + investigation migration 2022-07-08 09:47:47 +02:00			`kvrocks`
			`DATA_KVROCKS`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`faup`
			`tlsh`
Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00			`Blooms`
			`PASTES`
chg: [Crawler UI] display domain information 2018-09-12 09:55:49 +02:00			`CRAWLED_SCREENSHOT`
chg: [chats] add image object + show message image 2023-11-15 14:12:50 +01:00			`IMAGES`
chg: [git] update gitignore 2024-02-26 15:41:46 +01:00			`FAVICONS`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`BASE64`
chg: [Crawler UI] display domain information 2018-09-12 09:55:49 +02:00			`HASHS`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`DATA_ARDB`
			`indexdir/`
Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00			`logs/`
fix hive connection + submitted dir creation 2018-06-19 11:31:30 +02:00			`old/`
fix: [gitignore] 2021-02-10 15:27:31 +01:00			`pgpdump/`
			`temp/`

Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00
chg: [user_management 2.0] add update scripts + fix create_default_user 2019-06-20 14:47:59 +02:00			`DEFAULT_PASSWORD`

Update gitignore to have a clean dev directory 2014-08-22 17:34:13 +02:00			`# Webstuff`
			`var/www/static/`
			`!var/www/static/css/dygraph_gallery.css`
			`!var/www/static/js/indexjavascript.js`
Added new file in gitignore 2016-08-10 09:42:15 +02:00			`!var/www/static/js/moduleTrending.js`
			`!var/www/static/js/plot-graph.js`
			`!var/www/static/js/trendingchart.js`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`var/www/templates/header.html`
fix hive connection + submitted dir creation 2018-06-19 11:31:30 +02:00			`var/www/submitted`
fix: [doc] typo 2019-08-06 11:43:18 +02:00			`var/www/server.crt`
			`var/www/server.key`
Improve the cleanup. Still some to do. 2014-08-19 19:07:07 +02:00
			`# Local config`
fix hive connection + submitted dir creation 2018-06-19 11:31:30 +02:00			`configs/keys`
chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader 2019-11-05 15:18:03 +01:00			`configs/core.cfg`
			`configs/core.cfg.backup`
chg: [config update] refractor, auto update, create config if file doesnt exist 2019-04-23 15:04:45 +02:00			`configs/update.cfg`
chg: [gitignore] add update version 2018-11-15 10:43:19 +01:00			`update/current_version`
chg: [Showpaste] add screenshot + improve onion db 2018-08-16 17:24:39 +02:00			`files`
chg: [passiveDns D4 Client] add passiveDns D4 Client 2021-03-31 11:25:09 +02:00			`configs/d4client_passiveDNS_conf/uuid`
ajout d'un script d'installation pour archlinux via pacman et yaourt. 2016-02-05 13:14:52 +01:00
fix: [redis cache] remove old paste_name db 2021-02-03 14:22:26 +01:00			`# Trackers`
			`bin/trackers/yara/custom-rules/*`

fix: [doc] typo 2019-08-06 11:43:18 +02:00			`# Helper`
chg: [ail] cleanup 2023-05-17 10:26:54 +02:00			`tools/gen_cert/rootCA.*`
			`tools/gen_cert/server.*`
fix: [doc] typo 2019-08-06 11:43:18 +02:00

Add docker-compose support This commit separates the AIL Framework services into individual Docker containers that can be managed with docker-compose. It's intended to ease the installation, development and troubleshooting procedures for all-in-one deployments. No changes to architecture or base code are required in this commit. Changes to existing files: .gitignore * Ignore pystemon archive directory Dockerfile: * Add AIL shell environment variables * Install pystemon and crawler pip requirements into AIL virtual environment Docker-compose notes: * All containers are participating in a service network `network_mode: service:flask`. This allows the containers to share the same IP namespace to accommodate hard-coded localhost entries. * By default persistent data is saved to the following directories in the local AIL framework git directory: PASTES, HASHS, CRAWLED_SCREENSHOTS, pystemon/archives This was tested with docker-ce on Ubuntu 16.04 and MacOS. A typical deployment would look like: ``` git clone https://github.com/CIRCL/AIL-framework.git cd AIL-framework cp bin/packages/config.cfg.docker-compose-sample bin/packages/config.cfg (optionally enable activate_crawler in config.cfg) docker-compose build docker-compose up -d ``` 2019-03-11 23:04:02 +01:00			`# Pystemon archives`
			`pystemon/archives`

ajout d'un script d'installation pour archlinux via pacman et yaourt. 2016-02-05 13:14:52 +01:00			`# installed files`
			`nltk_data/`
Added all_modules.txt rule in gitignore 2017-04-25 08:34:21 +02:00			`doc/all_modules.txt`
clean Flask_tags + gitignore 2018-06-01 13:36:08 +02:00			`# auto generated`
			`doc/module-data-flow.png`
			`doc/data-flow.png`
chg: [AIL queues] rewrite module queues. remove PUBSUB 2023-04-13 14:25:02 +02:00			`doc/ail_queues.dot`
			`doc/ail_queues.svg`
chg: [statistics] clean scripts 2018-09-12 11:21:11 +02:00			`doc/statistics`