AIL-framework/HOWTO.md

73 lines
2.6 KiB
Markdown
Raw Normal View History

# Feeding, Adding new features and Contributing
2017-05-03 14:25:58 +02:00
## [AIL Importers](./doc/README.md#ail-importers)
2017-05-03 14:25:58 +02:00
Refer to the [AIL Importers Documentation](./doc/README.md#ail-importers)
2017-05-03 14:25:58 +02:00
## Feeding Data to AIL
2017-05-03 14:42:37 +02:00
2017-05-03 14:25:58 +02:00
AIL is an analysis tool, not a collector!
2017-05-09 16:35:43 +02:00
However, if you want to collect some pastes and feed them to AIL, the procedure is described below. Nevertheless, moderate your queries!
2017-05-03 14:25:58 +02:00
1. [AIL Importers](./doc/README.md#ail-importers)
2. ZMQ: Be a collaborator of CIRCL and ask to access our feed. It will be sent to the static IP you are using for AIL.
2017-05-03 14:25:58 +02:00
2023-05-30 14:48:06 +02:00
## How to create a new module
2017-05-03 14:25:58 +02:00
2023-05-30 14:48:06 +02:00
To add a new processing or analysis module to AIL, follow these steps:
2017-05-03 14:25:58 +02:00
2023-05-30 14:48:06 +02:00
1. Add your module name in [./configs/modules.cfg](./configs/modules.cfg) and subscribe to at least one module at minimum (Usually, `Item`).
2. Use [./bin/modules/modules/TemplateModule.py](./bin/modules/modules/TemplateModule.py) as a sample module and create a new file in bin/modules with the module name used in the `modules.cfg` configuration.
2017-05-03 14:25:58 +02:00
## Contributions
2017-05-03 14:25:58 +02:00
Contributions are welcome! Fork the repository, experiment with the code, and submit your modules or patches through a pull request.
2017-05-03 14:25:58 +02:00
## Crawler
2017-05-09 16:35:43 +02:00
AIL supports crawling of websites and Tor hidden services. Ensure your Tor client's proxy configuration is correct, especially the SOCKS5 proxy settings.
### Installation
2018-09-27 11:14:29 +02:00
[Install Lacus](https://github.com/ail-project/lacus)
2018-09-28 11:32:08 +02:00
### Configuration
2018-09-28 11:32:08 +02:00
1. Lacus URL:
2023-05-30 14:48:06 +02:00
In the web interface, go to `Crawlers` > `Settings` and click on the Edit button
2023-05-17 16:07:32 +02:00
![AIL Crawler Config](./doc/screenshots/lacus_config.png?raw=true "AIL Lacus Config")
![AIL Crawler Config Edis](./doc/screenshots/lacus_config_edit.png?raw=true "AIL Lacus Config")
2. Number of Crawlers:
Choose the number of crawlers you want to launch
![Crawler Manager Nb Crawlers Config](./doc/screenshots/crawler_nb_captures.png?raw=true "AIL Lacus Nb Crawlers Config")
![Crawler Manager Nb Crawlers Config](./doc/screenshots/crawler_nb_captures_edit.png?raw=true "AIL Lacus Nb Crawlers Config")
## Chats Translation with LibreTranslate
Chats message can be translated using [libretranslate](https://github.com/LibreTranslate/LibreTranslate), an open-source self-hosted machine translation.
### Installation:
1. Install LibreTranslate by running the following command:
```bash
pip install libretranslate
```
2. Run libretranslate:
```bash
libretranslate
```
### Configuration:
To enable LibreTranslate for chat translation, edit the LibreTranslate URL in the [./configs/core.cfg](./configs/core.cfg) file under the [Translation] section.
```
[Translation]
libretranslate = http://127.0.0.1:5000
```