mirror of https://github.com/MISP/misp-book
add: SimpleBackgroundJobs migration guide appendix
Luciano Righetti
parent
269314b978
commit
ba7ce174ec
|
|
@ -665,4 +665,160 @@ Because LDAP and MISP users are paired by e-mail address, it is possible to migr
|
||||||
* When a user is disabled in LDAP and also in MISP and then enabled in LDAP, it will be enabled in MISP for next login just when `updateUser` is set to `true`.
|
* When a user is disabled in LDAP and also in MISP and then enabled in LDAP, it will be enabled in MISP for next login just when `updateUser` is set to `true`.
|
||||||
* Currently it is not possible to log in with both LDAP and local (MISP) accounts.
|
* Currently it is not possible to log in with both LDAP and local (MISP) accounts.
|
||||||
* Admins can change users email address. But when `updateUser` is set to true, when the user will log in again, the e-mail address will be updated from LDAP.
|
* Admins can change users email address. But when `updateUser` is set to true, when the user will log in again, the e-mail address will be updated from LDAP.
|
||||||
* `Security.require_password_confirmation` setting currently does not work with LDAP authentication. But on the other hand, since user cannot change e-mail address and password, this setting is not important.
|
* `Security.require_password_confirmation` setting currently does not work with LDAP authentication. But on the other hand, since user cannot change e-mail address and password, this setting is not important.
|
||||||
|
|
||||||
|
# Appendix G: SimpleBackgroundJobs Migration guide
|
||||||
|
As of **MISP** version `2.4.151` we introduced a simpler way to handle background jobs without relying in CakeResque as this library is no longer mantained.
|
||||||
|
|
||||||
|
For the time being both background jobs backends will be supported, but we plan to phase out the CakeResque one in a near future.
|
||||||
|
|
||||||
|
The new backend requires [Supervisor](http://supervisord.org/) and some extra PHP packages.
|
||||||
|
|
||||||
|
**This guide is intended for Ubuntu/Debian systems**
|
||||||
|
|
||||||
|
## Install requirements
|
||||||
|
Run on your MISP instance the following commands.
|
||||||
|
|
||||||
|
1. Install **Supervisord**:
|
||||||
|
```
|
||||||
|
sudo apt install supervisor -y
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
2. Install required PHP packages:
|
||||||
|
```
|
||||||
|
cd /var/www/MISP/app
|
||||||
|
sudo -u www-data composer require supervisorphp/supervisor:^4.0 \
|
||||||
|
guzzlehttp/guzzle \
|
||||||
|
php-http/message \
|
||||||
|
lstrojny/fxmlrpc
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
3. Add the following settings at the bottom of the **Supervisord** conf file, usually located in:
|
||||||
|
|
||||||
|
`/etc/supervisor/supervisord.conf`
|
||||||
|
```
|
||||||
|
[inet_http_server]
|
||||||
|
port=127.0.0.1:9001
|
||||||
|
username=supervisor
|
||||||
|
password=PWD_CHANGE_ME
|
||||||
|
```
|
||||||
|
|
||||||
|
4. Use the following configuration as a template for the services, usually located in:
|
||||||
|
|
||||||
|
`/etc/supervisor/conf.d/misp-workers.conf`
|
||||||
|
```
|
||||||
|
[group:misp-workers]
|
||||||
|
programs=default,email,cache,prio,update
|
||||||
|
|
||||||
|
[program:default]
|
||||||
|
directory=/var/www/MISP
|
||||||
|
command=/var/www/MISP/app/Console/cake start_worker default
|
||||||
|
process_name=%(program_name)s_%(process_num)02d
|
||||||
|
numprocs=5
|
||||||
|
autostart=true
|
||||||
|
autorestart=true
|
||||||
|
redirect_stderr=false
|
||||||
|
stderr_logfile=/var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
stdout_logfile=/var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
directory=/var/www/MISP
|
||||||
|
user=www-data
|
||||||
|
|
||||||
|
[program:prio]
|
||||||
|
directory=/var/www/MISP
|
||||||
|
command=/var/www/MISP/app/Console/cake start_worker prio
|
||||||
|
process_name=%(program_name)s_%(process_num)02d
|
||||||
|
numprocs=5
|
||||||
|
autostart=true
|
||||||
|
autorestart=true
|
||||||
|
redirect_stderr=false
|
||||||
|
stderr_logfile=/var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
stdout_logfile=/var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
directory=/var/www/MISP
|
||||||
|
user=www-data
|
||||||
|
|
||||||
|
[program:email]
|
||||||
|
directory=/var/www/MISP
|
||||||
|
command=/var/www/MISP/app/Console/cake start_worker email
|
||||||
|
process_name=%(program_name)s_%(process_num)02d
|
||||||
|
numprocs=5
|
||||||
|
autostart=true
|
||||||
|
autorestart=true
|
||||||
|
redirect_stderr=false
|
||||||
|
stderr_logfile=/var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
stdout_logfile=/var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
directory=/var/www/MISP
|
||||||
|
user=www-data
|
||||||
|
|
||||||
|
[program:update]
|
||||||
|
directory=/var/www/MISP
|
||||||
|
command=/var/www/MISP/app/Console/cake start_worker update
|
||||||
|
process_name=%(program_name)s_%(process_num)02d
|
||||||
|
numprocs=1
|
||||||
|
autostart=true
|
||||||
|
autorestart=true
|
||||||
|
redirect_stderr=false
|
||||||
|
stderr_logfile=/var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
stdout_logfile=/var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
directory=/var/www/MISP
|
||||||
|
user=www-data
|
||||||
|
|
||||||
|
[program:cache]
|
||||||
|
directory=/var/www/MISP
|
||||||
|
command=/var/www/MISP/app/Console/cake start_worker cache
|
||||||
|
process_name=%(program_name)s_%(process_num)02d
|
||||||
|
numprocs=5
|
||||||
|
autostart=true
|
||||||
|
autorestart=true
|
||||||
|
redirect_stderr=false
|
||||||
|
stderr_logfile=/var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
stdout_logfile=/var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
user=www-data
|
||||||
|
```
|
||||||
|
|
||||||
|
5. Restart **Supervisord** to load the changes:
|
||||||
|
```
|
||||||
|
sudo service supervisor restart
|
||||||
|
```
|
||||||
|
|
||||||
|
6. Check **Supervisord** workers are running:
|
||||||
|
```
|
||||||
|
$ sudo supervisorctl status
|
||||||
|
misp-workers:cache_00 RUNNING pid 1673228, uptime 1:37:54
|
||||||
|
misp-workers:cache_01 RUNNING pid 1673225, uptime 1:37:54
|
||||||
|
misp-workers:cache_02 RUNNING pid 1673375, uptime 1:37:53
|
||||||
|
misp-workers:cache_03 RUNNING pid 1673398, uptime 1:37:52
|
||||||
|
misp-workers:cache_04 RUNNING pid 1673303, uptime 1:37:53
|
||||||
|
misp-workers:default_00 RUNNING pid 1673222, uptime 1:37:54
|
||||||
|
misp-workers:default_01 RUNNING pid 1673385, uptime 1:37:52
|
||||||
|
misp-workers:default_02 RUNNING pid 1673391, uptime 1:37:52
|
||||||
|
misp-workers:default_03 RUNNING pid 1673223, uptime 1:37:54
|
||||||
|
misp-workers:default_04 RUNNING pid 1673393, uptime 1:37:52
|
||||||
|
misp-workers:email_00 RUNNING pid 1673394, uptime 1:37:52
|
||||||
|
misp-workers:email_01 RUNNING pid 1673312, uptime 1:37:53
|
||||||
|
misp-workers:email_02 RUNNING pid 1673224, uptime 1:37:54
|
||||||
|
misp-workers:email_03 RUNNING pid 1673227, uptime 1:37:54
|
||||||
|
misp-workers:email_04 RUNNING pid 1673333, uptime 1:37:53
|
||||||
|
misp-workers:prio_00 RUNNING pid 1673279, uptime 1:37:54
|
||||||
|
misp-workers:prio_01 RUNNING pid 1673304, uptime 1:37:53
|
||||||
|
misp-workers:prio_02 RUNNING pid 1673305, uptime 1:37:53
|
||||||
|
misp-workers:prio_03 RUNNING pid 1673232, uptime 1:37:54
|
||||||
|
misp-workers:prio_04 RUNNING pid 1673319, uptime 1:37:53
|
||||||
|
misp-workers:update_00 RUNNING pid 1673327, uptime 1:37:53
|
||||||
|
```
|
||||||
|
|
||||||
|
## MISP Config
|
||||||
|
1. Go to your **MISP** instances `Server Settings & Maintenance` page, and then to the new [SimpleBackgroundJobs]((https://localhost/servers/serverSettings/SimpleBackgroundJobs)) tab.
|
||||||
|
|
||||||
|
2. Update the `SimpleBackgroundJobs.supervisor_password` with the password you set in the _Install requirements_ section 3.
|
||||||
|
|
||||||
|
3. Verify Redis and other settings are correct and then set `SimpleBackgroundJobs.enabled` to `true`.
|
||||||
|
|
||||||
|
4. Use **MISP** normally and visit [Administration -> Jobs](/jobs/index) to check Jobs are running correctly.
|
||||||
|
If there are any issues check the logs:
|
||||||
|
* /var/www/MISP/app/tmp/logs/misp-workers-errors.log
|
||||||
|
* /var/www/MISP/app/tmp/logs/misp-workers.log
|
||||||
|
|
||||||
|
### Notes
|
||||||
|
Scheduled tasks (TasksController) are not supported with the new backend, however this feature is going to be deprecated, it is recommended to use cron jobs instead.
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue