Commit Graph

1202 Commits (be46572adf00ad57b346e77bfabbee6cf3b95cb7)

Author SHA1 Message Date
Jakub Onderka be46572adf
Merge pull request #8731 from JakubOnderka/debug-failing
fix: [test] Debug failing test
2022-11-01 15:04:14 +01:00
Jakub Onderka a44f801f17 fix: [test] Debug failing test 2022-11-01 14:05:10 +01:00
Jakub Onderka 7a29e18d23 chg: [sync] New way how to pull sightings 2022-11-01 10:56:14 +01:00
Jakub Onderka 5ea72e1924 fix: [sync] Do not try to push no clusters to remote server 2022-10-31 15:08:18 +01:00
Jakub Onderka 772c789c76 chg: [internal] Add logging for galaxy cluster sync 2022-10-31 14:34:56 +01:00
Jakub Onderka 645b11e1b1 new: [redis] Store some data in Redis compressed to save memory 2022-10-30 16:19:58 +01:00
Jakub Onderka 446cf12799 chg: [internal] Cleanup code for JSON decoding 2022-10-23 13:17:39 +02:00
Jakub Onderka 1ab9c41981 chg: [internal] Use JsonTool more often vol. 2 2022-10-19 14:36:55 +02:00
Jakub Onderka b4bcbfe103 chg: [internal] Use JsonTool more often 2022-10-19 10:11:37 +02:00
Jakub Onderka 21857cbfd1 new: [internal] Add support for simdjson extension 2022-10-18 18:39:08 +02:00
Jakub Onderka fd37e54f76
Merge pull request #8663 from JakubOnderka/fix-delete-wlc
fix: [redis] Delete also misp:wlc:* keys
2022-10-12 17:53:08 +02:00
Jakub Onderka 5621d863b2 fix: [redis] Delete also misp:wlc:* keys 2022-10-12 17:31:48 +02:00
Jakub Onderka 72c05c314d fix: [jobs] Correctly handle incorrectly configured simple background jobs 2022-10-11 09:30:54 +02:00
Jakub Onderka a024a6f61e chg: [jobs] Store job data in Redis when SimpleBackgroundJobs are enabled
Will help to solve #8616
2022-10-10 19:31:24 +02:00
Jakub Onderka 79e2ffa6a7 fix: [redis] Delete all keys by pattern 2022-10-09 09:38:21 +02:00
Jakub Onderka c40feb1897 chg: [redis] Use redis serializer for storing dashboard cache 2022-10-08 13:09:35 +02:00
Jakub Onderka 72d9243b84 new: [redis] Add support for dragonfly redis replacement 2022-10-08 12:13:54 +02:00
Jakub Onderka 82698a5fa0
Merge pull request #8518 from JakubOnderka/disable-key-fetching
new: [UI] Allow to disable PGP key fetching
2022-10-06 17:23:41 +02:00
Jakub Onderka 341ac2d0a8 chg: [internal] New method RedisTool::unlink 2022-10-01 09:48:13 +02:00
Jakub Onderka 1a4500a5a5 chg: [internal] Optimise deleting keys from Redis 2022-09-30 21:04:27 +02:00
iglocska 1bbbafddd2
Merge branch '2.4' into develop 2022-09-26 13:10:04 +02:00
szopin 760d2ee048
Redact sensitive settings
Proxy password, ZeroMQ password and ZeroMQ redis password were not redacted as all other password fields
2022-09-21 13:53:56 +02:00
Jakub Onderka 172e724515 fix: [internal] Flush just necessary data 2022-09-11 10:59:14 +02:00
Jakub Onderka 877dded06a fix: [internal] Use Redis serializer to more places 2022-09-11 10:59:14 +02:00
Jakub Onderka 17981be04d new: [internal] RedisTool 2022-09-11 10:59:14 +02:00
Jakub Onderka 36addef808 new: [sync] Event index cache 2022-09-11 10:59:14 +02:00
Jakub Onderka 47c716e207 chg: [internal] Order columns by name when generating db_schema.json 2022-08-11 12:58:54 +02:00
iglocska c764bb0e8f
Merge branch 'log_last_api' into develop 2022-08-11 09:36:30 +02:00
Sami Mokaddem 0e2648d481
chg: [menus] Added `new` badge for over-correlating values 2022-08-04 13:33:00 +02:00
Sami Mokaddem 49575533ad
Merge remote-tracking branch 'origin/develop' into feature-workflows-2 2022-08-04 10:08:56 +02:00
iglocska a04f3964e7
new: [correlation rework] round 2
- long list of fixes
- update scripts
- correlation engine management interface
- recorrelation/truncation tools
- various performance tunings and bug fixes
2022-08-03 15:44:27 +02:00
Sami Mokaddem 44b2a1c3cd
new: [workflow:debugging] Added debugging capability by POSTing workflow exec to an URL 2022-08-03 11:45:17 +02:00
Tom King de351faaac new: [internal] Add option to log last API request 2022-08-01 15:02:49 +01:00
Sami Mokaddem 151d23a8c2
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-08-01 09:59:44 +02:00
iglocska 3ce754d595
Merge branch 'develop' into new_correlations 2022-07-31 23:58:40 +02:00
iglocska 3a4289d631
new: [correlation] engine rewrite
- allow for multiple concurrent engines
  - default: similar behaviour as before, ACL enforced
  - No ACL: for endpoint misps, disable the enforcement of ACL for correlations altogether

- rework:
  - correlation entries are fully indexed reference tables
  - values are now stored separately
  - built in protection against overcorrelating values (defaults to 20 max)
  - 1 way correlations to cut the size in half
  - unsigned IDs to double the ID space
  - loads of performance improvements
  - fix to the broken event index with correlation counts enabled

- UI improvements
  - search for values from the correlation column directly (in case there are non-correlating versions of the same value)
  - added correlations to the attribute search/index

- TODO:
  - upgrade scripts
2022-07-31 23:48:38 +02:00
Jakub Onderka 62926da1a3 new: [UI] Allow to disable PGP key fetching 2022-07-29 18:06:45 +02:00
Sami Mokaddem e9dc2f4e92
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:45:45 +02:00
Luciano Righetti f26f50c8d3
fix: handle casing diff in db response 2022-07-26 11:43:58 +02:00
Sami Mokaddem 6020aeba7a
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:32:31 +02:00
Luciano Righetti 13460b3a7b
fix: use session variables instead of global_variables table as its not available in some installations 2022-07-26 11:31:08 +02:00
Sami Mokaddem b8a9bedcbc
fix: [workflows] Clean up and removed unused code 2022-07-25 13:41:13 +02:00
Sami Mokaddem ed59e09161
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-21 13:21:14 +02:00
Luciano Righetti b4fb6251ce
new: mysql db tuning recommendations in server diagnostics 2022-07-19 13:36:53 +02:00
Bradley Logan 1838672306
fix: [diag] Correctly set DB session errorCode 2022-07-18 01:17:04 -07:00
Sami Mokaddem 74ff67d564
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-12 14:14:47 +02:00
Sami Mokaddem 59221576e5
new: [taxonomy:normalizeCustomTags] Normalize custome tags to their taxonomy format
New feature accessible on the administrator on-demand action page
2022-07-12 14:13:30 +02:00
Jakub Onderka 26cc86fde2
Merge pull request #8205 from JakubOnderka/pull-optim
Pull optim
2022-07-09 09:01:54 +02:00
Jakub Onderka 9e75c909e2 fix: [internal] Properly handle zmq exception 2022-07-06 17:20:07 +02:00
Sami Mokaddem 8e746960a1
chg: [workflow] Improved integration with settings + added global setting to enable/disable workflow feature 2022-06-24 12:45:20 +02:00