Commit Graph

1208 Commits (56c5b9c40976f9ff41e8b3c478f328c2dec0e490)

Author SHA1 Message Date
iglocska 56c5b9c409
Merge branch '2.4' into develop 2022-11-09 15:08:02 +01:00
CriimBow 0f6ffb8270 does not exists => does not exist 2022-11-08 16:13:14 +01:00
iglocska 0f0fd60d56
new: [CLI] added pretty and json output modes to list and view feeds 2022-11-04 15:28:57 +01:00
iglocska 10f9f2c954
chg: [CLI] new functions documented on the automation page 2022-11-04 15:15:35 +01:00
Jakub Onderka d9f4050cbd fix: [sync] Do not push galaxy cluster to events that should not be pushed 2022-11-03 09:37:55 +01:00
Jakub Onderka 33eaf49b0c chg: [sync] Remove empty events from pull 2022-11-01 15:12:17 +01:00
Jakub Onderka be46572adf
Merge pull request #8731 from JakubOnderka/debug-failing
fix: [test] Debug failing test
2022-11-01 15:04:14 +01:00
Jakub Onderka a44f801f17 fix: [test] Debug failing test 2022-11-01 14:05:10 +01:00
Jakub Onderka 7a29e18d23 chg: [sync] New way how to pull sightings 2022-11-01 10:56:14 +01:00
Jakub Onderka 5ea72e1924 fix: [sync] Do not try to push no clusters to remote server 2022-10-31 15:08:18 +01:00
Jakub Onderka 772c789c76 chg: [internal] Add logging for galaxy cluster sync 2022-10-31 14:34:56 +01:00
Jakub Onderka 645b11e1b1 new: [redis] Store some data in Redis compressed to save memory 2022-10-30 16:19:58 +01:00
Jakub Onderka 446cf12799 chg: [internal] Cleanup code for JSON decoding 2022-10-23 13:17:39 +02:00
Jakub Onderka 1ab9c41981 chg: [internal] Use JsonTool more often vol. 2 2022-10-19 14:36:55 +02:00
Jakub Onderka b4bcbfe103 chg: [internal] Use JsonTool more often 2022-10-19 10:11:37 +02:00
Jakub Onderka 21857cbfd1 new: [internal] Add support for simdjson extension 2022-10-18 18:39:08 +02:00
Jakub Onderka fd37e54f76
Merge pull request #8663 from JakubOnderka/fix-delete-wlc
fix: [redis] Delete also misp:wlc:* keys
2022-10-12 17:53:08 +02:00
Jakub Onderka 5621d863b2 fix: [redis] Delete also misp:wlc:* keys 2022-10-12 17:31:48 +02:00
Jakub Onderka 72c05c314d fix: [jobs] Correctly handle incorrectly configured simple background jobs 2022-10-11 09:30:54 +02:00
Jakub Onderka a024a6f61e chg: [jobs] Store job data in Redis when SimpleBackgroundJobs are enabled
Will help to solve #8616
2022-10-10 19:31:24 +02:00
Jakub Onderka 79e2ffa6a7 fix: [redis] Delete all keys by pattern 2022-10-09 09:38:21 +02:00
Jakub Onderka c40feb1897 chg: [redis] Use redis serializer for storing dashboard cache 2022-10-08 13:09:35 +02:00
Jakub Onderka 72d9243b84 new: [redis] Add support for dragonfly redis replacement 2022-10-08 12:13:54 +02:00
Jakub Onderka 82698a5fa0
Merge pull request #8518 from JakubOnderka/disable-key-fetching
new: [UI] Allow to disable PGP key fetching
2022-10-06 17:23:41 +02:00
Jakub Onderka 341ac2d0a8 chg: [internal] New method RedisTool::unlink 2022-10-01 09:48:13 +02:00
Jakub Onderka 1a4500a5a5 chg: [internal] Optimise deleting keys from Redis 2022-09-30 21:04:27 +02:00
iglocska 1bbbafddd2
Merge branch '2.4' into develop 2022-09-26 13:10:04 +02:00
szopin 760d2ee048
Redact sensitive settings
Proxy password, ZeroMQ password and ZeroMQ redis password were not redacted as all other password fields
2022-09-21 13:53:56 +02:00
Jakub Onderka 172e724515 fix: [internal] Flush just necessary data 2022-09-11 10:59:14 +02:00
Jakub Onderka 877dded06a fix: [internal] Use Redis serializer to more places 2022-09-11 10:59:14 +02:00
Jakub Onderka 17981be04d new: [internal] RedisTool 2022-09-11 10:59:14 +02:00
Jakub Onderka 36addef808 new: [sync] Event index cache 2022-09-11 10:59:14 +02:00
Jakub Onderka 47c716e207 chg: [internal] Order columns by name when generating db_schema.json 2022-08-11 12:58:54 +02:00
iglocska c764bb0e8f
Merge branch 'log_last_api' into develop 2022-08-11 09:36:30 +02:00
Sami Mokaddem 0e2648d481
chg: [menus] Added `new` badge for over-correlating values 2022-08-04 13:33:00 +02:00
Sami Mokaddem 49575533ad
Merge remote-tracking branch 'origin/develop' into feature-workflows-2 2022-08-04 10:08:56 +02:00
iglocska a04f3964e7
new: [correlation rework] round 2
- long list of fixes
- update scripts
- correlation engine management interface
- recorrelation/truncation tools
- various performance tunings and bug fixes
2022-08-03 15:44:27 +02:00
Sami Mokaddem 44b2a1c3cd
new: [workflow:debugging] Added debugging capability by POSTing workflow exec to an URL 2022-08-03 11:45:17 +02:00
Tom King de351faaac new: [internal] Add option to log last API request 2022-08-01 15:02:49 +01:00
Sami Mokaddem 151d23a8c2
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-08-01 09:59:44 +02:00
iglocska 3ce754d595
Merge branch 'develop' into new_correlations 2022-07-31 23:58:40 +02:00
iglocska 3a4289d631
new: [correlation] engine rewrite
- allow for multiple concurrent engines
  - default: similar behaviour as before, ACL enforced
  - No ACL: for endpoint misps, disable the enforcement of ACL for correlations altogether

- rework:
  - correlation entries are fully indexed reference tables
  - values are now stored separately
  - built in protection against overcorrelating values (defaults to 20 max)
  - 1 way correlations to cut the size in half
  - unsigned IDs to double the ID space
  - loads of performance improvements
  - fix to the broken event index with correlation counts enabled

- UI improvements
  - search for values from the correlation column directly (in case there are non-correlating versions of the same value)
  - added correlations to the attribute search/index

- TODO:
  - upgrade scripts
2022-07-31 23:48:38 +02:00
Jakub Onderka 62926da1a3 new: [UI] Allow to disable PGP key fetching 2022-07-29 18:06:45 +02:00
Sami Mokaddem e9dc2f4e92
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:45:45 +02:00
Luciano Righetti f26f50c8d3
fix: handle casing diff in db response 2022-07-26 11:43:58 +02:00
Sami Mokaddem 6020aeba7a
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:32:31 +02:00
Luciano Righetti 13460b3a7b
fix: use session variables instead of global_variables table as its not available in some installations 2022-07-26 11:31:08 +02:00
Sami Mokaddem b8a9bedcbc
fix: [workflows] Clean up and removed unused code 2022-07-25 13:41:13 +02:00
Sami Mokaddem ed59e09161
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-21 13:21:14 +02:00
Luciano Righetti b4fb6251ce
new: mysql db tuning recommendations in server diagnostics 2022-07-19 13:36:53 +02:00