Commit Graph

6116 Commits (02a4c51406de4a6a66574bf476ebcce1426abbfb)

Author SHA1 Message Date
iglocska b34a6d670a
fix: [compatibility] removed function return types from correlations 2022-08-08 16:02:50 +02:00
iglocska 9a6dc85a96
chg: [compatibility] for PHP < 7.2 for an organisation that shall go unnamed 2022-08-08 15:59:59 +02:00
iglocska fa3a67d22b
fix: [compatibility] Support for php < 7.2 for an organisation that shall go unnamed 2022-08-08 15:56:55 +02:00
Sami Mokaddem ca02bf1c4e
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-05 14:49:21 +02:00
Sami Mokaddem e21c2c8cb1
chg: [workflow:tag_operation] Make module not blocking 2022-08-05 14:48:48 +02:00
iglocska b5596f687f
chg: [publishing] reverted the speculative fix 2022-08-05 14:47:03 +02:00
iglocska a3f0347a45
fix: [speculative] fix for the event publishing timing issues 2022-08-05 14:44:37 +02:00
iglocska 2516c25eae
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-05 14:41:44 +02:00
iglocska 77eaa86225
fix: [speculative fix] for event publishing timing issues 2022-08-05 14:41:00 +02:00
Sami Mokaddem d38c3cea63
new: [workflow:tag_operation] New module to perform tag operations 2022-08-05 14:34:14 +02:00
Sami Mokaddem f478841401
chg: [Tag] Helper function to attach/detach tags and bump timestamps 2022-08-05 14:33:15 +02:00
Sami Mokaddem 668566ee6e
chg: [workflow:event_after_save] Changed trigger overhead to high 2022-08-05 14:32:32 +02:00
Sami Mokaddem a2923513a5
chg: [workflow:baseModule] New helper function and better usage of the `equals` filter operator 2022-08-05 14:32:05 +02:00
Sami Mokaddem de5ca67001
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-05 13:17:01 +02:00
Sami Mokaddem 33d3eebd9c
chg: [event:publish] Only fetch full event if needed + added site_admin perms for the user 2022-08-05 13:16:38 +02:00
iglocska 9dc233bc9e
fix: [proposal] correlations are deprecated 2022-08-05 12:55:04 +02:00
Tom King 64d508b4e3 fix: Rollback change to DB upgrade 86 2022-08-05 09:41:05 +01:00
Tom King d2a7b4b3c8 fix: Use correct field for altering table to include last_api_access 2022-08-05 09:35:15 +01:00
iglocska 3e8be53979
fix: [typo] causing the object saving to fail 2022-08-04 19:55:20 +02:00
iglocska 35b4803400
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-04 19:09:11 +02:00
iglocska 243208e4eb
fix: [objects] only check for soft deleted attributes when appropriate
- when it's an edit
- when the soft delete flag is set
2022-08-04 19:08:26 +02:00
Sami Mokaddem 8494c6d187
fix: [worflow:walkGraph] Correct usage of oganisation key 2022-08-04 15:12:30 +02:00
Sami Mokaddem 5bed18614b
fix: [correlation:getRelatedAttribute] Always return an array 2022-08-04 14:51:37 +02:00
Sami Mokaddem c215c47e18
chg: [correlation:getRelatedAttributes] Updated documentation to reflect returned type 2022-08-04 14:49:48 +02:00
iglocska ea0932b7b1
chg: [correlations] value field changed to varchar 2022-08-04 13:49:30 +02:00
iglocska c030b06437
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-04 13:48:07 +02:00
iglocska aa43182eca
fix: [correlation] value truncation for the correlation value table 2022-08-04 13:47:31 +02:00
Sami Mokaddem 077b43a961
chg: [workflow:module_zmq] renamed parameter 2022-08-04 13:34:50 +02:00
Sami Mokaddem 0e2648d481
chg: [menus] Added `new` badge for over-correlating values 2022-08-04 13:33:00 +02:00
iglocska 61ec464b4d
fix: [workflow] description field default set 2022-08-04 11:28:24 +02:00
Sami Mokaddem 79d182dc79
fix: [appModel:update] Fixed forgotten schema update for workflows 2022-08-04 11:08:19 +02:00
Sami Mokaddem 5074528d91
fix: [appModel:update] Set update success to true for case 89 and 90 2022-08-04 10:58:44 +02:00
Sami Mokaddem 3f65c3ef94
fix: [correlation:defaultCorrelation] Ignore ACL check for site_admins 2022-08-04 10:48:17 +02:00
Sami Mokaddem 49575533ad
Merge remote-tracking branch 'origin/develop' into feature-workflows-2 2022-08-04 10:08:56 +02:00
iglocska bce4508716
chg: [grammar] minor fix
- fat finger induced typo
2022-08-04 08:20:20 +02:00
iglocska dae2b1782a
fix: [Objects] cascade deletes when capturing already soft-deleted objects 2022-08-04 08:19:54 +02:00
Sami Mokaddem ce9eac725f
chg: [workflowBlueprint:update] Small refacto 2022-08-04 08:17:26 +02:00
Sami Mokaddem ea443b76f0
chg: [workflowBlueprint] Usage of FileAccessTool 2022-08-04 08:14:51 +02:00
Sami Mokaddem bd33dac909
chg: [workflow] Refactoring and allow running workflow by ID 2022-08-03 16:05:29 +02:00
iglocska a04f3964e7
new: [correlation rework] round 2
- long list of fixes
- update scripts
- correlation engine management interface
- recorrelation/truncation tools
- various performance tunings and bug fixes
2022-08-03 15:44:27 +02:00
Sami Mokaddem 44b2a1c3cd
new: [workflow:debugging] Added debugging capability by POSTing workflow exec to an URL 2022-08-03 11:45:17 +02:00
Sami Mokaddem 0c2144f701
fix: [workflow:module_concurrent_task] Use correct class for constant 2022-08-02 14:26:09 +02:00
Sami Mokaddem 9f4093a311
chg: [workflow:walkGraph] Simplified condition and logging 2022-08-02 14:25:39 +02:00
Sami Mokaddem eaa8daa39d
chg: [workflow:executeNode] Improved logging and error catching 2022-08-02 13:47:36 +02:00
Sami Mokaddem 076f2aee64
fix: [workflow:executeForTrigger] Differentiate between error and blocked outcome 2022-08-02 13:42:35 +02:00
Sami Mokaddem dc5e3d051a
fix: [workflow:executeNode] Make disabled node fails 2022-08-02 13:41:57 +02:00
Sami Mokaddem 3a65f22ada
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-08-02 11:31:12 +02:00
Sami Mokaddem f29836d904
fix: [workflow:tag_if] Use flattened attributes and extract tags from all attributes 2022-08-02 11:27:58 +02:00
Tom King de351faaac new: [internal] Add option to log last API request 2022-08-01 15:02:49 +01:00
iglocska dbd992dbef
fix: [correlation engines] added additional event fields to the retrieved event metadata to match the old behaviour 2022-08-01 10:36:18 +02:00
Sami Mokaddem d83039f520
fix: [appmodel] Fixed merged conflict and typo in sql query 2022-08-01 10:19:38 +02:00
Sami Mokaddem 151d23a8c2
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-08-01 09:59:44 +02:00
iglocska be67304988
fix: [correlation] fixed missing passed sharing group ID array 2022-08-01 00:43:36 +02:00
iglocska 3ce754d595
Merge branch 'develop' into new_correlations 2022-07-31 23:58:40 +02:00
iglocska 3a4289d631
new: [correlation] engine rewrite
- allow for multiple concurrent engines
  - default: similar behaviour as before, ACL enforced
  - No ACL: for endpoint misps, disable the enforcement of ACL for correlations altogether

- rework:
  - correlation entries are fully indexed reference tables
  - values are now stored separately
  - built in protection against overcorrelating values (defaults to 20 max)
  - 1 way correlations to cut the size in half
  - unsigned IDs to double the ID space
  - loads of performance improvements
  - fix to the broken event index with correlation counts enabled

- UI improvements
  - search for values from the correlation column directly (in case there are non-correlating versions of the same value)
  - added correlations to the attribute search/index

- TODO:
  - upgrade scripts
2022-07-31 23:48:38 +02:00
Sami Mokaddem a3ab0838d1
fix: [workflows] Typos in some views 2022-07-29 15:40:50 +02:00
Sami Mokaddem a578d0a833
fix: [workflow:validation] Make sure a workflow has one and only one trigger 2022-07-29 10:59:12 +02:00
Sami Mokaddem b146902a01
fix: [event:publish] Call correct trigger 2022-07-29 10:58:39 +02:00
Sami Mokaddem 762f1a7c9a
chg: [workflow] Changed the format of the graph 2022-07-29 10:26:14 +02:00
Sami Mokaddem 60ceed59fa
fix: [workflow] Fixed in walkGraph 2022-07-29 10:24:47 +02:00
Sami Mokaddem d069d72f35
chg: [workflow] Changed the format of the graph WiP
Made a clear separation between node data and module data
2022-07-29 08:33:59 +02:00
Sami Mokaddem e265057d24
chg: [workflow] Added an `id` in all module instead of relying on the label 2022-07-27 15:41:21 +02:00
Sami Mokaddem 416f824449
new: [trigger:post_after_save] Added support of post_after_save trigger
Data passed include the Post's Thread as well as the Event it belongs to if applicable
2022-07-27 12:06:07 +02:00
Sami Mokaddem 9e8a481b32
chg: [workflow:executeWorkflowForTrigger] Log execution outcome 2022-07-27 12:03:45 +02:00
Sami Mokaddem 098696aadb
chg: [workflows:if] Usage of Hash::get instead of extract for non-containable operators 2022-07-27 12:01:05 +02:00
Sami Mokaddem 7f5ce84288
new: [workflow:trigger_event_after_save] New trigger Event.afterSave 2022-07-27 10:45:05 +02:00
Sami Mokaddem 8f1b07d698
new: [workflow] Added support of estimated overhead for triggers 2022-07-27 10:44:00 +02:00
Sami Mokaddem a6f676a66c
chg: [workflow] Simplified call to executeTrigger 2022-07-27 10:43:09 +02:00
Sami Mokaddem 997f7396ae
chg: [workflow:module_email_before_send] Removed useless module 2022-07-26 14:48:28 +02:00
Sami Mokaddem f89e48a75a
chg: [workflows] Improved pagination and added trigger scope 2022-07-26 14:45:35 +02:00
Sami Mokaddem c1136dcb7d
chg: [workflow:module_webhook] Added description 2022-07-26 14:07:18 +02:00
Sami Mokaddem e9dc2f4e92
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:45:45 +02:00
Luciano Righetti f26f50c8d3
fix: handle casing diff in db response 2022-07-26 11:43:58 +02:00
Sami Mokaddem 6020aeba7a
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-26 11:32:31 +02:00
Sami Mokaddem c3cd5e5827
chg: [workflow] Started renaming `block` into `module` 2022-07-26 11:32:15 +02:00
Luciano Righetti 13460b3a7b
fix: use session variables instead of global_variables table as its not available in some installations 2022-07-26 11:31:08 +02:00
Sami Mokaddem 5e29f975d1
chg: [workflow] Enable some module by default when updating 2022-07-26 11:16:08 +02:00
Sami Mokaddem 106d6aa299
chg: [workflows:module_index] Added support of mass enable/disable 2022-07-26 11:07:52 +02:00
Sami Mokaddem 2be3efaf84
chg: [workflows:editor] Added support of codemirror for textarea 2022-07-26 10:00:30 +02:00
Sami Mokaddem c26f0e5ea1
chg: [workflows:misp_module] Reorganised the config in misp-module 2022-07-26 08:45:33 +02:00
Sami Mokaddem a092a1da1c
chg: [workflow:zmq_module] Simplified usage 2022-07-25 15:08:17 +02:00
Sami Mokaddem 95e98c27bb
chg: [workflowBlueprint] Clean-up and new method export formats 2022-07-25 14:09:29 +02:00
Sami Mokaddem b8a9bedcbc
fix: [workflows] Clean up and removed unused code 2022-07-25 13:41:13 +02:00
Sami Mokaddem 51fa6fd6d8
fix: [workflow] Remove leftovers from previous design with [non]blocking paths from triggers 2022-07-25 13:29:03 +02:00
Sami Mokaddem ab26b27268
chg: [workflow] added `addWorkflow` function in model 2022-07-25 13:24:15 +02:00
Sami Mokaddem fb62a38d7a
chg: [workflow:editor] Show warning for path leading to blocking nodes from non-blocking context 2022-07-22 13:28:56 +02:00
Sami Mokaddem 702d2f8a5e
chg: [workflow:attachNotification] Added warning about using a blocking module in a non-blocking trigger 2022-07-22 10:06:18 +02:00
Sami Mokaddem 85ada91dde
chg: [user:afterSave] Do not execute trigger for login and logout actions 2022-07-22 10:05:34 +02:00
Sami Mokaddem c8528a7c59
chg: [workflows:modules] Renamed parallel tasks into concurrent tasks 2022-07-22 09:56:30 +02:00
Sami Mokaddem 798e440f57
chg: [workflows:editor] Sort modules in the sidebar by their name 2022-07-21 14:42:40 +02:00
Sami Mokaddem ed59e09161
Merge branch 'develop' of github.com:MISP/MISP into feature-workflows-2 2022-07-21 13:21:14 +02:00
Sami Mokaddem 79e6d2bf54
chg: [workflow] Usage of format converter tool to convert passed data into MISP core format 2022-07-21 11:18:59 +02:00
Sami Mokaddem 0de1656f32
fix: [workflow] Log error message on the disk as well upon module execution error
This is needed as currently log entries are rollbacked if the trigger was called from the beforeSave context
2022-07-20 16:53:17 +02:00
Sami Mokaddem 354594f5ca
chg: [workflow] Made sure data is correctly converted before calling the trigger 2022-07-20 16:51:53 +02:00
Sami Mokaddem 94804f7776
chg: [workflow:baseModule] Automatically convert into MISP core format if `misp_core_format` is set 2022-07-20 16:51:03 +02:00
Luciano Righetti dc4236ef9b
new: add LightPaginator when total page count is not needed/to expensive 2022-07-20 15:56:30 +02:00
Sami Mokaddem fd2bf8511a
chg: [workflow] Simplified extraction of trigger from workflows 2022-07-20 15:35:31 +02:00
Sami Mokaddem 3e8889dc90
chg: [workflow:distribution_if] Added `event` scope to be used. 2022-07-20 15:22:11 +02:00
Sami Mokaddem 461860e78d
chg: [workflow:webhook] Renamed parameter 2022-07-20 15:21:41 +02:00
Sami Mokaddem 2011bf3670
chg: [workflow] Added support of misp_core_format in triggers and modules
Allow trigger to specify if their passed data is compliant with the MISP core format from the RFC. As for module, they can specify if they expect data under the MISP core format to be working properly.
2022-07-20 15:19:33 +02:00