Commit Graph

6116 Commits (02a4c51406de4a6a66574bf476ebcce1426abbfb)

Author SHA1 Message Date
Jakub Onderka 02a4c51406 fix: [correlation] Fix correlation skipping when doing full correlation 2022-09-08 09:45:02 +02:00
Jakub Onderka e8ea9877a3 chg: [correlations] Optimise fetching limit 2022-09-08 09:44:25 +02:00
Jakub Onderka fcd0447ec9 chg: [correlations] Skip correlations for float attribute type 2022-09-08 09:35:20 +02:00
Jakub Onderka 1daab04ce2 chg: [correlation] Faster saving correlations 2022-09-08 09:30:45 +02:00
Jakub Onderka c367e2b3a1
Merge pull request #8373 from JakubOnderka/mysql-extended
new: [internal] Experimental MysqlExtended driver
2022-09-07 17:12:41 +02:00
Sami Mokaddem bc6d4a8305
chg: [appModel] Usage of `update` worker instead of `prio` 2022-09-01 15:55:37 +02:00
Sami Mokaddem 646d921d67
Merge remote-tracking branch 'origin/develop' into tomking2_feature/propagate_tag_deletion 2022-09-01 11:07:35 +02:00
Alexandre Dulaunoy 1e73697da2
Merge branch '2.4' into develop
Following discussion with Luciano and the finding of a logic for
the format string. We decided to go for Unicode ;-)
2022-09-01 09:12:34 +02:00
Sami Mokaddem c9327174b9
Merge branch 'fix-truncate-overcorrelating-value' into 2.4 2022-08-29 15:10:48 +02:00
Sami Mokaddem 05ad105750
fix: [update-91] Remove duplicates before creating the constraint 2022-08-29 12:12:39 +02:00
Sami Mokaddem 962754dd3b
chg: [overCorrelatingValue] Truncated the `value` column
- We keep the unique constraint on the table
- Correlating values over the max. allowed size are truncated to fit the size requirement. That means large correlating values might be marked as over-correlating despite the fact they are not (as only the starting portion of the value is evaluated).
2022-08-29 10:50:59 +02:00
Sami Mokaddem 74830c5a42
Merge branch 'feature-workflow-module-msteams' into develop 2022-08-25 11:07:45 +02:00
Sami Mokaddem c74ca2563c
chg: [workflowModule:send_email] Removed unused import 2022-08-25 11:03:32 +02:00
Sami Mokaddem d22e426364
new: [workflowModule:send_email] To allow sending an email to a list of users
The module requires the `jinja_template_rendering` module in misp-module to work correctly
2022-08-25 10:56:49 +02:00
Sami Mokaddem e9e0d3d203
new: [workflowBaseModule] Allow jinja template rendering using misp-module 2022-08-25 10:54:53 +02:00
Sami Mokaddem ac34456697
chg: [module:queryModuleServer] Allow skipping trigger execution 2022-08-25 10:54:15 +02:00
Sami Mokaddem 56aeebf3a5
Merge branch 'Benni0_2.4' into 2.4 2022-08-24 13:36:13 +02:00
Sami Mokaddem 2208d01924
Merge branch 'Benni0_2.4' into develop 2022-08-24 13:35:23 +02:00
Sami Mokaddem b1597861d7
Merge branch 'Benni0_patch-1' into 2.4 2022-08-24 11:21:25 +02:00
Sami Mokaddem 057bce11f9
Merge branch 'Benni0_patch-1' into develop 2022-08-24 11:18:33 +02:00
Sami Mokaddem e49723f4dc
new: [workflow-module:ms_teams_webhook] Added new MS teams module based on the webhook module 2022-08-24 11:07:43 +02:00
Sami Mokaddem c79324528b
fix: [eventReport:downloadMarkdownFromURL] Added support of trigger for that function 2022-08-24 10:36:00 +02:00
Sami Mokaddem f0913e1c52
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-24 09:54:46 +02:00
Sami Mokaddem d551d0533a
chg: [workflow:Action_tag_*] Usage of tag name instead of tag ID
Using IDs was a bad choice as it prevent to correctly share blueprints since IDs will be different from instance to instance
2022-08-24 09:52:53 +02:00
Sami Mokaddem 85c1a75830
chg: [workflowBlueprint] Don't attach module_data in blueprint by default 2022-08-24 09:14:17 +02:00
iglocska 6a7521293c
chg: [syslog] include change field if no custom log message was generated
- for certain log entries vital information was omitted by the syslog. If no custom message is specifically set for the log entry, the change field is included
2022-08-24 09:06:11 +02:00
iglocska 0d6d3cb980
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-22 16:24:26 +02:00
Luciano Righetti e991d0c8da
fix: event block rules not working with tags filters, see issue #8551 2022-08-22 16:08:56 +02:00
Luciano Righetti 5d4f73fcbb
fix: event block rules not working with tags filters, see issue #8551 2022-08-22 16:07:40 +02:00
iglocska 446835a000
fix: [feeds] - tagging a feed would cause the pull to fail
- tag metadata not correctly retrieved
2022-08-22 16:00:01 +02:00
Benni0 8386b2c0bd
fix: Undefined index: Tag in Feed.php #8547 2022-08-18 10:06:46 +02:00
Benni0 4caad64928
fix: Class 'Folder' not found #8544 2022-08-17 16:23:17 +02:00
iglocska e24d3bf2d3
fix: [correlations] save the distribution state of the event before/after saving it, fixes #8528
- only trigger a correlation update with the new distribution if it actually changed
- should remove a massive additional load on the table

- thanks to @github-germ for noticing this!
2022-08-12 16:06:08 +02:00
iglocska cbfb2b74ee
fix: [modules] only run the workflow if it's enabled, fixes #8531
- blocked event report fetches from URL
2022-08-11 14:59:59 +02:00
iglocska 0f15344cff
Merge branch 'value1' into develop 2022-08-11 14:22:34 +02:00
iglocska 54821e6297
Merge branch 'develop' of github.com:MISP/MISP into develop 2022-08-11 14:00:03 +02:00
iglocska 0b0b62991a
fix: [internal] Attribute model, initialise variable 2022-08-11 13:59:25 +02:00
iglocska 7dbb0a6669
fix: [emailing] speculative fix for #8523 2022-08-11 13:59:01 +02:00
Jakub Onderka 47c716e207 chg: [internal] Order columns by name when generating db_schema.json 2022-08-11 12:58:54 +02:00
Jakub Onderka 48c8a7eab3 chg: [internal] Code cleanup 2022-08-11 12:55:23 +02:00
Jakub Onderka 14501e8a78 chg: [internal] Use less SQL queries for event fetching 2022-08-11 12:55:23 +02:00
Jakub Onderka 986e109f76 fix: [internal] Advanced correlations 2022-08-11 12:55:21 +02:00
Jakub Onderka ec209a98b9 chg: [internal] Drop unnecessary indexes from default_correlations table 2022-08-11 12:54:49 +02:00
Jakub Onderka b53d8c828d chg: [internal] Cleanup code for new correlation engine 2022-08-11 12:53:14 +02:00
iglocska c764bb0e8f
Merge branch 'log_last_api' into develop 2022-08-11 09:36:30 +02:00
Luciano Righetti 057a9883a0
chg: allow to restsearch attributes by value1 and value2 2022-08-10 16:07:43 +02:00
iglocska d3d042cf2a
new: [overcorrelations] quality of life improvements
- Added new tool to generate occurrence counts (real numbers this time)
- Added hook to truncate over correlating value table on recorrelation
- No longer store the partial counts as occurrences when generating correlations
2022-08-10 14:17:20 +02:00
iglocska c452706374
Merge branch '2.4' into develop 2022-08-10 13:12:05 +02:00
iglocska f9c76acc90
fix: [pubsub] gracefully handle events with attribute-less objects 2022-08-10 11:05:45 +02:00
iglocska 097ad78d54
chg: [correlations] performance tuning
- added a new constraint to check for correlation uniqueness (a_id, 1_a_id, value_id)
- stopped dropping correlations on a full recorrelation
- only correlate "upwards" towards higher IDs
2022-08-09 14:41:59 +02:00