Commit Graph

586 Commits (f796071d6494e7b21e4c6fb7a7cbd10b1427be52)

Author SHA1 Message Date
Jakub Onderka 28afe209ca chg: [internal] Fix setting cleanDb admin setting 2021-10-16 19:32:32 +02:00
Jakub Onderka d45ac63bf9 chg: [internal] Do less work when checking if db is updated 2021-10-16 09:58:05 +02:00
Jakub Onderka a3d1ff8762 chg: [internal] Another bunch of event filter optim 2021-10-15 15:54:31 +02:00
Jakub Onderka 9d84b6923d
Merge pull request #7835 from JakubOnderka/stix-export
chg: [internal] Simplified loading python bin
2021-10-13 17:27:02 +02:00
Jakub Onderka 2b31ada0a5 chg: [stix-export] Simplified loading python bin 2021-10-13 09:57:25 +02:00
Jakub Onderka 9610fb1e93 chg: [internal] Use FileAccessTool for Feed::unzipFirstFile 2021-10-12 14:32:50 +02:00
Jakub Onderka d9e89955bc chg: [internal] Simplify fetching Kafka topic 2021-10-11 09:41:46 +02:00
Jakub Onderka b3591f2d72 chg: [internal] Faster event tag attaching 2021-10-05 20:24:02 +02:00
Jakub Onderka 544c9ee8b9 new: [internal] Store MISP live status also in Redis 2021-10-04 10:07:32 +02:00
Jakub Onderka fdf6f5ca9e chg: [internal] Cleanup AdminShell::{updateJSON,runUpdates} 2021-09-26 21:52:18 +02:00
Jakub Onderka da1818c3cc fix: [internal] Fetching filter rules 2021-08-30 17:51:17 +02:00
Jakub Onderka 98b87d8987 chg: [security] Use const hasher also for login 2021-08-24 21:45:37 +02:00
Jakub Onderka 439ec5cceb fix: [internal] Code cleanup 2021-08-23 17:03:44 +02:00
Jakub Onderka 3c3cee7735
Merge pull request #7659 from JakubOnderka/unique-indexes
chg: [schema] Mark more indexes as unique
2021-08-20 09:22:23 +02:00
Jakub Onderka 1cd09dd919 chg: [schema] Mark more indexes as unique 2021-08-13 13:59:47 +02:00
Jakub Onderka c7f3be0929 chg: [sync] Remove `commit` and MISP-version from HTTP header 2021-08-11 17:02:55 +02:00
Jakub Onderka da195589df chg: [internal] Convert PubSubTool to static 2021-08-11 12:07:32 +02:00
iglocska 4739e1f234
Merge branch '2.4' into develop 2021-08-02 13:31:19 +02:00
iglocska 269883c4ef
fix: [afterHook] for setting changes wasn't returning true, fixes 7477
- this caused the CLI setting change to error out
2021-08-02 13:30:29 +02:00
Jakub Onderka db242d6901 chg: [internal] Convert array to const 2021-07-27 18:49:40 +02:00
Jakub Onderka 15e3cc799c chg: [internal] Removed unused variables 2021-07-27 18:43:16 +02:00
Jakub Onderka 525339e333 chg: [internal] Remove unused method 2021-07-21 17:57:25 +02:00
Jakub Onderka 5f48fee84a chg: [internal] Move variable from AppModel to Server model 2021-07-21 17:53:47 +02:00
Jakub Onderka b62c95389c
Merge pull request #7157 from JakubOnderka/sighting-push-filtering
new: [sync] Method for filtering out existing sightings
2021-07-09 12:19:32 +02:00
Jakub Onderka 017249451b new: [API] Read only authkeys 2021-06-28 12:41:10 +02:00
Jakub Onderka 8dc740cc35 new: Custom warninglist 2021-06-08 17:48:05 +02:00
mokaddem daf3d112ee
Merge remote-tracking branch 'origin/develop' into feature-galaxy-disabled 2021-06-03 11:01:49 +02:00
Jakub Onderka ad1b373766 new: [log] Audit log 2021-05-03 13:44:44 +02:00
iglocska d61ebc9905
new: [correlation exclusions] now have an optional comment field
- explain why you exclude a value for easier maintenance
- edit existing exclusions to add those comments after the fact
2021-04-27 10:52:53 +02:00
Jakub Onderka cd943b5e27 new: [sync] Method for filtering out existing sightings 2021-03-09 20:07:02 +01:00
Jakub Onderka e19850218a chg: [optimisation] Faster Model::_findList method 2021-03-07 11:12:03 +01:00
Jakub Onderka 062390ed83
Merge pull request #7155 from JakubOnderka/push-optim
Push optim
2021-03-04 19:12:31 +01:00
Jakub Onderka 921583f24d chg: [sync] Code cleanup 2021-03-04 18:30:28 +01:00
Jakub Onderka 599819f7f9 new: [authkeys] Allowed IPs 2021-03-03 09:23:07 +01:00
Jakub Onderka e3b2a0a40c chg: [schema] Add index for EventReport.event_id 2021-03-03 08:17:18 +01:00
Jakub Onderka 874ec66c9b chg: [schema] Convert GalaxyCluster tag name to case insensitive 2021-03-03 08:17:16 +01:00
iglocska b4e84726f1
Merge branch '2.4' into develop 2021-02-25 11:58:11 +01:00
iglocska 64879b836e
new: [CLI] check if updates are done yet or not
usage:

- /var/www/MISP/app/Console/cake Admin updatesDone [blocking]
- returns True or False based on whether it is done
- When the blocking parameter is set, it will not return until all updates are done
2021-02-25 11:37:37 +01:00
mokaddem 7222197245
new: [galaxy] Support of enabled/disabled state at galaxy level
Fix #7019
2021-02-19 13:33:24 +01:00
Jakub Onderka 1ac21e04c6 chg: [internal] Make Redis connection static 2021-02-16 09:50:46 +01:00
Jakub Onderka f910d8538b
Merge pull request #6809 from JakubOnderka/optimise-sightings-saving
chg: [internal] Optimise sightings saving
2021-01-09 13:23:36 +01:00
iglocska b8823b86e2
new: [correlation] added system to exclude certain values from the correlation engine
- simply add values at /exclude_correlations
- new values coming in will not correlate if they trip over the values listed there
- to remove existing correlations run the cleaner tool on the above endpoint

- values can be 1:1 matches, or substring searches (denoted with a leading, ending, or both '%')
  - https://www.google.com/%  will match anything starting with https://www.google.com/
  - %google.com% will match anything that contains google.com
2021-01-07 09:31:38 +01:00
Jakub Onderka 2bbe36c0ed chg: [internal] Optimise sightings saving 2021-01-01 15:45:05 +01:00
Jakub Onderka 4d4b306b60 new: [internal] New model method find('column') 2020-12-23 10:42:05 +01:00
Jakub Onderka a585466dff new: [security] Setting to hide orgs form sharing group view 2020-12-22 23:43:30 +01:00
Jakub Onderka 8df77748b0 chg: [internal] Small optimisations 2020-12-17 13:50:25 +01:00
Jakub Onderka d7c027fe91 chg: [internal] Force to update session data after database update 2020-12-17 13:49:32 +01:00
iglocska a332e1379c
Merge branch '2.4' into cerebrate 2020-11-30 23:49:40 +01:00
iglocska e65b255a62
new: [Cerebrate] db update added 2020-11-30 23:38:38 +01:00
Jakub Onderka 2c7d6e4466 new: [auth] Allow to enforce auth plugin authentication 2020-11-30 14:46:36 +01:00
Jakub Onderka 3b791aea7e fix: [internal] Do not try to fetch empty job 2020-11-19 19:16:12 +01:00
mokaddem eb2fa7b393 Merge branch '2.4' into galaxy-cluster2.0 2020-11-18 11:45:01 +01:00
iglocska 360dadc35f
fix: [authkey] default value incorrect 2020-11-18 11:37:23 +01:00
mokaddem dc65c79130
Merge branch '2.4' of github.com:MISP/MISP into galaxy-cluster2.0 2020-11-13 16:26:35 +01:00
mokaddem 410e3fbeee
chg: [appModel] Logout users after update 2020-11-12 11:08:08 +01:00
iglocska dbffebe503
Merge branch '2.4' into CRUD 2020-11-11 11:19:23 +01:00
mokaddem 150b4cb7d1
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-11-09 10:07:43 +01:00
mokaddem 0f69022a4e
fix: [appmodel] Make sure parameter is a string before accessing string
index.
Fix #6544
2020-11-05 10:13:05 +01:00
Jakub Onderka 49660255fe new: [av] Malware protection for uploaded files 2020-10-22 16:38:07 +02:00
iglocska 0b6da917d4
new: [advanced authkey] API key copy to the new system added to diagnostics 2020-10-20 08:35:21 +02:00
Jakub Onderka 46ba51a32e new: [sync] Show client certificate info in connection test 2020-10-19 09:57:06 +02:00
Jakub Onderka ac6761d7a5 fix: [internal] Remove unused AppModel::checkVersionRequirements method 2020-10-18 22:19:07 +02:00
mokaddem b628e15eb9
Merge remote-tracking branch 'origin/2.4' into feature-event-report 2020-10-09 14:54:47 +02:00
Jakub Onderka cf070bd7dd fix: [internal] Array to string conversion when constructing request 2020-10-06 17:27:53 +02:00
mokaddem 28a05576a4
chg: [appmodel] Set default value for warninglist_entry_count 2020-10-06 10:53:29 +02:00
Jakub Onderka c2f6908002 chg: [optimisation] Load MISP version and commit just once 2020-10-03 20:02:55 +02:00
mokaddem 02725982cc
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-10-01 10:38:28 +02:00
mokaddem 2fdcede6b6
chg: [appModel] Removed prio worker from the list of available workers
to perform an update
2020-10-01 09:28:02 +02:00
iglocska 6b0252d7e4
new: [user agent] string changed for MISP -> MISP synchronisation 2020-09-29 14:56:19 +02:00
mokaddem 6aab30c871
chg: [appmodel] Make sure to trigger the event report db update 2020-09-28 15:53:12 +02:00
mokaddem eb84b3344f
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-09-22 12:08:12 +02:00
mokaddem 4408a17dff
Merge remote-tracking branch 'origin/2.4' into feature-event-report 2020-09-22 10:15:22 +02:00
mokaddem 8e6b5ecb44
chg: [appmodel] New entry to create an upper bound for the unwanted
action through login

This will be used by recovery scripts
2020-09-15 12:00:26 +02:00
mokaddem 32dde67374
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-09-03 13:38:41 +02:00
Golbark 3a0bedb104 chg: [internal] Using Allowedlist instead of Whitelist 2020-09-01 16:28:20 +02:00
Golbark 3fb47d1cce chg: [internal] Using blocklist instead of blacklist 2020-09-01 16:27:36 +02:00
mokaddem 355861daa7
fix: [appmodel] Create indexes after the column has been added 2020-09-01 08:16:17 +02:00
iglocska 8fc66eda9f
new: [internal] cache tags instead of loading them over and over via the event fetcher, fixes #6201
- should speed things up for exports of datasets that have a lot of recurring tags
- moved the caching of some internals to the appmodel level to make it more generic
2020-08-18 09:52:48 +02:00
iglocska 0e898ce4f4
Merge branch '2.4' of github.com:MISP/MISP into 2.4 2020-08-18 09:26:56 +02:00
iglocska 24a5a9dc5e
chg: [internal] stub for a simple caching mechanism for recurring queries 2020-08-18 09:26:25 +02:00
Jakub Onderka cac497158e chg: [internal] Reuse AttachmentTool instance 2020-08-14 12:30:12 +02:00
Jakub Onderka a411b36666 chg: [internal] Move attachment handling to one place 2020-08-13 15:34:32 +02:00
Jakub Onderka 6fc8e4d119 fix: [internal] SendEmail exceptions message and logging 2020-08-12 19:33:15 +02:00
mokaddem 8d6f2eab03
chg: [eventReport] Added markdown-it dependency and started integration
- WiP
2020-08-04 10:08:18 +02:00
mokaddem dfaafd8054
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-08-03 14:38:06 +02:00
mokaddem 3d224cfdb8
Merge branch '2.4' of github.com:MISP/MISP into fix-mass-edit-form-with-post 2020-07-30 15:29:20 +02:00
iglocska a2c0010d48
fix: [unicode] Temporarily escape 4 byte characters until we move the attribute value fields to mb4, fixes #5123
- fixes sync/feed issues related to 4 byte unicode characters
2020-07-30 09:17:27 +02:00
mokaddem 8ee87fb754
chg: [attributes:massEditForm] Pass attributes ids to be edited via POST
Fix #5500
2020-07-27 12:10:53 +02:00
Jakub Onderka f3d11f8d55 chg: [internal] Better error handling for JSON decoding 2020-07-13 15:59:32 +02:00
mokaddem 2051880b3f
new: [GalaxyCluster] Added soft and hard deletion 2020-07-13 12:34:58 +02:00
mokaddem 724de8a759
new: [clusterBlocklist] Added initial blocklist similar to the event one 2020-07-13 11:14:56 +02:00
mokaddem f7a3ed1db8
fix: [appModel:db_changes] Added new entry 2020-07-07 09:47:13 +02:00
mokaddem f3a9481c61
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-07-01 16:22:55 +02:00
mokaddem d4b1ecb088
new: [tag] Added 2 new columns to fetch tags from galaxies faster 2020-06-18 11:02:08 +02:00
mokaddem 864ecbdcce
new: [galaxyCluster] Added `published` flag to clusters 2020-06-16 16:36:49 +02:00
mokaddem 6e850f9455
fix: [clusterRelations] Corrected conditions allowing the
creation/update of relations. Plus, get rid of not-used relation's value
2020-06-15 08:31:40 +02:00
iglocska 82425123ab
fix: [internal] object level restsearch issues resolved when querying via filters on the attribute scope, fixes #6016
- use subqueries instead of trying to query on the current scope
- associated find queries don't work on habtm relationships
2020-06-14 20:23:48 +02:00
mokaddem 9b630ab146
new: [server] Added `pull_galaxy_cluster` option in the server config 2020-06-10 09:36:34 +02:00
Jakub Onderka aab0dc75a9 chg: [internal] Drop correlations.{org_id,sharing_group_id,a_sharing_group_id} indexes 2020-06-07 19:16:33 +02:00
Jakub Onderka ad9a729ffe chg: [internal] Drop correlations.value index 2020-06-07 18:58:04 +02:00