MISP
/
MISP
mirror of https://github.com/MISP/MISP
2
2
Fork 0
Code Issues Releases Wiki Activity
25,570 Commits
35 Branches
366 Tags
190 MiB
Commit Graph

767 Commits (038c41136602669314ba977dcbf2515fa160ba05)

Author SHA1 Message Date
Luciano Righetti ae3300d5d0 chg: use new bg jobs tool in AppModel 2021-11-02 11:55:12 +01:00
Jakub Onderka f1283996ad chg: [internal] Optimise AuditLog 2021-10-31 10:52:47 +01:00
Jakub Onderka 9ae7d88f23 chg: [internal] Optimise Tag::findTagIdsByTagNames 2021-10-30 19:43:17 +02:00
Jakub Onderka 94808488ce
Merge pull request #7852 from JakubOnderka/optimise-sighting 
chg: [internal] Optimise sightings
 2021-10-29 21:25:42 +02:00
Jakub Onderka 0d8292289d chg: [internal] Optimise afterFind and simplify ISODatetimeToUTC 2021-10-28 13:56:27 +02:00
Jakub Onderka 6ade27a27c chg: [internal] Move attribute validation to different tool 2021-10-28 09:42:04 +02:00
Loïc Fortemps dc71f6e451
Merge branch 'develop' into local_tags 2021-10-27 17:06:02 +02:00
Loic Fortemps a1ba1c053e
Adding a local_only option for Tags and Galaxies 2021-10-27 16:51:54 +02:00
Luciano Righetti 5e19ca6761 chg: refactor all background job calls from event model and controller to use new tool 2021-10-27 11:33:32 +02:00
Luciano Righetti 35cf34fab2 Merge branch 'develop' into add_simple_background_jobs 2021-10-26 10:55:13 +02:00
Jakub Onderka 006f603d76 chg: [schema] Add index for object_references.event_id column 2021-10-24 16:01:22 +02:00
Jakub Onderka fd0faf53d7
Merge pull request #7884 from JakubOnderka/faster-notifications 
chg: [internal] Simplified notifications loading
 2021-10-23 20:12:28 +02:00
Jakub Onderka 4997af0aa2 chg: [internal] Disable order for hasAny method 2021-10-23 19:54:38 +02:00
Jakub Onderka 0d78d0f994 chg: [internal] Simplified notifications loading 2021-10-23 19:50:38 +02:00
Jakub Onderka 958bfe7383 fix: [schema] Modify User.change_pw column to boolean 2021-10-23 19:22:45 +02:00
Luciano Righetti f3d05e6ff8 add: add initial new simple background jobs. 2021-10-21 13:39:26 +02:00
Tom King 4e74a165ed Merge remote-tracking branch 'upstream/develop' into feature/propagate_tag_deletion 2021-10-19 09:44:41 +01:00
Jakub Onderka 2ed41a0964 new: [oidc] User setting for oidc metadata 2021-10-18 10:08:18 +02:00
Jakub Onderka 6fe3a895c8 chg: [internal] Simplify validation 2021-10-18 09:04:06 +02:00
Jakub Onderka 1ffdfed0b1 chg: [internal] Optimise validators 2021-10-18 09:04:06 +02:00
Jakub Onderka a1c22e9fe5 chg: [internal] Remove unused validation rule 2021-10-18 09:04:06 +02:00
Jakub Onderka f3f50c14fd chg: [internal] Remove unused method 2021-10-18 09:04:06 +02:00
Jakub Onderka e1895cba81 chg: [internal] Optimise sightings 2021-10-17 16:17:17 +02:00
Jakub Onderka 28afe209ca chg: [internal] Fix setting cleanDb admin setting 2021-10-16 19:32:32 +02:00
Jakub Onderka d45ac63bf9 chg: [internal] Do less work when checking if db is updated 2021-10-16 09:58:05 +02:00
Jakub Onderka a3d1ff8762 chg: [internal] Another bunch of event filter optim 2021-10-15 15:54:31 +02:00
Jakub Onderka 9d84b6923d
Merge pull request #7835 from JakubOnderka/stix-export 
chg: [internal] Simplified loading python bin
 2021-10-13 17:27:02 +02:00
Jakub Onderka 2b31ada0a5 chg: [stix-export] Simplified loading python bin 2021-10-13 09:57:25 +02:00
Jakub Onderka 9610fb1e93 chg: [internal] Use FileAccessTool for Feed::unzipFirstFile 2021-10-12 14:32:50 +02:00
Jakub Onderka d9e89955bc chg: [internal] Simplify fetching Kafka topic 2021-10-11 09:41:46 +02:00
Jakub Onderka b3591f2d72 chg: [internal] Faster event tag attaching 2021-10-05 20:24:02 +02:00
Jakub Onderka 544c9ee8b9 new: [internal] Store MISP live status also in Redis 2021-10-04 10:07:32 +02:00
Jakub Onderka fdf6f5ca9e chg: [internal] Cleanup AdminShell::{updateJSON,runUpdates} 2021-09-26 21:52:18 +02:00
Jakub Onderka da1818c3cc fix: [internal] Fetching filter rules 2021-08-30 17:51:17 +02:00
Jakub Onderka 98b87d8987 chg: [security] Use const hasher also for login 2021-08-24 21:45:37 +02:00
Jakub Onderka 439ec5cceb fix: [internal] Code cleanup 2021-08-23 17:03:44 +02:00
Jakub Onderka 3c3cee7735
Merge pull request #7659 from JakubOnderka/unique-indexes 
chg: [schema] Mark more indexes as unique
 2021-08-20 09:22:23 +02:00
Jakub Onderka 1cd09dd919 chg: [schema] Mark more indexes as unique 2021-08-13 13:59:47 +02:00
Jakub Onderka c7f3be0929 chg: [sync] Remove `commit` and MISP-version from HTTP header 2021-08-11 17:02:55 +02:00
Jakub Onderka da195589df chg: [internal] Convert PubSubTool to static 2021-08-11 12:07:32 +02:00
Tom King 370176a037 Merge remote-tracking branch 'upstream/develop' into feature/propagate_tag_deletion 2021-08-11 10:56:30 +01:00
iglocska 4739e1f234
Merge branch '2.4' into develop 2021-08-02 13:31:19 +02:00
iglocska 269883c4ef
fix: [afterHook] for setting changes wasn't returning true, fixes 7477 
- this caused the CLI setting change to error out
 2021-08-02 13:30:29 +02:00
Jakub Onderka db242d6901 chg: [internal] Convert array to const 2021-07-27 18:49:40 +02:00
Jakub Onderka 15e3cc799c chg: [internal] Removed unused variables 2021-07-27 18:43:16 +02:00
Jakub Onderka 525339e333 chg: [internal] Remove unused method 2021-07-21 17:57:25 +02:00
Jakub Onderka 5f48fee84a chg: [internal] Move variable from AppModel to Server model 2021-07-21 17:53:47 +02:00
Jakub Onderka b62c95389c
Merge pull request #7157 from JakubOnderka/sighting-push-filtering 
new: [sync] Method for filtering out existing sightings
 2021-07-09 12:19:32 +02:00
Tom King 297eb9baad Merge remote-tracking branch 'upstream/2.4' into feature/propagate_tag_deletion 2021-07-07 08:49:13 +01:00
Jakub Onderka 017249451b new: [API] Read only authkeys 2021-06-28 12:41:10 +02:00
Tom King b5e2163556 new: [sync] Allow option to delete tags on event sync prior to soft-delete tag implementation 2021-06-11 17:14:29 +01:00
Jakub Onderka 8dc740cc35 new: Custom warninglist 2021-06-08 17:48:05 +02:00
mokaddem daf3d112ee
Merge remote-tracking branch 'origin/develop' into feature-galaxy-disabled 2021-06-03 11:01:49 +02:00
Jakub Onderka ad1b373766 new: [log] Audit log 2021-05-03 13:44:44 +02:00
iglocska d61ebc9905
new: [correlation exclusions] now have an optional comment field 
- explain why you exclude a value for easier maintenance
- edit existing exclusions to add those comments after the fact
 2021-04-27 10:52:53 +02:00
Jakub Onderka cd943b5e27 new: [sync] Method for filtering out existing sightings 2021-03-09 20:07:02 +01:00
Jakub Onderka e19850218a chg: [optimisation] Faster Model::_findList method 2021-03-07 11:12:03 +01:00
Jakub Onderka 062390ed83
Merge pull request #7155 from JakubOnderka/push-optim 
Push optim
 2021-03-04 19:12:31 +01:00
Jakub Onderka 921583f24d chg: [sync] Code cleanup 2021-03-04 18:30:28 +01:00
Jakub Onderka 599819f7f9 new: [authkeys] Allowed IPs 2021-03-03 09:23:07 +01:00
Jakub Onderka e3b2a0a40c chg: [schema] Add index for EventReport.event_id 2021-03-03 08:17:18 +01:00
Jakub Onderka 874ec66c9b chg: [schema] Convert GalaxyCluster tag name to case insensitive 2021-03-03 08:17:16 +01:00
iglocska b4e84726f1
Merge branch '2.4' into develop 2021-02-25 11:58:11 +01:00
iglocska 64879b836e
new: [CLI] check if updates are done yet or not 
usage:

- /var/www/MISP/app/Console/cake Admin updatesDone [blocking]
- returns True or False based on whether it is done
- When the blocking parameter is set, it will not return until all updates are done
 2021-02-25 11:37:37 +01:00
mokaddem 7222197245
new: [galaxy] Support of enabled/disabled state at galaxy level 
Fix #7019
 2021-02-19 13:33:24 +01:00
Jakub Onderka 1ac21e04c6 chg: [internal] Make Redis connection static 2021-02-16 09:50:46 +01:00
Jakub Onderka f910d8538b
Merge pull request #6809 from JakubOnderka/optimise-sightings-saving 
chg: [internal] Optimise sightings saving
 2021-01-09 13:23:36 +01:00
iglocska b8823b86e2
new: [correlation] added system to exclude certain values from the correlation engine 
- simply add values at /exclude_correlations
- new values coming in will not correlate if they trip over the values listed there
- to remove existing correlations run the cleaner tool on the above endpoint

- values can be 1:1 matches, or substring searches (denoted with a leading, ending, or both '%')
  - https://www.google.com/%  will match anything starting with https://www.google.com/
  - %google.com% will match anything that contains google.com
 2021-01-07 09:31:38 +01:00
Jakub Onderka 2bbe36c0ed chg: [internal] Optimise sightings saving 2021-01-01 15:45:05 +01:00
Jakub Onderka 4d4b306b60 new: [internal] New model method find('column') 2020-12-23 10:42:05 +01:00
Jakub Onderka a585466dff new: [security] Setting to hide orgs form sharing group view 2020-12-22 23:43:30 +01:00
Jakub Onderka 8df77748b0 chg: [internal] Small optimisations 2020-12-17 13:50:25 +01:00
Jakub Onderka d7c027fe91 chg: [internal] Force to update session data after database update 2020-12-17 13:49:32 +01:00
iglocska a332e1379c
Merge branch '2.4' into cerebrate 2020-11-30 23:49:40 +01:00
iglocska e65b255a62
new: [Cerebrate] db update added 2020-11-30 23:38:38 +01:00
Jakub Onderka 2c7d6e4466 new: [auth] Allow to enforce auth plugin authentication 2020-11-30 14:46:36 +01:00
Jakub Onderka 3b791aea7e fix: [internal] Do not try to fetch empty job 2020-11-19 19:16:12 +01:00
mokaddem eb2fa7b393 Merge branch '2.4' into galaxy-cluster2.0 2020-11-18 11:45:01 +01:00
iglocska 360dadc35f
fix: [authkey] default value incorrect 2020-11-18 11:37:23 +01:00
mokaddem dc65c79130
Merge branch '2.4' of github.com:MISP/MISP into galaxy-cluster2.0 2020-11-13 16:26:35 +01:00
mokaddem 410e3fbeee
chg: [appModel] Logout users after update 2020-11-12 11:08:08 +01:00
iglocska dbffebe503
Merge branch '2.4' into CRUD 2020-11-11 11:19:23 +01:00
mokaddem 150b4cb7d1
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-11-09 10:07:43 +01:00
mokaddem 0f69022a4e
fix: [appmodel] Make sure parameter is a string before accessing string 
index.
Fix #6544
 2020-11-05 10:13:05 +01:00
Jakub Onderka 49660255fe new: [av] Malware protection for uploaded files 2020-10-22 16:38:07 +02:00
iglocska 0b6da917d4
new: [advanced authkey] API key copy to the new system added to diagnostics 2020-10-20 08:35:21 +02:00
Jakub Onderka 46ba51a32e new: [sync] Show client certificate info in connection test 2020-10-19 09:57:06 +02:00
Jakub Onderka ac6761d7a5 fix: [internal] Remove unused AppModel::checkVersionRequirements method 2020-10-18 22:19:07 +02:00
mokaddem b628e15eb9
Merge remote-tracking branch 'origin/2.4' into feature-event-report 2020-10-09 14:54:47 +02:00
Jakub Onderka cf070bd7dd fix: [internal] Array to string conversion when constructing request 2020-10-06 17:27:53 +02:00
mokaddem 28a05576a4
chg: [appmodel] Set default value for warninglist_entry_count 2020-10-06 10:53:29 +02:00
Jakub Onderka c2f6908002 chg: [optimisation] Load MISP version and commit just once 2020-10-03 20:02:55 +02:00
mokaddem 02725982cc
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-10-01 10:38:28 +02:00
mokaddem 2fdcede6b6
chg: [appModel] Removed prio worker from the list of available workers 
to perform an update
 2020-10-01 09:28:02 +02:00
iglocska 6b0252d7e4
new: [user agent] string changed for MISP -> MISP synchronisation 2020-09-29 14:56:19 +02:00
mokaddem 6aab30c871
chg: [appmodel] Make sure to trigger the event report db update 2020-09-28 15:53:12 +02:00
mokaddem eb84b3344f
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-09-22 12:08:12 +02:00
mokaddem 4408a17dff
Merge remote-tracking branch 'origin/2.4' into feature-event-report 2020-09-22 10:15:22 +02:00
mokaddem 8e6b5ecb44
chg: [appmodel] New entry to create an upper bound for the unwanted 
action through login

This will be used by recovery scripts
 2020-09-15 12:00:26 +02:00
mokaddem 32dde67374
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-09-03 13:38:41 +02:00
mokaddem fb5c26997a
chg: [appModel] Create UUID unique index for other tables 2020-09-03 13:29:54 +02:00
mokaddem b374e67a15
chg: [appModel] Delete duplicated sightings uuid 2020-09-03 13:15:24 +02:00
mokaddem 6f092dfeb4
chg: [appModel] Optimized deduplication, log removed elements and 
regenerate unique indexes on update
 2020-09-03 10:55:14 +02:00
mokaddem 1729de3995
Merge branch '2.4' into fix-duplicated-uuids 2020-09-03 10:21:56 +02:00
Golbark 3a0bedb104 chg: [internal] Using Allowedlist instead of Whitelist 2020-09-01 16:28:20 +02:00
Golbark 3fb47d1cce chg: [internal] Using blocklist instead of blacklist 2020-09-01 16:27:36 +02:00
mokaddem 355861daa7
fix: [appmodel] Create indexes after the column has been added 2020-09-01 08:16:17 +02:00
iglocska 8fc66eda9f
new: [internal] cache tags instead of loading them over and over via the event fetcher, fixes #6201 
- should speed things up for exports of datasets that have a lot of recurring tags
- moved the caching of some internals to the appmodel level to make it more generic
 2020-08-18 09:52:48 +02:00
iglocska 0e898ce4f4
Merge branch '2.4' of github.com:MISP/MISP into 2.4 2020-08-18 09:26:56 +02:00
iglocska 24a5a9dc5e
chg: [internal] stub for a simple caching mechanism for recurring queries 2020-08-18 09:26:25 +02:00
Jakub Onderka cac497158e chg: [internal] Reuse AttachmentTool instance 2020-08-14 12:30:12 +02:00
Jakub Onderka a411b36666 chg: [internal] Move attachment handling to one place 2020-08-13 15:34:32 +02:00
Jakub Onderka 6fc8e4d119 fix: [internal] SendEmail exceptions message and logging 2020-08-12 19:33:15 +02:00
mokaddem 8d6f2eab03
chg: [eventReport] Added markdown-it dependency and started integration 
- WiP
 2020-08-04 10:08:18 +02:00
mokaddem dfaafd8054
Merge branch '2.4' of github.com:MISP/MISP into feature-event-report 2020-08-03 14:38:06 +02:00
mokaddem 8da680c60a
chg: [db_schema] Add constraint on UUID for Attribute, Object and Event 
tables
 2020-08-03 12:37:42 +02:00
mokaddem 3d224cfdb8
Merge branch '2.4' of github.com:MISP/MISP into fix-mass-edit-form-with-post 2020-07-30 15:29:20 +02:00
iglocska a2c0010d48
fix: [unicode] Temporarily escape 4 byte characters until we move the attribute value fields to mb4, fixes #5123 
- fixes sync/feed issues related to 4 byte unicode characters
 2020-07-30 09:17:27 +02:00
mokaddem 8ee87fb754
chg: [attributes:massEditForm] Pass attributes ids to be edited via POST 
Fix #5500
 2020-07-27 12:10:53 +02:00
Jakub Onderka f3d11f8d55 chg: [internal] Better error handling for JSON decoding 2020-07-13 15:59:32 +02:00
mokaddem 2051880b3f
new: [GalaxyCluster] Added soft and hard deletion 2020-07-13 12:34:58 +02:00
mokaddem 724de8a759
new: [clusterBlocklist] Added initial blocklist similar to the event one 2020-07-13 11:14:56 +02:00
mokaddem f7a3ed1db8
fix: [appModel:db_changes] Added new entry 2020-07-07 09:47:13 +02:00
mokaddem f3a9481c61
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-07-01 16:22:55 +02:00
mokaddem d4b1ecb088
new: [tag] Added 2 new columns to fetch tags from galaxies faster 2020-06-18 11:02:08 +02:00
mokaddem 864ecbdcce
new: [galaxyCluster] Added `published` flag to clusters 2020-06-16 16:36:49 +02:00
mokaddem 6e850f9455
fix: [clusterRelations] Corrected conditions allowing the 
creation/update of relations. Plus, get rid of not-used relation's value
 2020-06-15 08:31:40 +02:00
iglocska 82425123ab
fix: [internal] object level restsearch issues resolved when querying via filters on the attribute scope, fixes #6016 
- use subqueries instead of trying to query on the current scope
- associated find queries don't work on habtm relationships
 2020-06-14 20:23:48 +02:00
mokaddem 9b630ab146
new: [server] Added `pull_galaxy_cluster` option in the server config 2020-06-10 09:36:34 +02:00
Jakub Onderka aab0dc75a9 chg: [internal] Drop correlations.{org_id,sharing_group_id,a_sharing_group_id} indexes 2020-06-07 19:16:33 +02:00
Jakub Onderka ad9a729ffe chg: [internal] Drop correlations.value index 2020-06-07 18:58:04 +02:00
mokaddem a3bfd89f3e
chg: [appModel:update-55] Added indexes and removed incorrect sql 
commands
 2020-05-28 14:17:23 +02:00
mokaddem 5c04b9a8c1
Merge remote-tracking branch 'origin/2.4' into galaxy-cluster2.0 2020-05-28 14:06:30 +02:00
mokaddem 176e29c94f
chg: [server:push] Drafty version of galaxyCluster push 2020-05-26 15:08:24 +02:00
mokaddem 9ba5bc186f
chg: [galaxyCluster] Usage of both ID and UUID for relation with drafty working 
version of import/export
 2020-05-25 10:04:07 +02:00
mokaddem 4fa9642879
fix: [sightingdbs:model] Added default value for `timestamp`. Fix #5887 2020-05-14 15:23:28 +02:00
Jakub Onderka 1e07dfc9ae chg: [pubsub] Refactored PubSub tool 2020-05-11 08:22:37 +02:00
mokaddem d61e864a1e
chg: [clusterRelations:view_relations] Attached referencing relations 2020-05-08 09:17:37 +02:00
mokaddem 23d24c3c9e
chg: [clusterRelations] Model linking and basic index 2020-05-07 11:03:18 +02:00
mokaddem 01ec581a86
new: [clusterRelation] Early work on Galaxy Cluster Relations 2020-05-06 07:59:57 +02:00
iglocska 49499f1df8
Merge branch '5834' into 2.4 2020-04-30 07:07:25 +02:00
iglocska 2de54d59e5
fix: [user settings] corrected field name 2020-04-30 06:46:46 +02:00
iglocska d2ed0c8956
fix: [internal] Edge case where due to an old invalid update script an instance could end up with the wrong key in user settings 
- this should resolve the issue for affected users
- no change for everyone else
 2020-04-29 16:13:54 +02:00
mokaddem b86db16697
chg: [galaxyClusters] Added column `extends_version` 2020-04-29 10:00:22 +02:00
Jakub Onderka 4dec19dedf new: [feed] Support for compressed feeds 2020-04-28 16:16:34 +02:00
iglocska 1c3dc3fe51
Merge branch '2.4' into 5272 2020-04-28 15:31:17 +02:00
iglocska 2d63f68fc1
new: [feeds] index refactor and new features 
- added the ability to select an orgc ID for CSV/freetext feeds
  - all events created from this feed will carry the selected orgc_id

- Refactored the index fully
  - using the factories
  - better warnings against the dangerous new feed each pull setting
  - event index search added
  - several settings cleaned up / made more clear

- auto reload of default feed configuration disabled, fixes #2542, fixes #5789
  - added a button / endpoint to handle that instead to allow for the deleted default feeds to stay deleted
 2020-04-17 14:17:54 +02:00
iglocska 4ded5a73c4
new: [database] New MySQL data source added for debugging 
- MySQLObserver datasource added - prepends all queries with the requested controller/action and user ID for better debugging
 2020-04-14 15:04:33 +02:00
mokaddem dd1be03597
Merge branch '2.4' of github.com:MISP/MISP into galaxy-cluster2.0 2020-04-09 14:26:48 +02:00
iglocska 4ebc0a7988
new: [inbox] system added 
- user self-registration is the first use-case
- if the feature is enabled, users can unauthenticated send a registration request to MISP
  - request includes information on desired org and some privileges (sync / org admin / publisher)
- requests land in the inbox, admins can inspect the registration requests
  - they can accept/discard them individually or en masse
  - users will be notified of their credentials automatically
  - quick user creation if the user asks for an org that doesn't exist yet
 2020-04-07 13:21:01 +02:00
mokaddem 04dcdebb1f
new: [galaxyCluster] Initial import of Galaxy2.0 codebase - WiP 2020-03-12 10:26:09 +01:00
iglocska 8d02332b31
new: [dashboard] persistence package 
- export dashboard state
- import dashboard state
- save dashboard state
  - make it available to others on the instance on demand
  - admins can set a default password for users that don't have anything configured yet
  - load another template based on what the community has shared
- added Whoami widget which was an outcome of the ESDC training
- various improvements, new fields for genericElements, etc
 2020-03-08 23:36:27 +01:00
iglocska 03dc9a8206
fix: [synctool] tests improved 2020-03-02 23:09:47 +01:00
mokaddem 0831a3804a
chg: [database] Added db entry to re-correlate Attributes 2020-02-26 14:37:09 +01:00
mokaddem 745e42dc01
chg: [eventReport] Continuation of implementation - WiP 2020-02-18 15:02:35 +01:00
mokaddem 5408bb14f8
fix: [indexes] Added SQL index for tag numerical_value 2020-02-07 12:56:27 +01:00
Jakub Onderka e609ad6b77 chg: [internal] Log also previous exception 2020-01-26 18:56:41 +01:00
mokaddem 9d9ee3dbe7
Merge branch '2.4' of github.com:MISP/MISP into 2.4 2020-01-20 13:25:51 +01:00
mokaddem 92ebdfaba8
fix: [updateProgress] Display errors in between updates 
Return empty progress when the current progress can't be fetched
 2020-01-20 13:24:51 +01:00
iglocska 2ac7ea62da
fix: [internal] upgrade issues fixed 2020-01-20 11:56:50 +01:00
iglocska 379c6c3443
fix: [upgrade] removed test change 2020-01-20 10:25:00 +01:00
iglocska 22b2e82ace
fix: [upgrade] Added a safety net for launching superfluous updates 2020-01-20 10:23:51 +01:00
mokaddem 73b3acda94
fix: [model:comment] Do not index the `comment` field anymore for 
shadowAttribute and Objects
 2020-01-17 10:20:13 +01:00
mokaddem 4525f263c9
fix: [Attribute:comment] Do not index the `comment` field anymore 2020-01-17 09:23:18 +01:00
mokaddem a2127bea83
fix: [update:index] Correctly log index addition errors 2019-12-16 14:59:53 +01:00
mokaddem 5ff9c29fb8
fix: [update] Function name conflict introduced by the merge + UI 
Improvements
 2019-12-09 09:53:18 +01:00
mokaddem a1fdea754d
Merge branch 'zoidberg-timeline' into zoidberg-final 2019-12-06 15:40:51 +01:00
iglocska 7a8574851e
fix: [internal] potential fix to uninitialised AdminSetting model errors when calling changeSetting() in the upgrade process 2019-11-27 09:47:25 +01:00
Richard van den Berg dd963c2e21 Sync sightings on push, pull and push on add 2019-11-22 21:53:51 +01:00
iglocska 288df9d8e7
chg: [internal] Renamed log action name for db worker issues to be <= 20 characters in length 
- it was a restriction based on the db schema of the log table from before
 2019-11-18 11:35:10 +01:00
iglocska fc5c9d0db6
Revert "Revert "Merge pull request #5304 from JakubOnderka/version-loading"" 
This reverts commit 623bb20cb0.
 2019-11-12 13:12:42 +01:00
Raphaël Vinot 623bb20cb0 Revert "Merge pull request #5304 from JakubOnderka/version-loading" 
This reverts commit 71fb7fcbd7, reversing
changes made to 11ee95aeb3.

Note: broke freetext import.
 2019-11-12 10:16:36 +01:00
Andras Iklody 71fb7fcbd7
Merge pull request #5304 from JakubOnderka/version-loading 
fix: [internal] Load MISP version just once in AppController
 2019-11-11 15:15:20 +01:00
mokaddem 3babd222ac
Merge branch '2.4' of github.com:MISP/MISP into revisedUpdateProcess 2019-11-08 11:42:27 +01:00
iglocska 5f25f451df
chg: [sightingdb] Added support for bulk lookups and namespacing 
- aligned with the latest version of the sightingdb (support for the /rb endpoint)
- added namespacing as an option / sightingdb connection, defaults to "all" if left empty
 2019-11-08 08:24:04 +01:00
iglocska d24f23b5bd
Merge branch '2.4' into sightingdb 2019-11-06 21:22:00 +01:00
iglocska c4f1d4d15e
new: [SightingDB] Added integration with SightingDB 
- Added configuration tool
- Added lookups from the event view
- Added includeSightingdb flag for the restSearch searches
- Added SightingDB search tool
- Added SightingDB connection test tool
 2019-11-06 21:20:04 +01:00
mokaddem f58770a90a
Merge branch '2.4' of github.com:MISP/MISP into zoidberg-timeline 2019-11-05 13:51:03 +01:00
mokaddem b78d7825b9
Merge branch '2.4' of github.com:MISP/MISP into revisedUpdateProcess 2019-11-05 13:48:39 +01:00
Koen Van Impe 75f993e524 Force botvrij.eu feed to use HTTPS 2019-10-31 08:48:00 +01:00
mokaddem 0087a49fcc
chg: Usage of camelCase instead of snake_case 2019-10-29 09:57:25 +01:00
mokaddem 5e8720c8ee
chg: [update] Added special log action for workers performing the DB 
update
 2019-10-15 12:07:29 +02:00
mokaddem b87ee19146
chg: [update] Actually reset `UpdateFailNumber` when manually unlocking 2019-10-15 11:44:34 +02:00
mokaddem 13173e8926
chg: [update] Added postgresql allowed DB update errors 2019-10-14 12:37:19 +02:00
mokaddem 5d4142f62a
chg: [update] Parametrized ignore_disabled in ondemand_action and 
support of string update in update_progress
 2019-10-14 10:49:41 +02:00
Jakub Onderka 9314e9c968 fix: [internal] Load MISP version just once in AppController 2019-10-13 11:29:43 +02:00
mokaddem 0e2205c061
chg: [update] Added endpoint to release lock and integration with UI 2019-10-10 12:02:23 +02:00
mokaddem 571b4887f0
chg: [update] Do not release the lock if update fails more than 3 times 2019-10-10 10:14:22 +02:00
mokaddem 6652b922e6
chg: [appModel] Fixed merge conflict 2019-10-08 14:14:24 +02:00
mokaddem 015ec7d989
Merge branch '2.4' of github.com:MISP/MISP into zoidberg-timeline 2019-10-08 14:12:38 +02:00
mokaddem 8760c98c7e
Merge branch '2.4' of github.com:MISP/MISP into revisedUpdateProcess 2019-10-08 12:02:09 +02:00
iglocska a8c57a8316
new: [API] Added rate limiting option to the API 
- / role setting
- can be enabled/disabled and if enabled a limit can be set
- limit counter / 15 minutes starting from the first query
- x-headers inform the user about their limit/remaining queries/reset in seconds
 2019-10-08 11:43:56 +02:00
mokaddem 035d3be878
chg: [updateProgress] Usage of GPU for animation, deleted sleeps and 
improved task
 2019-10-07 15:12:47 +02:00
mokaddem 831e970e37
Merge branch 'revisedUpdateProcess' of github.com:MISP/MISP into revisedUpdateProcess 2019-10-07 11:52:26 +02:00
mokaddem c936d4ab51
chg: [updateProgress] Started taking into account stack of updates - WiP 2019-10-03 13:50:55 +02:00
mokaddem 2a6288c30b fix: [updateProgress] Fixed return message to better handle translation 2019-10-02 15:07:37 +02:00
mokaddem b44b369eec
Merge remote-tracking branch 'origin/2.4' into zoidberg-timeline 2019-10-02 14:35:00 +02:00
mokaddem bb3cf85776
Merge branch '2.4' into zoidberg-timeline 2019-10-02 11:23:04 +02:00
mokaddem a95aa1f5a2
Merge branch '2.4' of github.com:MISP/MISP into revisedUpdateProcess 2019-10-01 15:51:18 +02:00
mokaddem 25b1faceef
chg: [update] Usage of sprintf instead of string concatenation 2019-10-01 15:46:45 +02:00
mokaddem 0f6f5d6291
chg: [dbSchemaDiagnostic] show remaining time before update unlock and 
columns that should not be there
 2019-10-01 15:22:29 +02:00
mokaddem 6fd52393b7
chg: [update] Added new worker type `update` to perform updates 2019-10-01 13:36:37 +02:00
mokaddem 3b09a4bb16
chg: [update] Correctly terminate parallels workers doing updates - WiP 2019-10-01 13:08:09 +02:00
Andras Iklody 20311ae3e6
Merge pull request #5217 from JakubOnderka/patch-36 
new: [internal] New AppModel::logException method
 2019-09-30 21:26:09 +02:00
mokaddem cc6f0dcba7
chg: [update] Moved locking system from `updateDatase` to `runUpdates` - WiP 
So that `updateMISP` is also locked and workers benefits of more context
 2019-09-30 16:28:52 +02:00
mokaddem ae5d900b40
chg: [update] Keep track of update number in job - WiP 2019-09-30 15:31:49 +02:00
mokaddem 900317d5fe
Merge remote-tracking branch 'origin/2.4' into revisedUpdateProcess 2019-09-30 10:40:01 +02:00
mokaddem 006279f91f
fix: [update] Fixed bad merge and added more comments 2019-09-30 10:30:41 +02:00
iglocska cee439dc80
fix: [performance] notifications lookup on each UI page load was slow 
- introduced a major bottleneck on large instances
- massively reduced the load times for pages that warranted none
 2019-09-30 08:36:13 +02:00
iglocska a18e49f07e
fix: [user_settings] added timestamp field 2019-09-29 22:20:46 +02:00
iglocska 480e3b2969
Merge branch 'dev_session' into 2.4 2019-09-29 20:23:00 +02:00
iglocska 9ac6552ffa
new: [user settings] Finalised first revision 
More to come in the future
 2019-09-29 20:20:39 +02:00
mokaddem c72f04dd90
Merge branch '2.4' into revisedUpdateProcess 2019-09-26 12:13:49 +02:00
iglocska 946602a696
new: [User settings] Added user settings system 
- set settings / user
- settings can be set by user themselves or their org admin / site admin
- added first setting: publish_alert_filter
- accepts boolean branched filter options
  - supports deep logical trees
  - OR/NOT/AND
  - currently supports filtering on tags and the creator organisation
 2019-09-25 11:50:54 +02:00
Jakub Onderka acd90d9675
new: [internal] New AppModel::logException method 2019-09-24 20:52:36 +02:00
Jakub Onderka 84d100e982 new: [internal] Redis diagnostic 2019-09-21 07:43:35 +02:00
Jakub Onderka 0924de0440 fix: [internal] Clear also cake core and model caches 2019-09-16 19:41:27 +02:00
iglocska 850159627a
Merge branch '2.4' of github.com:MISP/MISP into 2.4 2019-09-13 11:51:05 +02:00
iglocska ffc9147018
new: [sync] Added sync priority system to prioritise the order of instances to push to 2019-09-13 11:49:12 +02:00
mokaddem 1b133062e6
chg: [decaying] Changed `name` column type from `text` to `varchar(255)` 2019-09-12 14:44:09 +02:00
mokaddem ead4f46cf4
fix: [decaying] Correctly add database indexes 2019-09-12 14:28:49 +02:00
mokaddem 60edb198a7
chg: [database] Added indexes to decaying models and related tables 2019-09-12 10:22:13 +02:00
mokaddem 91768dc881
Merge branch '2.4' of github.com:MISP/MISP into revisedUpdateProcess 2019-09-09 11:42:03 +02:00
mokaddem 059b25f262
chg: [decaying] Added `default` column in decayingModels table, code 
path for `rest` and improved ACL
 2019-08-30 09:18:00 +02:00
mokaddem c39c168962
fix: [appModel] SQL query syntax fixed 2019-08-29 12:22:35 +02:00
mokaddem 0c88b99a96
chg: [roles] Initially sets perm_decaying permission to mirror sighting 
permission
 2019-08-27 09:19:44 +02:00
mokaddem 2c788b1863
fix: [appmodel] Added db_change number for the decaying update 2019-08-27 09:01:27 +02:00
mokaddem ed98d73be7
Merge branch '2.4' of github.com:MISP/MISP into decaying 2019-08-22 15:33:09 +02:00
mokaddem 3a64405bd9
chg: [decayingMapping] Refacto - Comments and code optimization 2019-08-22 11:31:50 +02:00
mokaddem 26afe1765d
chg: [roles] Added `perm_decaying` role 2019-08-20 16:37:06 +02:00
Jakub Onderka b50ffc9885 chg: [cache] Do not check if class exists when cache is already connected 2019-08-16 19:26:12 +02:00
mokaddem e421c0684e
chg: [decaying:edit] Notice if editing a default model 2019-08-16 11:59:12 +02:00
mokaddem 3a356a51e4
chg: [decaying] Added restricted edition and `all_orgs`` flag - WiP 2019-08-16 10:33:58 +02:00
mokaddem dbeaefcfff
fix: [update] Correctly sets liveOff and do not consider MySQL index addition 
as an error anymore
 2019-08-14 16:45:58 +02:00
mokaddem 7ad60f7562
fix: [update] Init class before using it.. 2019-08-14 15:22:29 +02:00
mokaddem 5c3f2a8c80
chg: [update] Update function name are more explicit 2019-08-14 12:26:54 +02:00
mokaddem 0fe9b490b8
Merge branch 'workerForDBUpdate' into revisedUpdateProcess 2019-08-14 12:14:39 +02:00
mokaddem ae49c0766a
chg: [update] `updateDatabase` returns the result of the update 
(duplicated column are nbot counted as an error)
 2019-08-14 12:13:45 +02:00
mokaddem c2cd6a3459
chg: [decaying:index] Added support of enable/disable on the index 2019-07-24 14:36:13 +02:00
mokaddem 821785273a
Merge remote-tracking branch 'origin/2.4' into decaying 2019-07-22 10:03:57 +02:00
Raphaël Vinot a8e66b50aa
fix: [debug] Remove debug call. 2019-07-15 10:23:18 +02:00
mokaddem 13efab98a1
fix: [database] bumped db update number for fs/ls update 2019-07-11 10:10:48 +02:00
mokaddem 2c57c1138e
Merge branch '2.4' of github.com:MISP/MISP into zoidberg-timeline 2019-07-11 09:59:57 +02:00
iglocska 2a059f7b31
new: [tags] Local tags feature added 
- Create tags locally if you are a host org user that allows in-place tagging for sync / export filtering
- Events are NOT modified using these tags
- Local tags always get stripped before syncing
- Local tags allow host org users to violate the ownership model of MISP
- galaxies, attack matries also included

- some sync fixes
 2019-07-08 11:39:41 +02:00
mokaddem b8b6a170fe
chg: [attribute:restSearch] Search support for first_seen and last_seen 2019-07-04 15:08:05 +02:00
mokaddem 76cddeb264
Merge branch '2.4' of github.com:MISP/MISP into decaying 2019-07-03 13:45:49 +02:00
mokaddem 31c44d78d9
fix: [sql] updated MySQL.sql and modified comment column type 2019-07-02 16:26:05 +02:00
mokaddem f6d360bcfe
chg: [index] Index Attribute.comment 2019-07-02 16:12:53 +02:00
mokaddem 6305b681ed
chg: [update:seen] Switch back to the usage of worker for the update 2019-07-02 15:29:49 +02:00
mokaddem 91b70e5c82
fix: [update] liveOff recognition and logs when updates are locked 2019-07-02 15:22:21 +02:00