MISP
/
MISP
mirror of https://github.com/MISP/MISP
2
2
Fork 0
Code Issues Releases Wiki Activity
25,596 Commits
42 Branches
370 Tags
181 MiB
Commit Graph

162 Commits (a55a19cd0938e9cf86be7e5012690777c20ce00e)

Author SHA1 Message Date
Jakub Onderka d82a95b903 new: [sync] When pushing event, upload sightings by another call 2021-03-11 12:14:52 +01:00
Jakub Onderka 6af83b5d5a new: [sync] Filter out existing sightings if remote sever supports that method 2021-03-11 12:14:52 +01:00
Jakub Onderka 362707deb1 chg: [sync] Faster capturing sighting when pushing whole event 2021-03-11 12:14:52 +01:00
Jakub Onderka 8830696c4d chg: [sync] New separate method for uploading sightings to remote server 2021-03-11 12:14:52 +01:00
Jakub Onderka 8b2d1bdffd chg: [internal] Fetch attribute UUIDs for sightings in different query 2021-03-06 10:56:46 +01:00
Tom King 626443af47 chg: Use a more suitable Sighting creation function as recommended, grab the Org ID from the user if present 2021-02-11 16:31:51 +00:00
Jakub Onderka fdd354fa17 fix: [internal] Group for getting sightings for tag 2021-01-15 14:23:35 +01:00
iglocska 88d7e08606
Merge branch '2.4' into develop 2021-01-12 13:09:48 +01:00
Jakub Onderka 1276a42309
fix: [sighting] Order must contain group for some mysql servers 2021-01-07 14:10:35 +01:00
Jakub Onderka 2bbe36c0ed chg: [internal] Optimise sightings saving 2021-01-01 15:45:05 +01:00
Jakub Onderka ec6a73795f
Merge pull request #6797 from JakubOnderka/optimisations 
Optimisations
 2020-12-23 16:35:06 +01:00
Jakub Onderka faa95b256a new: [sighting] New setting that will allow users to see host org sightings 2020-12-23 14:51:28 +01:00
Jakub Onderka 9bc52c18fe chg: [internal] Use find('column') on more places 2020-12-23 13:45:57 +01:00
Jakub Onderka 0c722243e5 fix: [sighting] Grouping sighting fetch for tags 2020-12-22 15:29:08 +01:00
Jakub Onderka 1a184ebbb5 new: [internal] Allow to output directly TmpFileTool 2020-12-21 21:02:37 +01:00
Jakub Onderka e52a11efa2
Merge pull request #6787 from JakubOnderka/sighting-rest-optim 
chg: [sighting] Faster and memory efficient rest search
 2020-12-21 21:01:28 +01:00
Jakub Onderka 0e31996be3 chg: [sighting] Faster and memory efficient rest search 2020-12-21 19:18:22 +01:00
Jakub Onderka b770e46efb fix: [sighting] Order must contain group for some mysql servers 2020-12-21 18:38:59 +01:00
Jakub Onderka 8c15ea14a8
Merge pull request #6760 from JakubOnderka/sighting-rest-uuid 
new: [rest] Allow to search sightings by event or attribute UUID
 2020-12-20 01:14:25 +01:00
Jakub Onderka 36dabacfa1 new: [rest] Allow to search sightings by event or attribute UUID 2020-12-20 01:04:57 +01:00
Jakub Onderka 334d6c6f95 chg: [sighting] Optimise bulk sighting saving 2020-12-16 09:50:06 +01:00
Jakub Onderka 305605cd3f fix: [sighting] Make sure that correct columns are processed 2020-12-08 11:02:31 +01:00
Jakub Onderka e1bf73937a fix: [sightings] Support mysql in sql_mode=only_full_group_by 2020-11-30 19:50:52 +01:00
Jakub Onderka d92b18970a chg: [sighting] Support for postgres 2020-11-24 16:30:03 +01:00
Jakub Onderka 261d15265d chg: [sighting] Speedup loading sighting for tags and galaxies 2020-11-24 16:30:03 +01:00
Jakub Onderka 8df9bc9116 chg: [sighting] Speedups list all sightings 2020-11-24 16:30:03 +01:00
Jakub Onderka b1a5770ce9 chg: [sighting] Reworked listing sightings 2020-11-24 16:30:03 +01:00
Jakub Onderka 1f258ebe66 chg: [sighting] Sighting statistics 2020-11-24 16:30:00 +01:00
Jakub Onderka a92c1c4fe4 chg: [internal] Speedup sightings saving 2020-11-03 09:20:22 +01:00
Jakub Onderka b88bffd5b5 chg: [internal] Sighting saving optimisation 2020-10-06 16:48:47 +02:00
Jakub Onderka 0225afec40 chg: [internal] Validate sighting UUID 2020-10-05 14:44:23 +02:00
Jakub Onderka 2a30620368 chg: [internal] Remove unused code 2020-10-05 14:44:23 +02:00
Jakub Onderka 7fb7e8ae39 chg: [internal] Optimise sightings fetching 2020-10-05 14:44:23 +02:00
Jakub Onderka 00c318b451 chg: [internal] Optimise fetching sightings for object 2020-10-03 19:50:02 +02:00
iglocska 59d08f2e54
Revert "chg: [internal] Optimise fetching sightings for object" 
This reverts commit e442a394cd.
 2020-09-30 17:47:29 +02:00
Richard van den Berg 7151990383 chg: [sightings] anonymise pushed sightings using new Sightings_anonymise_as setting 2020-09-11 17:23:29 +02:00
Jakub Onderka e7f80fd51d chg: [internal] Use faster fetcher for viewing sightings 2020-09-01 17:06:23 +02:00
Jakub Onderka e442a394cd chg: [internal] Optimise fetching sightings for object 2020-08-18 15:02:36 +02:00
Jakub Onderka 8b10c94cfa chg: [internal] Refactor Server::getEventIdsFromServer 2020-08-10 15:47:06 +02:00
Jakub Onderka d7f7bc725b chg: [internal] Faster loading sighting 2020-07-28 09:50:28 +02:00
Andras Iklody e6995dab67
Merge pull request #6035 from JakubOnderka/rest-search-optim 
chg: [internal] Attribute REST search optimisations and error handling
 2020-07-07 12:18:29 +02:00
Andras Iklody 317d9f3661
Merge pull request #6026 from JakubOnderka/save-sightings-optimisation 
Save sightings optimisation
 2020-06-23 23:39:46 +02:00
Jakub Onderka ce47d32df1 chg: [internal] Move getting sightings range to one place 2020-06-23 08:44:55 +02:00
Jakub Onderka ea5a819064 chg: [internal] Faster loading sightings if the same attribute is requested 2020-06-23 08:37:14 +02:00
Jakub Onderka 3d12cb3f3c chg: [internal] Attribute REST search optimisations and error handling 2020-06-19 23:45:22 +02:00
Jakub Onderka 10516d30ef chg: [sightings] Check if sighting already exists before getting attribute info 2020-06-18 15:09:06 +02:00
Jakub Onderka bc19103aa3 chg: [sightings] Save one SQL query when saving sighting if event UUID is given 2020-06-18 15:08:23 +02:00
Jakub Onderka 90498fa1e2 chg: [internal] Log exception if exception is thrown during event downloading 2020-06-07 20:25:39 +02:00
iglocska bd2772bf82
fix: [internal] sighting restSearch 
- some small fixes
 2019-11-29 10:55:47 +01:00
iglocska 1c5afa49ed
new: [refactor] Massive internal refactor and cleanup of deprecated APIs 
- new centralised restSearch function in AppController as entry point via all controllers
- new component handling restSearch related support functions, such as parameter mapping
- hollowed out all deprecated export functions on the event/attribute controller
  - replaced with a new functionality that remaps them to restSearch
  - all functionality should be maintained with all additional advantages introduced with restsearch
- additional cleanup (some unused functions removed)
 2019-11-29 10:11:30 +01:00
iglocska 95f17d6acd
fix: [sync] Some minor changes to the sighting push 
- correctly handle anonymisation
- only push sightings, not rest of the event (decide on sender side)
- handle receiving sanitised sightings
 2019-11-25 14:32:22 +01:00
Richard van den Berg dd963c2e21 Sync sightings on push, pull and push on add 2019-11-22 21:53:51 +01:00
iglocska c4f1d4d15e
new: [SightingDB] Added integration with SightingDB 
- Added configuration tool
- Added lookups from the event view
- Added includeSightingdb flag for the restSearch searches
- Added SightingDB search tool
- Added SightingDB connection test tool
 2019-11-06 21:20:04 +01:00
mokaddem b51871fe52
fix: [Sightings] Plugin.Sightings_policy=Event Owner now shows sightings 
that belong to the creating org
 2019-08-26 16:49:30 +02:00
mokaddem ed98d73be7
Merge branch '2.4' of github.com:MISP/MISP into decaying 2019-08-22 15:33:09 +02:00
mokaddem cd5c9f7d1d
Merge remote-tracking branch 'origin/2.4' into decaying 2019-08-20 15:00:38 +02:00
Jakub Onderka 4ef9595023 fix: Replace not exists MethodNotFoundException with NotFoundException 2019-08-14 21:27:05 +02:00
iglocska de99495edf
fix: [API] sightings restSearch now accepts uuids as org_id, fixes #4992 2019-08-14 11:52:54 +02:00
mokaddem 6ba45b27f8
Merge remote-tracking branch 'origin/2.4' into decaying 2019-08-13 16:32:58 +02:00
mokaddem bbab646d01
chg: [decaying:simulation] Support of sightings in the decaying simulation 2019-07-16 09:31:49 +02:00
Nikos Filippakis 9d59b10368 Publish events to Kafka 
Signed-off-by: Nikos Filippakis <nikolaos.filippakis@cern.ch>
 2019-03-18 15:53:22 +01:00
mokaddem 47e53230ac fix: [sighting] Bug adding sightings on every attributes 
When trying to add a sighting to a value via the REST API,
if a value was given to the key `values` instead of an array,
the Model function `addSighting` would *crash* and skip the condition on
the value, consequently adding a sighting on every attributes.
 2019-01-29 12:54:50 +01:00
Sami Mokaddem ed4f752d3a Merge remote-tracking branch 'origin/2.4' into querybuilder 2018-12-17 16:36:27 +01:00
iglocska 2d0259ce13 fix: [CS] coding standards script re-run 2018-11-23 14:11:33 +01:00
mokaddem 7f5225b154 new: [rest client] added first draft of querybuilder widget 2018-11-06 16:54:17 +01:00
iglocska bbc8a8bf4d fix: [API] minor fixes to the sightings api 
- fixed duplicate sighting tags in XML output
- added attribute value to the sighting
 2018-10-29 20:18:29 +01:00
Sami Mokaddem 5763a74b96 chg: [sighting/api] improved comments 2018-10-23 13:39:29 +02:00
Sami Mokaddem ff5f5faf02 new: [sighting/api] xml output format + improved error feedback 2018-10-23 13:06:37 +02:00
Sami Mokaddem 01cba114f2 fix: [sightings/api] now support json output format 2018-10-23 12:17:54 +02:00
Sami Mokaddem 99e5f560a8 new: [sighting/api] trying to follow the new API architecture. JSON 
export is broken but CSV is working. WIP...
 2018-10-23 11:24:03 +02:00
Sami Mokaddem 41d2de90db chg: typo 2018-10-23 00:05:24 +02:00
Sami Mokaddem 731a4d5e2b new: [Sightings/API] Added possiblity to get sightings based on a 
timerange/source/...
 2018-10-22 23:27:58 +02:00
iglocska 0bda88db39 fix: [internal] Fixes to invalid model function calls 2018-10-17 12:31:43 +02:00
Steve Clement 51a3a5cdbf chg: [python] Added and amended varios places where python is called 2018-09-28 14:59:26 +02:00
chrisr3d 8628757f65
fix: [Sighting] Fixed sighting creation 2018-09-07 15:45:57 +02:00
jgo 32bb9c4b80 check if sighting with given uuid already exists before saving new sighting 2018-07-27 14:23:40 +02:00
jgo 719bcb5a65 add attribute UUID to sighting item (easier for synchronization) 2018-07-27 13:34:20 +02:00
iglocska a81894f14c chg: [CS] Changed to PSR-2 
- to make contributions easier, adopted PSR-2
- used php-cs-fixer to rework the style
- *sniff sniff* Goodbye tab indentation
 2018-07-19 11:48:22 +02:00
iglocska 56808265b7 fix: [python3] Updated script to python3 only 2018-07-12 16:26:49 +02:00
iglocska 6090e77cff fix: Rework of tags index / galaxy view 
- performance tweaks
- no more silly queries
- added sharing group aware ACL to the event/attribute counters
 2017-11-09 11:53:57 +01:00
iglocska 57b935e7de fix: Added context to the sightings zmq feed 2017-11-08 18:57:08 +01:00
iglocska 7492d2799f new: Sightings ingested on import/sync 2017-11-03 15:18:46 +01:00
iglocska 17b00e0376 fix: Fixed a bug where sightings couldn't be added to objects 2017-10-27 12:16:41 +02:00
iglocska 68f4833893 new: First version of the zmq reimplementation 2017-10-27 09:10:46 +02:00
iglocska 69436f3dd9 fix: Fixed the duplicate sighting save that kept popping up in the ZMQ feed 2017-06-16 09:23:05 +02:00
iglocska 57857c3a32 new: Performance improvements for the pub-sub modules 
- Only load and open connection to redis for the pub-sub connection once.
- Massive performance boost when the ZMQ functionality is enabled
 2017-06-16 08:41:12 +02:00
iglocska ab9f282a44 new: Added sightings to ZMQ pub sub system 2017-05-28 00:33:20 +10:00
Ángel González 926895733b Cosmetic changes 
Change space indents to tabs
Remove ?> at end of file
Add or remove some indentation where appropriate
 2017-05-08 00:45:57 +02:00
Iglocska 72a326f50f fix: Fixed several issues with the sightings 
- Main issue was the expensive and potentially large query used to find all sightings for a list of tags (used on the tag and galaxy cluster index)

potentially fixes #1993
 2017-02-26 08:12:53 +01:00
iglocska 3fca8de6bf new: Added activity charts to tag and galaxy cluster indeces 
- bunch of small improvements additionally
 2017-02-24 19:34:18 +01:00
iglocska b719b69ff7 chg: Better error message for invalid types when posting sightings 
- sent before doing the lookup against existing attributes
 2017-02-22 16:44:04 +01:00
iglocska e7d1cd6f4d fix: small fix for an invalid error message in the sightings 2017-02-21 14:26:33 +01:00
iglocska 3c558c653d fix: Added validation for sighting type and fixed responses for adding sightings 2017-02-20 11:13:39 +01:00
iglocska fb16d77e5c fix: several fixes to the new sightings 2017-02-17 01:27:07 +01:00
iglocska 94c01d5896 new: First revision of the new sightings system 2017-02-16 22:46:30 +01:00
iglocska 4e41b55572 new: First iteration of the improved sightings 2017-02-05 23:48:18 +01:00
iglocska 8ccd817435 new: Index API for sightings added 2017-01-06 15:25:31 +01:00
iglocska 62a2211a23 Merge branch '2.4' into 1457 2016-09-18 13:06:03 +02:00
iglocska a599ec24f7 Merge branch '2.4' into 1501 2016-09-18 11:07:10 +02:00
Andreas Ziegler 25e52a6786 chg: remove some references to variables 2016-09-15 17:08:58 +02:00