Commit Graph

1227 Commits (fe3cd9d81425af5d4fd8d8bacbb5390381fbbfc8)

Author SHA1 Message Date
iglocska 5795b1974a new: Added warning about missing warninglists used for TLD resolution in the freetext import tool
- following the twitter feedback
2018-04-26 18:57:00 +02:00
Sami Mokaddem 7a94612161 new: Possibility to view connected communities and concerned sharing groups in distribution graph's tooltip 2018-04-25 09:48:03 +00:00
Sami Mokaddem 56b37d08fc Merge remote-tracking branch 'upstream/2.4' into distributionGraph 2018-04-25 07:08:54 +00:00
iglocska df80f702d0 Merge branch 'correlation_integration' into 2.4 2018-04-24 17:10:16 +02:00
iglocska 2af8bfec4e new: Added event enrichment functionality
- select and run a set of enrichments on all applicable attributes of the event
- exposed to the API
- exposed to the command line tool
- adheres to attribute distributions
2018-04-24 16:41:09 +02:00
Sami Mokaddem 828426b0c9 fix: support of filtering for distribution=0 (empty(0) is true ini
php). Also, only consider attr and obj_attr (ignoring object as they
only carry meta-data)
2018-04-23 14:33:32 +00:00
Sami Mokaddem 02b4f32c4f Possibility to filter valueInFieldAttribute with multiple value.
distribution graph support inherit distribution level
2018-04-23 14:14:06 +00:00
Sami Mokaddem bdcecfb1e6 Allow filtering attributes based on specific columns (previsouly not
accessible) like distribution.
Partial support of onClick for distribution graph.
2018-04-23 13:54:36 +00:00
Sami Mokaddem 72ca4260be Merge remote-tracking branch 'upstream/2.4' into distributionGraph 2018-04-23 12:52:12 +00:00
Sami Mokaddem f9414871b8 Initial version of the distribution graph 2018-04-23 12:51:15 +00:00
iglocska 110cff08d8 fix: Fixed empty event tags on the event index api 2018-04-23 11:48:39 +02:00
Sami Mokaddem 43e8529b9d Correlation graph in event view 2018-04-20 12:38:14 +00:00
Andras Iklody 607d203c04
Merge pull request #3170 from mokaddem/ref_graph
Extended event support and tag filtergin in the event graph
2018-04-20 13:40:48 +02:00
Sami Mokaddem 2ca3515f10 Feature: Possibility to filter on tags 2018-04-20 08:35:38 +00:00
iglocska 279a6459ff new: Preview the extended event ID / UUID
- Also, cleanup of the nasty event tag code
2018-04-19 13:56:50 +02:00
iglocska 3c438243f4 Merge branch '2.4' of github.com:MISP/MISP into 2.4 2018-04-17 13:45:04 +02:00
iglocska 9b2e212b3d new: Added getEventInfoById API 2018-04-17 13:43:47 +02:00
Sami Mokaddem 368aa2f128 feature: Added support of extended event in event graph 2018-04-16 12:02:43 +00:00
Sami Mokaddem e14df3d066 Merge branch '2.4' of https://github.com/MISP/MISP into ref_graph 2018-04-16 11:15:06 +00:00
iglocska 1ec6412709 fix: Removed the validity check for the event UUID in the extended UUID field 2018-04-16 10:48:16 +02:00
iglocska c34067b8a7 fix: If no extension uuid is added to an event the editing via the UI would fail 2018-04-16 10:19:18 +02:00
iglocska 6e06642f6a chg: Added the command line functions to the automation page's parameters via the controller 2018-04-16 07:56:39 +02:00
iglocska 72f261a9b1 fix: Potentially fix an issue if no extended UUID is passed on edit 2018-04-11 16:44:59 +02:00
iglocska caf53e0c7f new: Extended event first iteration added
- when adding/editing an event, add another event's UUID as an extended event UUID to extend the targeted event with the current
- extender events can be viewed in the merged event view
2018-04-10 18:43:09 +02:00
Sami Mokaddem 4f96fb50a1 Moved event graph into its own view file 2018-04-09 15:41:13 +00:00
Sami Mokaddem 6ee5419297 feature: Draft of generic graphing from any key 2018-04-09 09:12:26 +00:00
iglocska 1cf495c201 fix: Fixed missing reason for failure if the freetext import had a single attribute fail during the saving process, fixes #3141 2018-04-07 23:57:23 +02:00
Sami Mokaddem f3b2741843 feature: Support of Tags in the event graph 2018-04-06 14:44:40 +00:00
Sami Mokaddem 921224ed40 Merge branch 'quick-fix-metacategory-graph' into ref_graph 2018-04-06 07:50:27 +00:00
Sami Mokaddem 3933baf9c9 Compute graph serverside 2018-04-04 13:12:16 +00:00
iglocska ed70624354 new: Added event/attribute add/edit to the restresponse describe functionality 2018-04-02 21:53:08 +02:00
Sami Mokaddem 5e83caf8fb Added retreiving of object templates in order to let the user choose the field we want to see in the event graph 2018-03-29 16:05:19 +00:00
iglocska 74937ea934 fix: Fixed the contactination issue from before 2018-03-28 11:41:27 +02:00
iglocska 9a692346a3 fix: Fixed a crappy event concatination bug for restsearch 2018-03-28 11:35:31 +02:00
StefanKelm 6ae842a0a4
Update EventsController.php 2018-03-27 15:40:34 +02:00
iglocska 6e7def472b Merge branch '2.4' of github.com:MISP/MISP into 2.4 2018-03-26 17:02:43 +02:00
iglocska d97e42296f new: Add event last modified to the event view 2018-03-26 17:02:03 +02:00
John Doe 606b18562b Pass attribute uuid to enrichment modules 2018-03-26 09:56:37 +08:00
iglocska 65385eb323 new: Added STIX 2.x import to the GUI 2018-03-23 14:37:43 +01:00
iglocska 5df34ea17d fix: Handle edge case scenarios where orphaned correlations would throw notices in the event view 2018-03-23 11:07:18 +01:00
Alexandre Dulaunoy f0d95887a4
Merge pull request #3063 from mokaddem/ref_graph
Event graph viewer editor
2018-03-23 09:08:20 +01:00
Sami Mokaddem 6a0abcce22 Renamed script again 2018-03-22 16:56:43 +00:00
Sami Mokaddem c78fca0ede Added possibility to edit references on the fly + edit objects on their dedicated webpage 2018-03-22 15:53:53 +00:00
iglocska 66c5594fb7 fix: Fixed error message if an attribute fails validation via the freetext import tool, fixes #3052 2018-03-19 23:32:18 +01:00
root a3a6a77611 Initial references graphs commit 2018-03-19 08:44:25 +00:00
iglocska 6e1528db1a fix: added uuid to organisations in the event index
- also unset empty sharing groups from the output
2018-03-08 12:07:30 +01:00
iglocska a38bccec77 new: Allow the searching of organisations by uuid on the event index (via the API) 2018-03-08 11:43:25 +01:00
iglocska 22e6fb57a8 fix: Reworked the way tags are attached to events on the index
- solves issues with the preview when an instance has an extremely high number of events
2018-02-28 17:09:55 +01:00
iglocska 714067c621 fix: Handle the no modules enabled error more gracefully 2018-02-27 10:29:41 +01:00
iglocska 3556df7658 fix: Nicer error message when trying to add a tag to an event that doesn't exist 2018-02-26 17:52:24 +01:00
iglocska 032844321c fix: Misleading failure message when failing to create Attributes partially fixes #2955 2018-02-25 23:20:37 +01:00
iglocska 10bd1f69c4 new: Allow requesting of misp standard format for the export modules
- just set the `require_standard_format` to true in the moduleinfo disctionary
2018-02-21 11:42:30 +01:00
Andras Iklody 297fe776fc
Merge pull request #2934 from cvandeplas/fix/modules-api
fix - allows upload of files using the misp-modules API
2018-02-18 10:07:21 +01:00
truckydev c247cfb77d
don't exlude attributes with non-exportable tag
exclude filter on attributes when tag is non-exportable
2018-02-15 17:17:50 +01:00
Christophe Vandeplas 637a500c1e fix - allows upload of files using the misp-modules API
See also #2719
2018-02-14 13:40:04 +01:00
iglocska 9af6130d43 new: Added STIX import directly to the UI 2018-02-09 11:30:28 +01:00
iglocska 23937eebb9 fix: Fixes to several cases of handling blocked access incorrectly / non-gracefully
- As reported by Christophe Vandeplas

- stix export: Ungraceful handling of attempted access of unauthorised event (no unauthorised data returned)
- import module: Allows creation of proposals to unauthorised events (no unauthorised data returned, proposals are for new attributes only meaning no automatic override triggered)
- saveFreetext: same as import module
2018-02-06 16:37:37 +01:00
iglocska 010557b042 new: Added returnMetaAttributes flag to the /events/freeTextImport API
- directly returns the raw parsing data instead of creating the attributes if set
- 177 days, 23 hours 40 minutes faster implementation than expected by @ilmoka - #PMD
2018-02-02 15:33:07 +01:00
iglocska a7f3bb7f76 fix: Load orgc data after attributes are loaded in search csv export
- functionality still needs further fixes, WIP
2018-01-25 07:45:38 +01:00
iglocska 00f711a86c fix: Fixes the object issues pointed out in #2543
- Shoutout to the debug hero finding them: @StefanKelm
2018-01-19 16:25:39 +01:00
iglocska 7f29a9a74b fix: Fixed a set of issues with sharing groups that lead to synced events not saving/updating 2018-01-18 23:34:04 +01:00
iglocska 3430383583 fix: Add timestamp to the CSV api 2018-01-18 15:59:13 +01:00
iglocska b18b64e833 new: Filter the event index on sharing group IDs, fixes #2845 2018-01-18 08:38:23 +01:00
iglocska 23adc990b9 new: Automatic cateory switching based on currently selected types for the freetext import/module triage screen 2018-01-17 10:15:23 +01:00
iglocska a7aa2358b2 fix: Remove the option for disabling sightings - it's an integral feature of the MISP core. Fixes #2820 2018-01-16 12:50:01 +01:00
iglocska 4e0fe770a7 fix: Removed debug 2018-01-15 11:11:58 +01:00
iglocska 637e2dda2d fix: Clarify scope for filter options in quick search 2018-01-15 10:59:44 +01:00
iglocska a2205fba31 new: Limit modules to a single organisation
- new settings in serverSettings
2018-01-13 12:22:14 +01:00
iglocska fee672dd76 fix: quickfilter should include attribute level tags too 2018-01-10 09:57:37 +01:00
iglocska 7b8da4979b fix: Pagination on event attributes didn't load the feed correlations 2018-01-09 14:00:50 +01:00
Andras Iklody d94c379f37
Merge pull request #2719 from cvandeplas/2.4
basic support for misp-modules via API
2017-12-19 20:07:26 +01:00
Alexandre Dulaunoy 710fe0ba7c
fix: STIX2 export is no more experimental and can be safely used 2017-12-19 12:18:19 +01:00
iglocska 92b441f37a fix: Fixed an issue where url parameters for restsearch didn't block attributes
- url parameters are bad
- shame
- SHAME
2017-12-13 19:22:27 +01:00
iglocska c16246598d new: Add tag restrictions for a single user 2017-12-08 16:31:00 +01:00
Christophe Vandeplas 7eed575c51 basic support for misp-modules via API
- mini cleanup of FileAccessTool that's not needed
- basic support for misp-modules via API (malware-samples not supported yet)
2017-12-07 18:52:31 +01:00
Christophe Vandeplas cda57ec92d fixes issue #2698 - malware-sample fails with import modules 2017-12-07 16:04:38 +01:00
iglocska 9e32f72f6c fix: Removed the requirement for a comment from the import modules
- if the comment field is set don't override it
2017-12-06 08:49:48 +01:00
iglocska 9ad39fedee fix: removed unused variable 2017-12-06 00:21:48 +01:00
iglocska 8323071b7e fix: Moved attribute_tags in the CSV export to the includeContext flag instead of the toggle-able attributes 2017-12-05 10:22:26 +01:00
iglocska 6d0550812d Merge branch '2.4' of github.com:MISP/MISP into 2.4 2017-12-05 09:24:30 +01:00
iglocska 3e112be322 new: Various improvements to the CSV export
- The @FloatingCode and @ilmoka care package
- Improved CSV performance for instances with large number of events
- Added "value" filter for CSV (use-case: I want all indicators for this value with context)
- Added attribute tags to the output of the CSV export
2017-12-05 09:21:31 +01:00
iglocska 8bb1fd678e Merge branch '2.4' of github.com:MISP/MISP into feature/tag_filter_rework 2017-12-05 00:09:37 +01:00
iglocska 4f6dba5f35 new: various improvements
- use the feed uuid caches to link directly to affected MISP events
- various UI improvements
- Feed preview pagination / POSTed event ID filters added
2017-12-05 00:05:11 +01:00
iglocska 05a89f5e87 Merge branch '2.4' into feature/tag_filter_rework 2017-11-30 22:28:35 +01:00
iglocska e760ba7b6a new: Add the possibility to limit fields for the CSV export via POST requests 2017-11-30 19:12:14 +01:00
iglocska 3b893d3b69 fix: Fixes to various issues with adding proposals via the freetext import tool
- no feedback on whether the resulting dataset will be stored as attributes/proposals
- unpublishing of the event when proposals get entered
- alerting the event creator of new proposals if coming from the freetext import tool
2017-11-29 07:59:09 +01:00
iglocska 678eecf224 new: Add attribute tag filters to the fetchEvents() functionality
- tag filters now filter on:
  - all events cotaining matching tags on event + attribute level (positive lookup)
  - all events not containing matching tags (negative lookup)
  - filter attributes within a matched event for blocked attributes (negative lookup)

- moved tag filtering to subquery filtering - should improve performance massively on larger instances when filtering on tags

- first round of implementations, more on the way
2017-11-19 21:21:32 +01:00
iglocska d09edd434c fix: Fixes an issue where assigning sharing groups based on existing IDs didn't work for event creation via the API
- expected full sharing groups as provided by the sync, references didn't work
2017-11-17 13:31:55 +01:00
iglocska 27e3faeba5 fix: Fixed silly lookup with injected event IDs on the export page for normal users
- broke instances with a few hundred k events
2017-11-13 16:32:28 +01:00
Andras Iklody 97b0edcbfd
chg: pass event_id to import modules, fixes #2612
As described by @Vince147
2017-11-03 08:43:16 +01:00
iglocska 08d71413cb fix: Fixed default distribution for upload_sample(), fixes #2608 2017-11-02 07:52:55 +01:00
iglocska 7f5c03f007 fix: Convert - to _ in csv headers
- to match the previous output
2017-10-28 19:10:34 +02:00
iglocska c02f91722f fix: Add the object fields by default to the CSV export 2017-10-27 17:53:37 +02:00
iglocska 6cd0a29f02 fix: Fixed the CSV field name for date 2017-10-27 16:38:39 +02:00
iglocska 35ad0f2f57 fix: Fixed an issue with the CVE export if no field parameters were passed 2017-10-27 16:14:37 +02:00
Cédric Bonhomme 96635dca78
the last useless coma 2017-10-27 11:16:42 +02:00
Cédric Bonhomme 5ac042da67
harmonizes arrays initializations 2017-10-27 11:04:57 +02:00
Cédric Bonhomme 9e93b61838
Enables the user to select the attributes to be included in the CSV export (event and object attributes). 2017-10-27 11:00:32 +02:00
Richard van den Berg b5972fb6e7 Speed up tag searches, fixes #2407 2017-10-20 14:22:22 +02:00
iglocska 7372831614 fix: Fixed a bug with the restSearch API 2017-10-13 16:56:13 +02:00
iglocska 0efa2bef1a new: Rework of the feed correlation lookups for the event view
- massive performance boost by using redis pipelining
- for events with 10k+ attributes, show truncated feed correlation lookups, informing the user about the number of correlating attributes and a boolean flag on attributes saying that they correlate
- The overall feed correlation counter also allows users to pivot to a view that loads all correlations, though it should be used with some caution as it can be somewhat heavy
2017-10-11 11:12:34 +02:00
iglocska 483c8704ac new: Added first experimental STIX 2 export implementation
- kudos to @chrisr3d for digging into the deepest bowels of the scary beast that is STIX2

- PoC, definitely needs further improvements/mapping. Let us know about issues you find!
2017-10-08 20:29:50 +02:00
iglocska fa7d3fdb36 new: First round of updates to the correlation engine ready
- node deletion temporarily disabled until a bug is resolved
2017-10-08 19:50:28 +02:00
iglocska f5bcd37944 Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2017-10-08 15:32:57 +02:00
iglocska a399ef1186 new: Further work on the graphing engine 2017-10-07 16:18:39 +02:00
iglocska 5290214c9b new: First iteration of the graphing engine rework 2017-10-06 10:05:00 +02:00
iglocska cd9fe1883e fix: Some cleanup of the attribute filtering 2017-10-05 11:59:59 +02:00
Tristan METAYER 66a43f5511 Add an imput for search on all attributes in an event.
field to search can be modify in administration page.
2017-10-04 19:07:58 +02:00
iglocska 09dd5b12c0 fix: Fix some restsearch filters fetching the same event more than once 2017-09-29 16:37:24 +02:00
iglocska 6a12f122db fix: Corrected filename for array of events 2017-09-29 16:10:38 +02:00
iglocska b658c20b75 fix: Flatten events for the correlation graph 2017-09-26 10:18:04 +02:00
iglocska 9e71fbb5f7 fix: flatten the events for the restSearch API's lookup functions
- otherwise valid events that only contain objects get blocked
2017-09-25 14:00:17 +02:00
iglocska 3f76fd6ea7 new: Rework of the attachment uploader
- add attachments and upload_sample now share code
- allow the same features via upload_sample (object creation / use of advanced add attachments)
- new flag: advanced

- example:

  POST to mymisp/events/upload_sample
  BODY:
{"request":{"files": [{"filename": "bla.exe", "data": "U3RhckNyYWZ0IElJIGZvcmV2ZXI="}], "distribution": 1, "advanced":1, "info":"bla"}}

- this commit was brought to you by CEF and

MMMH$= -  .,   ,,.          %H++  ,= %%$$$$X+ ;=== .=  :+HHHMMMHMMM####MMH@@@@@@HHH$=      HHH@HHHHH+XXX$$$$$$$$XXXXXXX+
MMH = -.  . ,-,,-,.         :H@H  =;;++$HH+XX$%+X%+$++=:=.XH@@@HMMMMMMMMH@@@@@@@HHX$   ,X@@@@@@@HHHHHHHHHHXXXXXXXXXXXXXX
  . ---,  -    ,,,            +@ .. ;++$HH+HHH++$+++HH+++, .+%HHMHHHHHHHHH+%%%++++$+   +++HHHHHHH+++++++++HHHHHHHHHHHHHH
- -- ,,,  --,. -                 , ,; +$XHH@@@@HHH@@@HHHH+$+$X+HH+$$+ ;  ;=  .    %   +  ,+$X+++XXXXXXXXXXXXX++HH+++++++
---==,,--,-,-., :     .          -,,:/ $XHH@HMMMMMMMMMM@HHX$H@MHHHHX+H%%$%+H/:.%. $. @,,,. $$XXXXXXXXXXXXXXXXXXXXXXXXXX+
  =  - --,,   , --   ..             =/ +$+H@@HMMMMMMMMH+H+++HHHHHHHH@+++++H+X++X+$$  = ,,, - $$XXXXX$$$$X$$$$$$$$$$$$$$X
====== --,,,, ,= =              ,==== ++$$+HHMMM####MH+$$+++HH@+HH@MHMMH@@H@@@HH+$+    ,,, ,. $$+$++$$$$$$$$$$++$$$$$$$X
 :==-===-,. ,., ==   .           :;; +++%$+H@HMMMMMMM%$%$$$+H@@+HH@MMMMMM@@@@HHH++H. .,,-,,--=/+$$%%%%%%%%$+%%$$$$$XXXXX
,  =  ==- -  .  ==             . =; ++++%++HHHHHHHHHH++%$$X+@@H+HHHMMMMMMHH@@@+X+    , ,,,,-  , ,$$$$$$$+++++$$$$XXXXX$$
,,-       ,    --=    ..       . ;/ ++++%$X+HHHHHHH  ++$++X+HH+X+H@HMMHHHHHHHH+.       ,,  ,,  , .    +$$$$+%+$$$$$$$$$$
,-----=-=--,   ,==             ..;/ +% +%$XX+HH++HH+/+$%++H@@HHXHHH@@@@@@@@HXX  .   .,,,.  ,,,,     ,-=$$$$$$$$$$$$$$$$$
 - ,- --  -,   ,-=     .         =/++%++%+++++XXXXX$$+.  +HHH@+$XHHHHHHHHH++$        -,,,  ,,      ,,,.   ,+$$$$$$$$$$$$
 ---,-----, .   ==               =/+%+++%++$$+++$X$$$$++,$$+++XXHHHHHHHH+X$+%       ,-,-,        ,,    .  .  ,+$$+++++++
== --, -- =--, ,,=          .    ./++$$++$+X$+/++$$XXXX$$$$XXXXXXH+HH+H+X$%%/     .,,,,,,    ..  ..    ,. ,,,-=+%+++ /++
+   -- -  -,,-  .,    .  . .      = +$$++++HH+.  ,+$$+++++++$XX$X$XHHH+X$$+      ..--,-    .. .        .    ,-, = ======
MH - ---- --,,,    .       .. ,      %++$$X++++ +%++++++++%++$$$$$+H++X$$+        --,    .         .   .        =  .====
MM=,-, ---,,,,,    . .     ...,,,   =/++%$$XXXX+/+++@@H@HX$+%$$+HHHHH$$$+:       ,--    .     ,. ..       .. ==::;=-:;;;
MM+ ,----,,,,              , .. ,.      +++X+HH+++++%++$++++$$+HHH+++$$          ,-          ,   .       .   : ;/ +%+.
MMH ,-,-,, ,,.        .    -,     =     = +$+H@HH++++$$X$$+++HHH+++$                       ,    ..       ,  +++++++%%+%+
MM@,--,-,,,,,. .     ,,     .    ,-,    .=+$XHHHXXHHHHHHHH@@@@HX$%+:          ,, .      ..,,  .....    ...%%%%++%%%%%%%%
M@@== ,,,  ,                               ++++XX++HHHHHH++HHH+,              ,         ,  .  ....     . +$+%%%%%%+%%%%%
H@H+=,,,  ..                                  ,,+%$+H@HHHXX++,               ,         ,,  .  ...   . ,$$$$$%%%%%+%+%%%%
@H+,-,,.....       .                          .,.;; ++$$X+%+:-              ,  .     .,,,  .  ...   . XXX$$$%%%%%%+%%%%%
+++ -, . ...                             .  .======== === ,                          ,, . .  ..   . -,XXX$X$+$+%%%%%%%%%
$+     .                                ===:; ++++ ++++-,.  ,                       ,-,          .  $X+XX+XXX$$+%++%%%%%
++: ,. .                         ,-,,-==:; %%%%%+%$$%$$X$$$+%+:==        .        . ,,           ..+X$XXXXXX$$$+%%$$%%%%
=:                              ,,,  ==   ++++++$+$$%+++$$$++$+ . ==     .        .,,,             +$$$$$$$$$$$$$$+$%%%+
 ,                          ,---, =:;/++$$XX$$$$$$X+H@H@HHH$%%%$X$++;===== .      .,            .. +%%+$++$%$$$$$$%%++%+
                               ===; +++$$$$+ +%+++%+HH@@@@HH+++ ++%+$+,  ===      ..             ,=;   +++++++++..   :;;
                      .   =:;   /++%$$++,  ,++HHMMHH@@@@HHHH@HH++++++ ,+$$+ .     ..                :=;;:;;;;;==========
                  .,,-==;;;+%  %%+$$$$ /+++@@@@@@@@@@HH@M@MH@@@HHHHH$$% /%$XXX$X  .                -=====::::=========::
                .    =;  ++++++$+++  , +%H@@@HHH@HH++HHH@MHHH@HHHHHH++++ , +%%+$                    ,, -       --- ==:=:
               ====;    ++++$$+%  ++H@HHHHHHH+X++X++@@@HHH@MMMMHHHHHH@HHHH+++++.                        ,,,,-,--- =:==;;
     .,., ==;// / ++++%+%+%+++$$+@H@@@@H@HHH+XXX$%+HHHH@@HH@HMMMMMMMMMMMMMMH@+%;                       ...,,,,,--==;;;/;
 .  ...=    .,+%$++%+$XXX$++%+++H@@@@HHH@HHH+++.   ++++H+HHHHHHHMMMMMMMMMMMM@++:                            ,,, ===;;;;;
==: .  ++++++++HH%H+++X++HH+H@HHHH@HHHHHHH+++++%++%%+%%++ . ,   = ++$H@@HMHMMH%=                                .  ..,,=
+++%$XXHHHHHH@H@@@@@H@HH@MMM@@HH@HH+HXH@HH%%+HH+XX$$$+++/;:=== ,,,,,, = ::; % :,                                   ...,,
%+++HHH@HHH@@HMHHHH@HHHMHMHHHHHH+XH+HHH++++HHHH@HHHHH++%+ -,  = ,=== ,,  ,,, .
H@HHHH#M#M#MHHHM#MMMMMMMHHHH@H@H++@H$+++HHM#MMMMHMMH@@HHHHHH%+++++%%%+++    ,  .
%%%%%%%%%%%%%%++++%%++   ..   ...  ..  .                                   +++%+++++++%++++%+++++++++%+%++%+%%++%++++++%
2017-09-25 12:22:19 +02:00
iglocska b5c4d0749b new: Added object relations to the CSV export 2017-09-19 16:50:56 +02:00
iglocska b442a273fc new: Further progress on the synchronisation 2017-09-07 12:20:20 +02:00
iglocska 89bc6d1690 fix: Fixed the empty event warning if an event only has objects but no attributes 2017-09-05 10:41:55 +02:00
iglocska 40ea22a272 Merge branch '2.4' into objects_wip 2017-09-04 17:38:06 +02:00
iglocska 2f02097590 fix: Fixed an invalid user call in the paginator 2017-09-04 09:01:08 +02:00
iglocska 52bf961dea Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2017-08-31 16:45:01 +02:00
iglocska bb4f74bb1a new: Massive performance improvements to the restSearch API
- smarter choice of pre-filtering gives a huge boost for non attribute level parameters
- caching the results of certain parts of the algorithm
- cleaned up some inefficient looping merges
2017-08-31 16:43:20 +02:00
iglocska 5d2c8822ad fix: Fixed a bug where /events/uuid would return the incorrect event. 2017-08-28 20:39:06 +02:00
iglocska 8474913862 fix: Slight improvement to event uuid lookup on the event view 2017-08-25 14:38:58 +02:00
iglocska 78f49e5e62 new: Added back referencing from a referenced object
- also fixed some view file issues
2017-08-24 07:49:11 +02:00
iglocska d3d6566b16 new: Various new features for the objects 2017-08-23 11:57:40 +02:00
iglocska 961bc76393 Merge branch '2.4' into objects_wip 2017-08-21 10:17:16 +02:00
iglocska 50a3d78c81 fix: Fixed a group by issue with the event filter overlay 2017-08-17 10:57:18 +02:00
iglocska ead2b9e1fd fix: Various fixes 2017-08-10 11:11:33 +02:00
iglocska aa07299abe Merge branch '2.4' into objects_wip 2017-08-10 07:29:50 +02:00
iglocska 0e7dd2eddc new: Added first iteration of object references and other changes
- various fixes
- rework of the pagination library
2017-08-09 17:53:25 +02:00
iglocska 952fff6252 fix: Fixes to several cases of reflected XSS, fixes #2381
- as reported by @import-au

- Additionally enforce content-type on all async APIs called by the UI using CakeResponse
2017-08-08 21:37:03 +02:00
iglocska f4c02e60f5 fix: Nicer response for the API to push events to ZMQ 2017-08-03 17:09:04 +02:00
iglocska 23e777c661 fix: Fixed a typo in the pushEventToZMQ function 2017-08-03 17:05:30 +02:00
iglocska 0097e040b1 fix: Previous commit was incorrect, empty filters contain null not false 2017-08-01 01:05:45 +02:00
iglocska 3e4fbcf5ff fix: Fixed "published":0 filter for restsearch
- also removed an empty function
2017-08-01 01:02:25 +02:00
iglocska 091175133b fix: GFI uploaded archives don't throw exceptions on failed parsing, instead simply show an error banner after redirect
- in situations with misconfigured MISPs (debug enabled), a parsing error
  exception thrown while parsing a maliciously malformed archive could include
  arbitrary files in the stacktrace accessed from within the apache user's
  scope if a symlinked file was uploaded in the archive

- Thanks to cert.govt.nz for the security report.
2017-07-12 15:44:02 +02:00
Kevin Allix 2248846706 attachments_dir: Default value queried through a function to workaround PHP inability to have anything useful stored in a class property 2017-07-10 12:42:23 +02:00
Kevin Allix 1ea33e811a Add an optional setting attachments_dir, and adapt existing code to use that setting 2017-07-07 17:29:13 +02:00
iglocska 154549efd9 fix: Accessing a pivoted event view URL without having the pivot path tracked in the session threw a notice 2017-06-29 07:42:26 +02:00
iglocska 483f425584 fix: JSON export via the UI should download a file, not render the JSON 2017-06-28 10:19:36 +02:00
iglocska 94ee61358c fix: Fixed the invalid CSV download filename 2017-06-28 09:53:34 +02:00
iglocska e72bbd7e07 fix: Removed silly duplicate queries from the event index 2017-06-19 11:12:15 +02:00
iglocska 57857c3a32 new: Performance improvements for the pub-sub modules
- Only load and open connection to redis for the pub-sub connection once.
- Massive performance boost when the ZMQ functionality is enabled
2017-06-16 08:41:12 +02:00
iglocska e56dc0d046 fix: fixed error messages for the CSV export API 2017-06-15 14:21:42 +02:00
iglocska bb20f232f8 fix: New way of checking for API access
- meant to resolve some issues such as being redirected to the news page if a new news item exists while running a CSV export via the API
2017-06-15 09:57:46 +02:00
iglocska 7f818c7e82 new: Add adhereToWarninglists as a JSON parameter to the freetextImport API 2017-06-13 15:15:19 +02:00
iglocska 3d74dbee28 new: First round of massive performance tuning (tm)(c)
- Make MISP fast again
2017-06-09 15:38:45 +02:00
iglocska 6fad375685 new: Mass delete events
- simply use the multi select on the event index via the UI
- for the API, simply POST to /events/delete with a payload in the following format:
  `{"id": [15, 16, 17]}`

- if you've accidentally deleted all your events using this functionality, feel free to contact @rommelfs or contact the NSA for backups
2017-06-01 09:45:10 +02:00
iglocska c52439b572 new: Publish event to ZMQ on demand and beaconing of ZMQ tool 2017-05-30 17:16:41 +02:00
iglocska 66613dd38f fix: Fixed a few silly issues with the hids export
- allow POSTed parameters
- simpler response always responds with txt type, won't complain about view not being set for incorrect accept headers
2017-05-22 15:03:56 +02:00
iglocska ccde4a8770 fix: hids api threw error on empty result 2017-05-22 14:47:57 +02:00
Andras Iklody c61b58ae73 Merge pull request #2200 from RichieB2B/ncsc-nl/openioc
Several fixes for OpenIOC importer
2017-05-18 17:24:29 +02:00
Richard van den Berg ac7b95380d Set OpenIOC attribute distribution to 'Inherit' by default 2017-05-18 17:10:44 +02:00
iglocska 81141ed4e0 fix: Fixed an issue with the freetext importer failing if no tags were set 2017-05-12 06:51:52 +02:00
Tristan METAYER e71045571c add possibility to define tags for import module.
Add possibility to desable validation for String field when empty
2017-05-10 19:51:27 +02:00
iglocska e34634201b fix: fixed an API vs documentation mismatch for the nids exports 2017-05-10 16:35:17 +02:00
iglocska 96574ec335 new: First implementation of the feed analysis system 2017-05-08 14:22:27 +02:00
iglocska 7b24077245 fix: Missing parameters for getenabledmodules 2017-05-03 14:41:39 +02:00
iglocska 26d3e2a0c2 fix: Fixed a failure with cortex modules (hopefully) 2017-05-03 14:27:23 +02:00
iglocska 9ccdc579a6 new: New module type: Cortex
- similar to Enrichment modules except for not having the options to run hover
2017-05-03 13:13:36 +02:00
Andras Iklody 120265b185 Merge pull request #2154 from truckydev/2.4
Add filename key for import modules
2017-05-02 14:34:06 +02:00
Tristan METAYER 98aafc3c49 add test for empty filename 2017-05-02 14:30:53 +02:00
iglocska ec83f378da new: Use /events/freeTextImport/eventid via the API to directly parse and create attributes from the input
- expected format is {"value": "my_string_to_parse"} with "distribution" being an optional value (otherwise instnace defaults are assumed)
2017-05-02 11:02:11 +02:00
Tristan METAYER 9c349caa44 Add filename key for import modules 2017-05-02 10:56:21 +02:00
iglocska ecf00e8c65 fix: Fixed an issue where certain filters removed some elements from the object counter, fixes #2151 2017-04-27 17:09:26 +02:00
iglocska d33b3b1434 fix: Left off controller changes in the previous commit 2017-04-27 16:13:00 +02:00
iglocska f3785d2366 fix: Allow event edits even if the "Event" container isn't set 2017-04-26 15:12:25 +02:00
iglocska c60cc785f4 fix: Fixed the publishtimestamp filter issues with the event index
- allow for publishtimestmap and publish_timestamp due to some documentation issues
- fixed the lookup to be greater than by default instad of lower than
- added the option to pass a range by passing an array with a start and end publish timestamp
2017-04-25 09:46:35 +02:00
iglocska 9b3bfd1fd4 fix: Added missing distribution defaults to the import modules 2017-04-20 10:34:00 +02:00
iglocska 17f6fba976 fix: Fixed a format issue with the minimal index 2017-04-13 21:31:23 +02:00
iglocska e638c5350a new: Minimal flag added to the event index
- used by the sync, greatly reduces the data fetched / transfered on the initial sync negotiation
2017-04-13 15:09:29 +02:00
iglocska aa7375cd74 fix: Fix to the correlation graph after the relatedevent format changes 2017-04-12 10:59:13 +02:00
iglocska e7f2944918 new: Added new flag to events/restSearch to disable sharing group loading
- sgReferenceOnly: Will only load the sharing_group_id not the actual sharing group data
2017-04-12 09:52:09 +02:00
iglocska 9a2aaf9a1c new: Set distribution level in freetext results / module import results, fixes #2023 2017-04-11 15:02:40 +02:00
iglocska 0b0f793dc9 fix: Fixed an invalid JSON serialisation for restSearch 2017-04-04 17:21:55 +02:00
iglocska 3b6807ef72 new: Rework of the restsearch APIs
- allows for alternate download types (supported for now: openioc)
- major refactor of the openioc export
- refactor of the CIDR tool
2017-03-31 19:27:34 +02:00
iglocska 958a667d0a fix: NotFoundException when no events found by restSearch, fixes #2096
- changed to just return an empty set
  - returns {"request":[]} for events/restSearch
  - returns [] for events/restSearch
2017-03-30 18:37:50 +02:00
Mathieu Deloitte a4018780fa New variable includeAllTags added to NIDS export: even not exportable tags could be included in NIDS export 2017-03-22 11:09:49 +01:00
iglocska 1567504896 fix: Typo fixed 2017-03-02 14:55:09 +01:00
iglocska 62cb2b66b6 new: Added a way to disable cached exports server wide for low disk space instnaces
- But please consider just adding some more space instead..
2017-03-02 10:49:18 +01:00
iglocska d70d5f6a3b fix: pushProposals requires that the user has perm_add permissions 2017-03-01 15:45:27 +01:00
iglocska b74548185a Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2017-03-01 15:42:07 +01:00
iglocska c7f4686ab8 chg: Quick deletion of events
- uses prepared statements instead of the framework's cascading delete
- utterly massive performance boost
2017-03-01 15:39:42 +01:00
kx499 0b2b49d6f4 Updated comment for enrichment modules to refence value used for enrichment for added context 2017-02-26 13:21:08 -05:00
iglocska 3fca8de6bf new: Added activity charts to tag and galaxy cluster indeces
- bunch of small improvements additionally
2017-02-24 19:34:18 +01:00
iglocska a59aab9b23 fix: Re-added the accidentally removed code in a merge, fixes #1965
- affects f0e1a27b7d
2017-02-20 18:43:36 +01:00
iglocska 4e41b55572 new: First iteration of the improved sightings 2017-02-05 23:48:18 +01:00
iglocska ee80ecfce7 new: small rework of the thread functionalities
- API get /threads/view/<thread_id> and /threads/viewEvent/<event_id>
- Added new setting to show post count on the event index including a notification if it has a post newer than 24 hours
2017-02-01 15:32:22 +01:00
iglocska 1f9a631182 fix: Added missing view file, some small fixes, pymisp version bump 2017-01-31 10:54:33 +01:00
iglocska ad472e8c4b fix: Removing tags now spans its own CSRF tokens in the confirmation popup
- fixes some CSRF issues
- improves rendering performance
2017-01-31 09:58:21 +01:00
Iglocska 2a13bf24a3 fix: Temporary fix for no relatedattributes producing an empty string instead of an empty array in the retrieved data 2017-01-18 11:24:17 +01:00
Iglocska 0960791008 Merge branch '2.4' into feature/attribute-tagging 2017-01-17 14:52:59 +01:00
Iglocska 770b69dbc2 fix: Fix a unicode issue with the correlation graphs 2017-01-17 14:50:39 +01:00
Iglocska 0f7d37ce04 fix: Fix an issue with the graphs when no relations are found 2017-01-17 14:22:25 +01:00
Iglocska 5eeb1c85a9 chg: Use cakeresponse for JSON response in updateGraph instead of serialize 2017-01-17 14:06:23 +01:00
iglocska 4ad022b03c Merge branch '2.4' into feature/attribute-tagging 2017-01-16 16:15:06 +01:00
iglocska a5663dfc07 fix: Fixed the editing of tags using the rest API 2017-01-16 16:05:19 +01:00
Iglocska be4d8ed54f chg: Allow disabling/enabling publishing of events imported via the UI, fixes #1845 2017-01-16 11:02:23 +01:00
Iglocska d537fa4447 fix: Edit events by uuid instead of id, fixes #1842 2017-01-15 09:05:17 +01:00
Iglocska c3225e0679 fix: Only allow malware-samples to be created using the upload_sample api, fixes #1843
- contrary to the documentation, setting the IDS flag decided the type of the resulting upload (malware-sample vs attachment)
- attachments can easily be created without any black magic using the add attribute api anyway

- also fixed a bug that prevented the timestamp of events receiving a sample via the upload_sample api from being re-timestamped
2017-01-15 08:56:02 +01:00
iglocska da433c3549 Merge branch '2.4' of https://github.com/MISP/MISP into feature/disable_correlation 2016-12-22 21:01:58 +01:00