Commit Graph

259 Commits (4fea371c4b417e6eac5cdefe0baf77840f5752a1)

Author SHA1 Message Date
William Robinet 4fea371c4b Fix permissions 2016-02-11 17:03:51 +01:00
Iglocska 97533ab272 Major speed boost to the correlation
- it seems that for some reason some conditions in the correlation lookup massacred the performance of the correlation
- doing that additional filter on a PHP level fixes it for now, but it would be interesting to investigate this further and potentially reuse the findings to improve other queries

- also fixed an issue with the indexing script failing on some fulltext fields if it has to fall back to regular indeces.
2016-02-02 09:35:14 +01:00
Alexandre Dulaunoy dc67a04305 Fixed typos for organization 2016-01-25 23:41:43 +01:00
Iglocska d4d0e6ee29 Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2016-01-18 15:18:01 +01:00
Iglocska 5bcd35ce5b Adding URIs failed because of the missing validation entry 2016-01-18 15:17:00 +01:00
Alexandre Dulaunoy 15bed1d299 pdb attribute - format is not checked 2016-01-18 13:24:18 +01:00
Alexandre Dulaunoy 4a2210526c pdb attributes added
pdb stands for Microsoft Program database (PDB) path information
2016-01-18 12:05:14 +01:00
Alexandre Dulaunoy 72bc3032d4 whois-registrant-name attribute added 2016-01-18 10:50:49 +01:00
Iglocska e85282c878 Fix to an invalid data entry pre-validation call that broke prtn attribute entry with a leading + 2016-01-14 19:46:35 +01:00
Iglocska a1f0a88707 Fixed missing validation for malware-type type attributes 2016-01-13 13:49:57 +01:00
Iglocska 6bf683cac6 FIxed several issues
- some performance tuning for the restSearch API
- fixed an issue where overriding the contain parameters in the attribute fetcher would lead to an exception
- fixed an issue where accepting a proposal would try to copy the sharing group of the event incorrectly (it now simply gets set to inherit event)
- fixed an issue with the rest search API failing when some fields were not set
2016-01-08 11:10:02 +01:00
Iglocska 62a20a2321 Fixed an issue where an event's sharing group ID would get set to the first available option even when a non sharing group distribution level is selected 2016-01-07 16:33:35 +01:00
Iglocska 6711c7441f Added malware sample to the file attribute filter 2016-01-04 10:28:41 +01:00
Iglocska 5d7aa73e27 First version of the quick filters for the event view 2016-01-04 10:23:07 +01:00
Iglocska f3d1a55702 Removed the test values for some attribute descriptions
- still needs some work, few empty ones remain and a few descriptions could use clarification
2016-01-02 20:02:26 +01:00
Iglocska 85c2360212 Merge branch 'portip' into 2.4
Conflicts:
	app/Model/Attribute.php
2016-01-01 14:17:50 +01:00
Alexandre Dulaunoy a5a142295b Typo fixed in whois-creation-date 2015-12-31 12:24:55 +01:00
Fafner [_KeyZee_] 9f4dc4b0b8 Update Attribute.php 2015-12-29 18:46:23 +01:00
iglocska 66a90cd60c Several fixes to the exports, fixes #790
- New generic fetch attribute method was mistakenly using the order field as a condition, resulting in some exports only displaying a subset of the data
  - the fix to this fixes the issue described in #790 for text exports
- Fix to the RPZ exports not working correctly
- Fix to the horrible performance of RPZ exports
- Fix to several background worker issues with exports
2015-12-26 02:50:50 +01:00
iglocska 85db894063 Left off from previous commit 2015-12-25 00:26:45 +01:00
iglocska 3061b37fc3 Fixed a serious issue with the snort/suricata export which would keep appending all eligible attributes over and over to the file instead of properly fetching them event by event resulting in a massive export file 2015-12-23 00:51:57 +01:00
iglocska cb42337f9b Merge branch '2.4' of https://github.com/MISP/MISP into 2.4 2015-12-21 10:39:39 +01:00
iglocska f963f8d7d8 Fixed a menu and some cleanup
- Freetext import was loading the wrong menu
- some leftover profiling code removed
2015-12-21 10:37:45 +01:00
Iglocska e4d3b6d1ac Removed crappy automatic CakePHP sorting from recorrelation
- /facepalm
2015-12-18 12:43:34 +01:00
iglocska e215bf3313 Slightly smarter correlation for generateCorrelations 2015-12-17 13:04:49 +01:00
iglocska dd53f7bfa2 Added default values to the log entry creation to avoid empty fields giving notices, fixes #769 2015-12-17 11:01:54 +01:00
iglocska 0a48ee2c44 Fix to the correlation peformance 2015-12-17 10:25:30 +01:00
iglocska 78d58b6cbd Changes to the generation recreation 2015-12-17 01:25:23 +01:00
Iglocska 4026627a91 Fix to the HIDS export 2015-12-13 17:59:48 +01:00
Iglocska b40e0fdc7c Merge branch 'master' into 2.4-syncrework
Conflicts:
	VERSION.json
	app/Controller/AttributesController.php
	app/Controller/ShadowAttributesController.php
	app/Lib/Tools/ComplexTypeTool.php
	app/Model/Attribute.php
	app/View/Pages/administration.ctp
2015-12-09 02:00:23 +01:00
iglocska 65faeb48d9 Further tweaks
- fixed some corner cases
- added support for the same defanging to the freetext import tool
2015-12-04 11:33:14 +01:00
iglocska 744cf50fb9 Update to attribute validation and the freetext import tool, fixes #742
- defanged URL type attributes are refanged on input
- admin script to do the same for all existing attributes

- admin tool doesn't recognise a word followed by a . as a url
2015-12-04 10:43:38 +01:00
Iglocska d433618c71 Also, enabled the filtering on pull
Merge branch 'master' into 2.4-beta

Conflicts:
	VERSION.json
	app/Controller/EventsController.php
	app/Lib/Tools/XMLConverterTool.php
	app/Model/Event.php
	app/Model/Server.php
2015-12-03 00:27:56 +01:00
iglocska 268c7683a0 Rework of the event add/edit
- allows for saving an event even if an attribute fails
  - logs attributes that fail validation

- same for edit

- add_misp_export updated with the above in mind
2015-12-01 15:39:12 +01:00
Benjamin Gathmann 9cd9259f98 added domain|ip composite attribute 2015-11-24 10:40:43 +01:00
iglocska 3cc3b4f34d fixed too restrictive generateCorrelation attribute fields 2015-11-20 01:21:44 +01:00
iglocska db359170f6 some left over merging issues among other things 2015-11-17 22:01:22 +01:00
iglocska 866641fb40 Fixed an issue with the blacklists not saving the event org 2015-11-17 00:47:51 +01:00
iglocska 1c6f45de52 Merge branch 'master' into 2.4-beta
Conflicts:
	VERSION.json
	app/Controller/EventsController.php
2015-11-12 09:26:29 +01:00
iglocska 3716b38a60 Bin number added to validation 2015-11-09 13:42:22 +01:00
iglocska cd886b4a79 Relaxed financial attribute validation
- also added 2 new types: bank-account-nr and aba-rtn
- validation is completely relaxed
- idea is to add a visual notification in the view for these attributes types if they are not valid (invalid financial indicators are still interesting)
2015-11-09 12:36:49 +01:00
Iglocska 7a686a2718 Merge branch 'master' into 2.4-beta
Also, reworked a lot of remaining distribution checks not handled by the main fetch methods

Conflicts:
	VERSION.json
	app/Controller/AttributesController.php
	app/Controller/ShadowAttributesController.php
	app/View/ShadowAttributes/add.ctp
	app/View/ShadowAttributes/edit.ctp
2015-10-30 13:39:12 +01:00
iglocska ef1d3949e7 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Controller/ShadowAttributesController.php
	app/Lib/Tools/JSONConverterTool.php
	app/Lib/Tools/XMLConverterTool.php
	app/Model/User.php
	app/View/Elements/eventattribute.ctp
2015-10-22 09:59:00 +02:00
iglocska 61e865956b Fixes to several issues, fixes #693
- Fixed a critical bug in the XML export
  - As of recently XML exports include relations as they were missing before
  - the sanitisation of the event info field in related attributes was incorrectly sanitized of unicode characters
  - this can lead to the XML export breaking and also for affected events to be blocked from synchronisation

- Proposal fixes
  - fixed an invalid uuid generation that lead to an exception
  - fixed the attachments for proposals still using the old attachment system that disallows most filenames
  - added the automatic creation of hashes for attachment proposals
2015-10-21 23:44:07 +02:00
Iglocska 044996bdb5 New feature: Proposal to delete attribute, fixes #315
- Users can now propose a deletion to an attribute
  - also tied into the mass accept mechanism
  - new UI elements to go along with this

- Code refactoring for category list retrievals
  - Until now, several methods got the list of categories from the validation code
  - Was awkward with a fake empty element that had to be removed
  - altered the validation code to read the categoryDefinitions array instead
2015-10-16 23:49:04 +02:00
Iglocska 328c666e3a Merge branch 'master' into feature/sg
Merging all the new changes from master

Conflicts:
	VERSION.json
	app/Console/Command/AdminShell.php
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Log.php
	app/Model/Server.php
	app/Model/User.php
	app/View/Elements/side_menu.ctp
	app/View/Pages/administration.ctp
	app/View/Users/admin_index.ctp
2015-10-12 09:41:20 +02:00
Iglocska dc638adac2 Upgrade to CakePHP 2.7, fixes #684
- cakephp submodule updated to 2.7
- make sure that you update your instance!

- not updating will not break compatibility
2015-10-09 15:59:25 +02:00
iglocska 6fa13b4ad0 Fix to the text export ignoring the rule to exclude unpublished and non-IDS flagged data, fixes #646 2015-09-18 10:53:03 +02:00
iglocska 14188f1367 Fix to a new bug introduced with the correlation engine
- an attribute could correlate with another attribut of the same event
2015-09-16 15:34:00 +02:00
iglocska 26e640e19c Further progress on several issues 2015-09-16 12:15:43 +02:00