Commit Graph

2005 Commits (704880ce590964e6eb95a3d639cfdcc044bd7ffd)

Author SHA1 Message Date
Iglocska 704880ce59 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Server.php
2015-08-30 13:29:05 +02:00
Iglocska 597e40fc0f Collection of fixes
- CSV export ignored the tag parameters
- tagging events didn't work as expected in some cases
- timing out and clicking on an admin action results in being redirected to a non-existing admin login page
- distribution setting ignored when uploading attachments
2015-08-27 09:44:58 +02:00
Iglocska bc4bc46fca Fix to the previous hotfix
- indexes were not created if they already existed
- this was an issue if a non unique index was present

- also made the process more verbose and added a generic method that deals with index removal
2015-08-25 11:56:29 +02:00
Iglocska 556688069a Resolved an issue that can lead to duplicate events showing up in MISP
- UUID uniqueness was previously not enforced
- changed the MYSQL.sql file to reflect the changes
- Added upgrade admin tool to remove duplicate events and make the database changes required
- Tweaked the tool for the attribute uuid fix so that it cannot created duplicate keys

- some minor fixes, such as automatically removing eventTag objects on event deletion
2015-08-25 10:32:26 +02:00
Iglocska 64485ad4a6 Fixed a bug with downloadSample that returns all accessible samples instead of the requested one, fixes #610
- fixed incorrect branch order causing this issue
2015-08-24 13:29:25 +02:00
Iglocska bd7555b185 Various fixes to the OpenIOC import and the password reset, fixes #600, fixes #599, fixes #565
- OpenIOC import now correctly sets IDS flags based on type
- OpenIOC import specifies the source file in the comments

- Fixed a blackhole issue with the password reset popups
2015-08-19 13:20:14 +02:00
Iglocska ebbc7390d1 Added event ID field to restSearch APIs, to assist #456
- eventid a new parameter for both event and attribute restsearch
- these APIs now accept arrays in both json and xml format (you can send "eventid": ["15", "16"] instead of "eventid": "15&&16" in addition to the old functionality
2015-08-18 19:51:41 +02:00
Iglocska ce2e6a769d Some fixes to the OpenIOC import tool
- added support for SHA types
- fixed an issue that caused the import to fail with duplicate attributes (the list gets pruned now)
- fixed an issue where no supplied contextual fields would lead to empty attributes being created
- removed the requirement for the files to have the .ioc extension
2015-08-18 17:16:58 +02:00
Iglocska 266e656bab Fix to a new bug introduced with the blacklisting that can prevent new events from being added via the UI 2015-08-18 16:24:50 +02:00
Iglocska 76b8aacc4c Added event ID/UUID to the event filters and attribute search
- enter a UUID in the event ID field of the attribute search to find attributes belonging to a certain event
- use event IDs / UUIDs to filter events on the event index
2015-08-18 15:37:49 +02:00
Iglocska 80dcdcf9d8 Database update admin-actions are now logged and if they fail the errors are logged 2015-08-18 09:44:59 +02:00
iglocska a93807439d Several bigger changes
- new functionality: Event blacklisting by UUID
  - site admins cna enable this feature in the server settings
  - enabling the feature will make the required db changes
  - any deleted event will automatically get blacklisted
  - this prevents deleted events from flowing back from a synced instance
  - site admins can manually add UUIDs to the list and remove entries

- fix to UUID duplication issues for attributes
  - simply run the admin script and it will regenerate the UUID of attributes that are duplicates, if any such exist
  - timestamps/event published status will not be affected

- config.core.php now includes a change that prevents from 404 exceptions being logged
  - the sync uses 404s to signal that an event with a given uuid does not exist when negotiating proposal synchronisation
  - this causes a dangerously high amount of noise in the logs
2015-08-17 16:10:10 +02:00
Iglocska 94398b8192 Download all samples for an event ID via the API
- as explained on the automation page
- also, better error handling

- all API calls that fail during authentication will now return a JSON/XML error message instead of redirecting to the login page
2015-08-07 16:10:40 +02:00
Iglocska 5273c2c5aa New functionality: API to download sample by hash
- simply pass an MD5 hash along and receive a sample if available zipped and base64 encoded in a response object
- pass any hash along with a flag set and receive any samples from events that have the passed hash

- Also, fix for an issue with the freetext import not using semi-colons as separators
2015-08-07 12:04:44 +02:00
Iglocska 7e10eb7b46 Some fixes to the upload malware API
- Threat level ID options correctly set
- Threat level ID validation tightened to reject anything but the existing threat levels
- The upload malware API now logs validation issues during the failed creation of attributes / events
2015-08-05 00:11:16 +02:00
Iglocska 0a26879d45 Additional parameters for the upload sample API 2015-08-04 02:30:22 +02:00
Iglocska 7db6e9ac47 A list of changes to the way attachments are uploaded, fixes #559, fixes #482
- new API for uploading malware samples
  - allows the upload of several files
  - can be used to populate a pre-existing event, or create a new event
  - expects a JSON or an XML object with the samples base64 encoded
- new way of storing malware samples
  - original filename not used any longer
  - samples are renamed to their md5 hashes
  - original filename preserved in a secondary txt file
- removed filename validation as it is no longer used for the command line execution
  - this allows unicode name files to be uploaded!
  - changed the UI attachment upload to reflect these changes
  - code more centralised and extendible
2015-08-04 02:00:21 +02:00
Iglocska 67bd44f5dc Relaxed visibility of org UUIDs and sharing groups (the latter for sync users) 2015-08-03 16:49:03 +02:00
Iglocska 3fb4c1f52d Copy pasta fail 2015-08-03 15:49:16 +02:00
Iglocska 7cc3a9a6d9 Removed SG options if no SGs exist from attribute creation/edit 2015-08-03 15:46:58 +02:00
Iglocska 43905247d2 Don't offer the SG option in the event add form if none exist 2015-08-03 14:18:02 +02:00
Iglocska ad21d5c35a Further work on the Sharing Groups 2015-08-03 14:12:20 +02:00
Iglocska 326d62d822 Added the server filters to the server creation 2015-07-30 13:11:07 +02:00
Iglocska bca26ed54c Small fix to the js scripts involved in the sync rule creation 2015-07-28 20:35:54 +02:00
Iglocska 11cd844104 UI for server filter rule editing finished 2015-07-28 14:00:38 +02:00
Iglocska a9c737ff2b Further work on the sync filters 2015-07-27 16:30:52 +02:00
Iglocska ff01eebf70 Added the same functionality to the regex edit 2015-07-27 08:26:01 +02:00
Iglocska 0874faa991 Added error message if regex is added without choosing a type, fixes #575
- user will be taken back to the form if no type selected
2015-07-27 08:13:20 +02:00
Iglocska a4ab089f50 Slightly better looks 2015-07-24 18:26:21 +02:00
Iglocska ed25d96a54 Filters shown correctly when editing a server 2015-07-24 18:19:34 +02:00
Iglocska a181f3f2a8 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
2015-07-24 16:02:31 +02:00
Iglocska d8cfbac67f Mass IDS toggle for freetext import, fixes #576
- added a toggle for the IDS fields in the freetext import to quickly set all found attributes to being IDS worthy
2015-07-23 08:33:04 +02:00
Iglocska 00005bca97 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Model/Attribute.php
2015-07-22 19:30:45 +02:00
Iglocska 616629e9b5 Fixed an issue with the NIDS export not correctly working for single events 2015-07-22 19:27:56 +02:00
Iglocska 47cc0e4d18 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Model/Attribute.php
	app/Model/Event.php
2015-07-22 18:04:02 +02:00
Iglocska 1bf2995f4e Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
2015-07-22 17:19:13 +02:00
Iglocska 684be69ed0 Incremental export generation for HIDS and NIDS exports
- Instead of fetching all events at once for the export, events are fetched one by one
- Greatly reduces memory footprint (It mostly depends on the event with the most eligible attributes now, instead of the combined list of all events)
- Because of the lower memory usage, the time taken for the export is also slashed to a fragment of what it was before
2015-07-20 16:25:16 +02:00
Iglocska 265088a0ea Merge branch '570' into hotfix-2.3.98 2015-07-17 15:09:27 +02:00
Iglocska b089cf077f Some changes to the workers
- some fixes with the previous iteration of the background workers
- PID now checked using ps -p instead of looking for it in /proc
2015-07-17 15:06:38 +02:00
Iglocska 93f9a01c87 Changes to the hids exports
- fixed some issues with unset variables (from, to, last) when triggered by the background workers
- reduced memory usage of the hids exports (removed storing the hashes twice in memory, drastically removed the data retrieved from the db when preparing the export)
2015-07-17 10:50:50 +02:00
Richard van den Berg 0b7df293ea Convert tab to spaces 2015-07-16 18:05:41 +02:00
Richard van den Berg 93c1849780 Remove unused relatedTTP 2015-07-16 18:04:39 +02:00
Richard van den Berg b126db534a Add timezone +00:00 to timestamp 2015-07-16 17:56:52 +02:00
Richard van den Berg 27d09b4e22 Change incident description to title 2015-07-16 17:53:49 +02:00
Richard van den Berg 2e1864f28d Add Indicated_TTP 2015-07-16 17:49:51 +02:00
Richard van den Berg ab2aeeb868 Add Valid_Time_Position 2015-07-16 12:55:20 +02:00
Richard van den Berg f68bd3f785 Add indicator types 2015-07-16 12:36:42 +02:00
Iglocska 1da5b71011 Some work on the new types 2015-07-16 09:18:21 +02:00
Richard van den Berg c15a178013 Add condition attributes 2015-07-15 17:10:55 +02:00
Iglocska c906cacd81 Merge branch 'pr567' into hotfix-2.3.97 2015-07-13 11:23:29 +02:00