Commit Graph

104 Commits (9b85428897b6930422138abcb93ee1ea65bcaeb8)

Author SHA1 Message Date
iglocska 0a48ee2c44 Fix to the correlation peformance 2015-12-17 10:25:30 +01:00
iglocska ffe8dbb011 More fixes to the background correlation generation 2015-12-17 01:40:02 +01:00
Iglocska d433618c71 Also, enabled the filtering on pull
Merge branch 'master' into 2.4-beta

Conflicts:
	VERSION.json
	app/Controller/EventsController.php
	app/Lib/Tools/XMLConverterTool.php
	app/Model/Event.php
	app/Model/Server.php
2015-12-03 00:27:56 +01:00
Iglocska 714ed198e5 Various fixes throughout the application
- org field still used in some places other than the legitimate use-cases
2015-11-28 23:49:52 +01:00
iglocska db359170f6 some left over merging issues among other things 2015-11-17 22:01:22 +01:00
Iglocska 328c666e3a Merge branch 'master' into feature/sg
Merging all the new changes from master

Conflicts:
	VERSION.json
	app/Console/Command/AdminShell.php
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Log.php
	app/Model/Server.php
	app/Model/User.php
	app/View/Elements/side_menu.ctp
	app/View/Pages/administration.ctp
	app/View/Users/admin_index.ctp
2015-10-12 09:41:20 +02:00
Iglocska e242c9add2 Set of changes to the sync
- finished preview feature
  - can now view events and attributes remotely
  - can copy over new event to local instance

- new sync mode (update)
  - allows to only pull changes to events that exist locally already
  - works well with the manual pull of events, no need to pull events that we didn't manually confirm, but can still update all events that we pulled over

- Fixed an issue with background tasks causing the logging to fail

- reworked connection test showing version numbers of both instances
  - also telling the admin whether the sync is compatible or not

- Further refactoring / tweaking of the vent view
2015-10-06 01:16:48 +02:00
Iglocska 4a75b1d2b5 Fixed an issue where the recorrelation of all events would run into memory issues
- before the recorrelation admin tool would load all attributes into memory in one go
- now it loads them in chunks of 1k attributes at a time
2015-09-24 10:36:02 +02:00
Iglocska e1a95c62b0 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Controller/EventsController.php
	app/Controller/ServersController.php
	app/Model/Attribute.php
	app/View/Users/statistics.ctp
2015-09-10 15:02:44 +02:00
Iglocska d7bab21919 Left off shell script 2015-09-10 00:30:34 +02:00
Iglocska 3feeee920e Initialise first user via the command line
usage:

/var/www/MISP/app/Console/cake userInit -q

returns the created auth key or an error message if users already exist

The created account is an admin user, with the login being admin@admin.test / admin
2015-09-09 20:52:01 +02:00
Iglocska 3fb7764c00 First revision of the upgrade scripts
- .sql file to add all the new fields / tables
- admin tool to convert the old organisation fields to the new objects
- still missing a cleanup method (to remove the old organisation fields once the conversion is done)
2015-09-02 01:34:52 +02:00
Iglocska 0481e6eb02 Merge branch 'master' into feature/sg
Conflicts:
	VERSION.json
	app/Controller/ServersController.php
	app/Controller/ShadowAttributesController.php
	app/Controller/UsersController.php
	app/Model/Event.php
	app/webroot/js/ajaxification.js
2015-06-29 14:27:16 +02:00
Iglocska ae0e1aeacb Merge branch 'feature/rpz' into hotfix-2.3.86
Conflicts:
	app/Console/Command/EventShell.php
	app/Model/Server.php
2015-06-23 17:19:08 +02:00
Iglocska c73f71f243 Merge branch 'master' into feature/sg
The merging is complete

Conflicts:
	VERSION.json
	app/Console/Command/ServerShell.php
	app/Controller/AppController.php
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Controller/PostsController.php
	app/Controller/UsersController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Log.php
	app/Model/Server.php
	app/Model/User.php
	app/View/Elements/side_menu.ctp
	app/View/Users/admin_index.ctp
	app/webroot/js/ajaxification.js
2015-06-10 22:54:20 +02:00
Iglocska b36c0da66a Timing for rescheduling of tasks changed slightly
- The rescheduling now happens before the task is executed - this way a failed job will not prevent the rescheduling of the next execution time
2015-06-03 23:49:37 +02:00
iglocska de50a99f44 Merge branch 'email-notifications' into hotfix-2.3.69 2015-05-25 10:24:04 +02:00
iglocska 2afea61ea0 Added the missing ways to exploit the rpz functionality
- rpz added to exports, both old-style and with background workers
- per event rpz functionality added
2015-05-20 16:23:42 +02:00
iglocska 644b0cd512 Password reset fix 2015-05-12 11:28:36 +02:00
Iglocska c44bee0e96 Further progress
- removed some junk
- more work on the background workers
- rewrote the correlation background job - should work correctly now and be a lot more memory efficient
2015-04-20 13:50:14 +02:00
Iglocska 93c2194e5f Some fixes to the background workers
- also added date tracking on jobs
2015-04-20 13:32:34 +02:00
Iglocska c24704a6c2 Lots of progress
- further work on implementing the SG changes everywhere
- reworked the alert e-mails
- reworked a lot of the logging
- several convenience methods
2015-04-20 11:46:55 +02:00
iglocska 51ea9c090d Further progress 2015-04-18 07:53:18 +02:00
Iglocska 28069a0a0f Further work and some cleanup
- decision to be revised: exports don't expose Sharing groups / org uuids to users unless they are admin (for the future: at least sync users have to be added for the new sync)
2015-04-13 16:20:21 +02:00
Iglocska e8bcab19db Background job for pull incorrectly checks the push flag on the server, fixes #457
- Issue fixed: When background jobs are enabled the wrong flag is checked when attemptying to enqueue a pull
2015-04-13 14:40:42 +02:00
Iglocska 5f70207051 Progress in moving all exports to the new distribution system 2015-04-13 12:42:26 +02:00
Iglocska 116bf8e425 Fix to an issue with the caching
- CSV caching was saving to file on each attribute, creating extremely high amounts of I/O
- reduced it to saving to file / event

- fixed incorrect pathing
2015-04-08 22:47:28 +02:00
Richard van den Berg fa112d77c3 Use correct CakeResque queues 2015-03-23 17:58:41 +01:00
Richard van den Berg 11052d85ce Fix posts alerts 2015-01-28 13:24:51 +01:00
Richard van den Berg 506e1fcb0d Send E-mail notifications for new posts in discussion and event threads 2015-01-28 13:24:51 +01:00
iglocska 2018f822ec Fixed a bug with the way scheduled syncs are logged 2015-01-27 10:42:31 +01:00
iglocska 6b6c62bd53 Fix to the new sync issues since 2.3.39, fixing #365
Incorrectly trying to look up authenticated user in the model fixed
2015-01-15 13:46:11 +01:00
iglocska cedaac360a Fixes to the scheduled tasks and some documentation issues
- Scheduled pulls should work correctly now
- Scheduled pushes and pulls correctly display in the logs
- Scheduled caching correctly sets the next date of execution
2015-01-12 17:35:08 +01:00
iglocska 71d36b9c64 Several issues fixed
- MYSQL.sql file now correctly includes the task entries
- GenerateCorrelation admin task is now a background job
- Organisation of events pulled now get the org in the server object as the owner instead of the one who initiates the pull
- Small fix to wrapping text in the pivot graph
2014-11-27 14:47:13 +01:00
iglocska bfdeda99dc Further corner case fixed (shadow attribute to attribute, not event) 2014-11-14 11:59:38 +01:00
iglocska 01fd0b93ce Comments also sanitized 2014-11-14 11:28:42 +01:00
iglocska c67af817e0 Related events not correctly sanitized in the xml export 2014-11-14 11:15:52 +01:00
iglocska 7a31e03021 Added to the caching mechanism 2014-11-14 11:05:37 +01:00
iglocska 4b7e56a43c Fix to an issue with the CSV export
- missing linebreak after header row added
- fixed an issue with quotes in the value field not being escaped properly
2014-11-12 15:36:07 +01:00
iglocska 982727819b debug left in code 2014-09-02 16:13:22 +02:00
iglocska 5a993dc120 Changes to the exports, fixes #285
- XML export was slow, replaced SimpleXML with a simple script that outputs XML for massive performance gains
- New option in bootstrap to allow the cached XML export to also include the attachments
- CSV caching slightly rearranged, it's much more memory efficient now
- Some fixes to relatedevent orgs being shown even if showorg is disabled
- Added a new site admin action to generate several 3k events for load testing (slow)
2014-09-02 15:56:28 +02:00
iglocska 4b19de1033 Merge branch 'hotfix-2.2.33' into develop 2014-06-27 21:38:31 +02:00
iglocska 72d4db3007 2 Background worker issues fixed
- Start-up script could only be started from the script's location

- Division by zero in e-mail alerts when calculating the progress of the background job
2014-06-27 21:36:14 +02:00
iglocska 6ac105e132 Merge branch 'hotfix-2.2.32' into develop 2014-06-24 13:44:22 +02:00
iglocska b1dafb7057 Removed junk left in the previous commit 2014-06-24 13:43:13 +02:00
iglocska aab50a9c44 Update to the way xml files are cached 2014-06-24 13:19:40 +02:00
iglocska 291892be05 Merge branch 'develop' into features/ajaxification
Conflicts:
	app/View/Elements/img.ctp
2014-05-05 09:56:42 +02:00
iglocska dac1c2b17c CSV export now includes date for each attribute, fixes #255 2014-04-30 11:00:20 +02:00
iglocska 705964a556 First commit of the event view ajaxification
- pagination of the attribute index within the event view
- add attributes in a pop-up window
- instantly refresh attributes
2014-03-24 16:33:40 +01:00
iglocska 4865121b7b Fix to the csv export in the automation not allowing a full export ignoring ids flags 2014-03-24 15:30:49 +01:00