Commit Graph

54 Commits (cfc582951307307b4d1b6521d48b3d77e8354c74)

Author SHA1 Message Date
iglocska af881189e5
new: [config load task] Added a task that will reload the settings on any console shell execution, fixes #5498
- helps with background workers being forced to fetch new settings whenever they start a new job
2020-02-10 15:15:59 +01:00
mokaddem 4100af2a30
chg: [console:server] Stop execution if user does not exists 2020-01-22 16:07:59 +01:00
Sami Mokaddem c628375e96
fix: [serverShell] Stopped usage of reserver keyword
Renamed function name to let PHP 5.x parse the shell script correctly
2020-01-21 14:05:22 +01:00
iglocska b3771f3913
fix: [CLI] invalid variable used for server caching log entry 2019-12-10 09:24:56 +01:00
Andras Iklody add02eb29a
Merge pull request #5280 from vpiserchia/fix-feed-cli
Server shell: use the right array key
2019-11-26 19:30:58 +01:00
Richard van den Berg dd963c2e21 Sync sightings on push, pull and push on add 2019-11-22 21:53:51 +01:00
Jan Skalny 0ef0cf49cb new: [cli] server connectivity test 2019-10-22 20:13:11 +02:00
Vito Piserchia 3190ff88ea Server shell: use the right array key 2019-10-08 09:30:24 +02:00
Jakub Onderka 7d438673c1 chg: [feed] Handle exceptions for ServerShell::enqueueFeedCache 2019-09-02 20:37:18 +02:00
Jakub Onderka de2b143748 chg: [feed] Better error handling for cacheFeedInitiator method 2019-09-02 19:52:41 +02:00
iglocska e8dd0e536f
chg: [CLI] server shell -> push now allows passing the event ID to push
- also, changed tabs to spaces
2019-08-08 11:18:21 +02:00
Andras Iklody 6248ae6121
fix: [CLI] Response after a CLI pull threw notice error
Proposal pull now returns int instead of a list of proposals, meaning that count($data) was trying to count an int.
2019-07-16 13:29:31 +02:00
mokaddem 47e13c8369 chg: [updates] Implented changes requested by the PR's review #4534. 2019-04-29 11:09:04 +02:00
mokaddem ee735f00d4 new: [update] Injected update-related files/changes from zoidberg 2019-04-26 09:45:03 +02:00
iglocska 24146af9db new: [remote caching] First release version of the remote caching 2019-01-18 16:15:22 +01:00
iglocska 9c5fbdd7e9 new: [server caching] Initial version WIP 2019-01-18 09:06:23 +01:00
iglocska be05652072 fix: [CLI] usage output fixed for the server shell tasks 2018-12-13 10:30:04 +01:00
iglocska c3ec498f46 fix: [CLI] Fixed the CLI feed fetcher
- use "all" to fetch all feeds
2018-11-08 13:10:27 +01:00
iglocska 113fa25471 new: [API] exposed the server related functionalities to the API
- server index
- server push
- server pull

- improved logging / error reporting of the sync functionalities
2018-08-22 17:00:13 +02:00
iglocska 5d21db8dd5 fix: Various fixes to the server shell 2018-04-16 07:56:17 +02:00
iglocska e435fbb571 fix: Copy pasta fixed 2018-04-15 22:41:13 +02:00
iglocska 7dfd602f86 new: Cleanup of server push, feed fetch, fed cache console commands 2018-04-15 22:40:17 +02:00
iglocska de8c0c0fb8 new: Rework of the server/feed command line tools, WIP 2018-04-14 23:37:07 +02:00
Matt Carothers 7af6dfde7a Set job_input explicitly to an empty string for cache feed jobs
Older MISP deployments may interpret a missing field as a null value instead
of an empty string, which causes the NOT NULL restriction on the jobs.job_input
field to raise an error.  Fixes issue #2804.
2018-01-16 17:22:56 -05:00
RT Hatfield 9740cadae9 fix for issue #2458 2017-09-13 09:35:24 -04:00
RT Hatfield bf2d7f920b Fixing bug in feed-fetch sched. task 2017-09-06 11:56:58 -04:00
iglocska bcbee05e2f new: Feeds added to the scheduled jobs 2017-08-25 14:38:32 +02:00
iglocska 96574ec335 new: First implementation of the feed analysis system 2017-05-08 14:22:27 +02:00
Iglocska 19373454e3 fix: Moved requeue of pull scheduled job to the front 2016-12-07 13:50:45 +01:00
Iglocska 9d4403ff3e fix: Resolved several issues with error handling in the new feed system 2016-10-07 20:08:57 +02:00
Andreas Ziegler 0fe692c56a remove whitespace at end of line 2016-06-04 01:10:45 +02:00
Andreas Ziegler 898ea1d97c remove whitespace (space/tab) from empty lines 2016-06-04 01:08:16 +02:00
Andreas Ziegler dc0974a55b misc cleanup 2016-05-21 05:10:49 +02:00
Iglocska 8565ce198b Merge branch 'feature/feeds' into 2.4 2016-03-10 15:27:47 +01:00
Iglocska e1b384c5b0 Scheduled push incorrectly used the user e-mail address instead of a user object to initiate the sync, fixes #1000 2016-03-09 11:25:05 +01:00
Iglocska 79e41da383 First version of Feed system ready
- tied into background processes
2016-03-09 02:31:55 +01:00
iglocska 79a074880f Invalid lookup of servers for the scheduled pull
- it was erroneously looking up servers that have push enabled instead of pull
2015-12-27 23:29:12 +01:00
iglocska ba95648fa5 Fixed some background worker issues
- scheduled pulls would fail because of invalid user object passed
- invalid permissions checks / org checks would cause the RPZ export to fail when using background workers
2015-12-26 01:35:34 +01:00
Iglocska d433618c71 Also, enabled the filtering on pull
Merge branch 'master' into 2.4-beta

Conflicts:
	VERSION.json
	app/Controller/EventsController.php
	app/Lib/Tools/XMLConverterTool.php
	app/Model/Event.php
	app/Model/Server.php
2015-12-03 00:27:56 +01:00
Iglocska 714ed198e5 Various fixes throughout the application
- org field still used in some places other than the legitimate use-cases
2015-11-28 23:49:52 +01:00
Iglocska e242c9add2 Set of changes to the sync
- finished preview feature
  - can now view events and attributes remotely
  - can copy over new event to local instance

- new sync mode (update)
  - allows to only pull changes to events that exist locally already
  - works well with the manual pull of events, no need to pull events that we didn't manually confirm, but can still update all events that we pulled over

- Fixed an issue with background tasks causing the logging to fail

- reworked connection test showing version numbers of both instances
  - also telling the admin whether the sync is compatible or not

- Further refactoring / tweaking of the vent view
2015-10-06 01:16:48 +02:00
Iglocska c73f71f243 Merge branch 'master' into feature/sg
The merging is complete

Conflicts:
	VERSION.json
	app/Console/Command/ServerShell.php
	app/Controller/AppController.php
	app/Controller/AttributesController.php
	app/Controller/EventsController.php
	app/Controller/PostsController.php
	app/Controller/UsersController.php
	app/Model/Attribute.php
	app/Model/Event.php
	app/Model/Log.php
	app/Model/Server.php
	app/Model/User.php
	app/View/Elements/side_menu.ctp
	app/View/Users/admin_index.ctp
	app/webroot/js/ajaxification.js
2015-06-10 22:54:20 +02:00
Iglocska b36c0da66a Timing for rescheduling of tasks changed slightly
- The rescheduling now happens before the task is executed - this way a failed job will not prevent the rescheduling of the next execution time
2015-06-03 23:49:37 +02:00
Iglocska c44bee0e96 Further progress
- removed some junk
- more work on the background workers
- rewrote the correlation background job - should work correctly now and be a lot more memory efficient
2015-04-20 13:50:14 +02:00
Iglocska e8bcab19db Background job for pull incorrectly checks the push flag on the server, fixes #457
- Issue fixed: When background jobs are enabled the wrong flag is checked when attemptying to enqueue a pull
2015-04-13 14:40:42 +02:00
iglocska 2018f822ec Fixed a bug with the way scheduled syncs are logged 2015-01-27 10:42:31 +01:00
iglocska 6b6c62bd53 Fix to the new sync issues since 2.3.39, fixing #365
Incorrectly trying to look up authenticated user in the model fixed
2015-01-15 13:46:11 +01:00
iglocska cedaac360a Fixes to the scheduled tasks and some documentation issues
- Scheduled pulls should work correctly now
- Scheduled pushes and pulls correctly display in the logs
- Scheduled caching correctly sets the next date of execution
2015-01-12 17:35:08 +01:00
iglocska 8fc85f95b9 Fixes with the synchronisation
- background pulls fixed
- now correctly logs changes
- now correctly updates attributes
2014-02-25 12:27:20 +01:00
iglocska e06c4b9299 Incremental pull and fixes to pulling shadow attributes
- during the event id pull, the local server already checks the timestamps, removing the ids of events that are not newer than the local version
- this results in only the event metadata being pulled for all events, and the attributes of only those events that need to be updated are pulled resulting in much quicker pulls

- Fixed an issue with proposals that got pulled not finding the attribute that they are proposals to (for proposals that belong to an attribute)
2014-02-20 17:28:39 +01:00