Jakub Onderka
f0fa71627d
chg: [internal] Better job progress and status logging
2020-06-28 09:06:27 +02:00
Jakub Onderka
fdb7f1d78b
new: [cli] Command for pulling from all remote servers
2020-06-09 10:19:22 +02:00
mokaddem
dcd3664bba
Merge branch '2.4' of github.com:MISP/MISP into pr-5256
2020-05-18 14:14:51 +02:00
iglocska
15d6c30649
new: [sync] (for now) undocumented force pull added
...
- can only be triggered via the CLI for now
- usage: /var/www/MISP/app/Console/cake Server pull [user_id] [server_id] [technique] [force]
- the force flag has to be passed as 'force' to avoid accidentally triggering it
- What it does:
- pulls ignoring the timetamp differences
- this means that even older states of events, attributes, objects are ingested
- useful for when wanting to reset an event / all events to align with an upstream server
- Caveats:
- attributes added on the low side are maintained
- tags added on the low side are maintained
- keep in mind this WILL override attributes that are soft deleted
2020-05-14 09:34:49 +02:00
Jakub Onderka
94b36c9259
chg: [feed] Provide more info when caching feeds about failures
2020-05-11 15:00:52 +02:00
mokaddem
d71b9a9dc6
fix: [Console:Server] Added `configLoad` task. Fix #5793
2020-04-27 11:51:04 +02:00
iglocska
af881189e5
new: [config load task] Added a task that will reload the settings on any console shell execution, fixes #5498
...
- helps with background workers being forced to fetch new settings whenever they start a new job
2020-02-10 15:15:59 +01:00
mokaddem
4100af2a30
chg: [console:server] Stop execution if user does not exists
2020-01-22 16:07:59 +01:00
Sami Mokaddem
c628375e96
fix: [serverShell] Stopped usage of reserver keyword
...
Renamed function name to let PHP 5.x parse the shell script correctly
2020-01-21 14:05:22 +01:00
iglocska
b3771f3913
fix: [CLI] invalid variable used for server caching log entry
2019-12-10 09:24:56 +01:00
Andras Iklody
add02eb29a
Merge pull request #5280 from vpiserchia/fix-feed-cli
...
Server shell: use the right array key
2019-11-26 19:30:58 +01:00
Richard van den Berg
dd963c2e21
Sync sightings on push, pull and push on add
2019-11-22 21:53:51 +01:00
Jan Skalny
0ef0cf49cb
new: [cli] server connectivity test
2019-10-22 20:13:11 +02:00
Vito Piserchia
3190ff88ea
Server shell: use the right array key
2019-10-08 09:30:24 +02:00
Jakub Onderka
7d438673c1
chg: [feed] Handle exceptions for ServerShell::enqueueFeedCache
2019-09-02 20:37:18 +02:00
Jakub Onderka
de2b143748
chg: [feed] Better error handling for cacheFeedInitiator method
2019-09-02 19:52:41 +02:00
iglocska
e8dd0e536f
chg: [CLI] server shell -> push now allows passing the event ID to push
...
- also, changed tabs to spaces
2019-08-08 11:18:21 +02:00
Andras Iklody
6248ae6121
fix: [CLI] Response after a CLI pull threw notice error
...
Proposal pull now returns int instead of a list of proposals, meaning that count($data) was trying to count an int.
2019-07-16 13:29:31 +02:00
mokaddem
47e13c8369
chg: [updates] Implented changes requested by the PR's review #4534 .
2019-04-29 11:09:04 +02:00
mokaddem
ee735f00d4
new: [update] Injected update-related files/changes from zoidberg
2019-04-26 09:45:03 +02:00
iglocska
24146af9db
new: [remote caching] First release version of the remote caching
2019-01-18 16:15:22 +01:00
iglocska
9c5fbdd7e9
new: [server caching] Initial version WIP
2019-01-18 09:06:23 +01:00
iglocska
be05652072
fix: [CLI] usage output fixed for the server shell tasks
2018-12-13 10:30:04 +01:00
iglocska
c3ec498f46
fix: [CLI] Fixed the CLI feed fetcher
...
- use "all" to fetch all feeds
2018-11-08 13:10:27 +01:00
iglocska
113fa25471
new: [API] exposed the server related functionalities to the API
...
- server index
- server push
- server pull
- improved logging / error reporting of the sync functionalities
2018-08-22 17:00:13 +02:00
iglocska
5d21db8dd5
fix: Various fixes to the server shell
2018-04-16 07:56:17 +02:00
iglocska
e435fbb571
fix: Copy pasta fixed
2018-04-15 22:41:13 +02:00
iglocska
7dfd602f86
new: Cleanup of server push, feed fetch, fed cache console commands
2018-04-15 22:40:17 +02:00
iglocska
de8c0c0fb8
new: Rework of the server/feed command line tools, WIP
2018-04-14 23:37:07 +02:00
Matt Carothers
7af6dfde7a
Set job_input explicitly to an empty string for cache feed jobs
...
Older MISP deployments may interpret a missing field as a null value instead
of an empty string, which causes the NOT NULL restriction on the jobs.job_input
field to raise an error. Fixes issue #2804 .
2018-01-16 17:22:56 -05:00
RT Hatfield
9740cadae9
fix for issue #2458
2017-09-13 09:35:24 -04:00
RT Hatfield
bf2d7f920b
Fixing bug in feed-fetch sched. task
2017-09-06 11:56:58 -04:00
iglocska
bcbee05e2f
new: Feeds added to the scheduled jobs
2017-08-25 14:38:32 +02:00
iglocska
96574ec335
new: First implementation of the feed analysis system
2017-05-08 14:22:27 +02:00
Iglocska
19373454e3
fix: Moved requeue of pull scheduled job to the front
2016-12-07 13:50:45 +01:00
Iglocska
9d4403ff3e
fix: Resolved several issues with error handling in the new feed system
2016-10-07 20:08:57 +02:00
Andreas Ziegler
0fe692c56a
remove whitespace at end of line
2016-06-04 01:10:45 +02:00
Andreas Ziegler
898ea1d97c
remove whitespace (space/tab) from empty lines
2016-06-04 01:08:16 +02:00
Andreas Ziegler
dc0974a55b
misc cleanup
2016-05-21 05:10:49 +02:00
Iglocska
8565ce198b
Merge branch 'feature/feeds' into 2.4
2016-03-10 15:27:47 +01:00
Iglocska
e1b384c5b0
Scheduled push incorrectly used the user e-mail address instead of a user object to initiate the sync, fixes #1000
2016-03-09 11:25:05 +01:00
Iglocska
79e41da383
First version of Feed system ready
...
- tied into background processes
2016-03-09 02:31:55 +01:00
iglocska
79a074880f
Invalid lookup of servers for the scheduled pull
...
- it was erroneously looking up servers that have push enabled instead of pull
2015-12-27 23:29:12 +01:00
iglocska
ba95648fa5
Fixed some background worker issues
...
- scheduled pulls would fail because of invalid user object passed
- invalid permissions checks / org checks would cause the RPZ export to fail when using background workers
2015-12-26 01:35:34 +01:00
Iglocska
d433618c71
Also, enabled the filtering on pull
...
Merge branch 'master' into 2.4-beta
Conflicts:
VERSION.json
app/Controller/EventsController.php
app/Lib/Tools/XMLConverterTool.php
app/Model/Event.php
app/Model/Server.php
2015-12-03 00:27:56 +01:00
Iglocska
714ed198e5
Various fixes throughout the application
...
- org field still used in some places other than the legitimate use-cases
2015-11-28 23:49:52 +01:00
Iglocska
e242c9add2
Set of changes to the sync
...
- finished preview feature
- can now view events and attributes remotely
- can copy over new event to local instance
- new sync mode (update)
- allows to only pull changes to events that exist locally already
- works well with the manual pull of events, no need to pull events that we didn't manually confirm, but can still update all events that we pulled over
- Fixed an issue with background tasks causing the logging to fail
- reworked connection test showing version numbers of both instances
- also telling the admin whether the sync is compatible or not
- Further refactoring / tweaking of the vent view
2015-10-06 01:16:48 +02:00
Iglocska
c73f71f243
Merge branch 'master' into feature/sg
...
The merging is complete
Conflicts:
VERSION.json
app/Console/Command/ServerShell.php
app/Controller/AppController.php
app/Controller/AttributesController.php
app/Controller/EventsController.php
app/Controller/PostsController.php
app/Controller/UsersController.php
app/Model/Attribute.php
app/Model/Event.php
app/Model/Log.php
app/Model/Server.php
app/Model/User.php
app/View/Elements/side_menu.ctp
app/View/Users/admin_index.ctp
app/webroot/js/ajaxification.js
2015-06-10 22:54:20 +02:00
Iglocska
b36c0da66a
Timing for rescheduling of tasks changed slightly
...
- The rescheduling now happens before the task is executed - this way a failed job will not prevent the rescheduling of the next execution time
2015-06-03 23:49:37 +02:00
Iglocska
c44bee0e96
Further progress
...
- removed some junk
- more work on the background workers
- rewrote the correlation background job - should work correctly now and be a lot more memory efficient
2015-04-20 13:50:14 +02:00