Fix a bug with cross-signing devices of users on other homeservers while in worker mode.