If `StateFilter` specifies a state set which we will have regardless of state-syncing, then we may as well return it immediately.