We were in fact only deleting stale marker when we got an incremental update, rather than when we did a full resync.