Handle different failure modes when we wipe the db in provision