worktree remove: allow it when $GIT_WORK_TREE is already gone