diff: do not reuse_worktree_file for submodules