submodule: don't access the .gitmodules cache entry after removing it