Installer: Let the setup do all the renaming for in-use files