musb_core: don't prevent disabling clock on driver unload