USB: fix bug in serial driver unregistration