USB: usb-serial: Prepare for BKL push down