USB: fix char-device disconnect handling