usb: don't update devnum for wusb devices