USB: make the usb_device numa_node get assigned from controller