ti_icdi_usb: Remove unnecessary casts and fix byte order bugs