caif-hsi: Remove wake line modification when flushing FIFO