libvhost-user: remove watch for kick_fd when de-initialize vu-dev