ctdbd_conn: Only poll if there's a timeout