s4-librpc: do not limit to the first IP when trying to do a rpc connection