No need to set the socket fd to non-blocking because it's in it's own