Fix removing the socket when bind() fails.