select: Don't allow unwanted/leftover fds being returned.