server: Store connected pipe_end in pipe_end struct.