ref-filter: move need_color_reset_at_eol into ref_format