Only switch on the line number toggle when highlighting is activated