sched: fix delay accounting performance regression