netlrts: Fix big (10x+) pingpong performance regression by partially reverting f505e76