Clean up long-press affordance handler