Protect the primary buffer when modifying it during secondary buffer destruction