[ALSA] ymfpci - Fix race at removal