Dereference left over buffers and slots when sources are released