audio/jack: do not remove ports when finishing