Don't update the source's gains in the sample mixing loop