Free the buffer more often when there is less data in it