Make sure the clock history only points to base buffers