Make sure the target buffer size is frame aligned