diff: do not short-cut CHECK_SIZE_ONLY check in diff_populate_filespec()