d3d11va: do the Xbox size check after the texture dimensions are definitive