tests/vm: Do not abuse parallelism when HOST != TARGET architecture