Use physical addresses at the interface level, letting drivers remap