ARM: pxa: fix pxa3xx-u2d crash when ULPI not used