Blackfin arch: unify port_setup() to reduce arch differences