x86, setup: Only set early_serial_base after port is initialized