Only check for bindable ports if we are unsure if it will fail.