[ci] Only install android-specific brew packages when building for android