gpu_group.c: compute_group_bounds_core: improve error handling