barvinok_enumerate: return NaN for infinite problems