aio-posix: Don't count ctx->notifier as progress when polling