Revert "setup.py: Also set setup_requires to require pycairo"