Move the xenfb pointer handler to the connected method