Move cached cwd onto conn struct.