org-element: Fix wrong cache behaviour