xtensa: remove ldso workaround by real pointer check