iommu/omap: Remove redundant clock handling on ISR