xfs: fix freeing of inodes not yet added to the inode cache