Make fsnotify possibly work better for the inode removal case