Fix the recursing when the sub-path was modified instead of just added