Cached modification times for symbolic refs too