Check known_hosts files as well