C/the.ansi.c.programming.language/c.programming.notes.int/robots.txt

   1 User-agent: *
   2 Disallow: /cgi-bin/dialsearch
   3 Disallow: /squirrelmail/data/
   4 Disallow: /cgi-bin/
   5 Disallow: /~ttca/
   6 Disallow: /~aiken/
   7 Disallow: /~noir/whatis.shtml
   8
   9 User-agent: Slurp
  10 Disallow: /~brucem/
  11 Disallow: /-brucem/
  12 Disallow: /~weidai/
  13 Disallow: /-weidai/
  14 Disallow: /~eriemer
  15 Disallow: /-eriemer
  16 Disallow: /ftp/
  17 Disallow: /~ericj/
  18 Disallow: /~peteyboy/
  19 Disallow: /~parents/cgi-bin/