update robots.txt, document it a bit better
commit1ee8754f9b22d38bb4fb5a14f887184c14296077
authorwarner <warner@lothar.com>
Sun, 30 Sep 2007 23:41:34 +0000 (1 00:41 +0100)
committerwarner <warner@lothar.com>
Sun, 30 Sep 2007 23:41:34 +0000 (1 00:41 +0100)
tree984406534edb907310cacc34e427631de21c42f6
parent47ae69db5f6cf38bb3b3e67a821a886ef994edf0
update robots.txt, document it a bit better
ChangeLog
buildbot/status/web/robots.txt
docs/buildbot.texinfo