5 sec crawler delay, deny /admin
authorStefan Kögl <stefan@skoegl.net>
Sat, 27 Apr 2013 11:45:44 +0000 (27 13:45 +0200)
committerStefan Kögl <stefan@skoegl.net>
Sat, 27 Apr 2013 11:45:44 +0000 (27 13:45 +0200)
htdocs/robots.txt

index e69de29..07b5140 100644 (file)
@@ -0,0 +1,3 @@
+User-agent: *
+Crawl-delay: 5
+Disallow: /admin