| commit | 366e09cf801f2474a2fb71713bfa8a8ad81b979b | |
| author | Kyle J. McKay <mackyle@gmail.com> | |
| Mon, 7 Jul 2014 15:10:37 +0000 (7 08:10 -0700) | ||
| committer | Kyle J. McKay <mackyle@gmail.com> | |
| Mon, 7 Jul 2014 15:10:37 +0000 (7 08:10 -0700) | ||
| tree | 904a6c768cf275a1c5feadc06d9678c0b9fec1ed | treesnapshot (tar.gz zip) |
| parent | 81dfc67e5d1180a6ae05120619fd0bc14f8f349e | commitdiff |
htaccess: catch misbehaving crawlers
Some crawlers like about their user agent.
Attempt to block access to expensive operations that these
crawlers should not be fetching by adding more match conditions.
Some crawlers like about their user agent.
Attempt to block access to expensive operations that these
crawlers should not be fetching by adding more match conditions.
| htaccess | diffblobblamehistory |