changeset 1418:fcadd1faee76

Added a note to robots.txt about the url_prefix_action setting.
author Alexander Schremmer <alex AT alexanderweb DOT de>
date Thu, 24 Aug 2006 23:21:46 +0200
parents 76cd1916b7e4
children aa8490f722fa 25be55af8b8b
files wiki/htdocs/robots.txt
diffstat 1 files changed, 5 insertions(+), 1 deletions(-) [+]
line wrap: on
line diff
--- a/wiki/htdocs/robots.txt	Thu Aug 24 22:55:30 2006 +0200
+++ b/wiki/htdocs/robots.txt	Thu Aug 24 23:21:46 2006 +0200
@@ -4,6 +4,10 @@
 Crawl-delay: 20
 # This has to match script url + cfg.url_prefix_action - it
 # saves lots of search engine load and traffic by disallowing crawlers
-# to request action related URLs:
+# to request action related URLs.
+#
+# NOTE - in order to make this have any effect, you have to set
+#        url_prefix_action to "action", cf. HelpOnConfiguration
+
 Disallow: /action/