changeset 6002:072577e05c0c

Add bingbot to ua_spiders. Bing has been crawling our wiki with the user agent "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)". A blog entry about the UA string can be found at http://www.bing.com/blogs/site_blogs/b/webmaster/archive/2010/09/03/bingbot-is-coming-to-town.aspx
author Gerald Combs <gerald@wireshark.org>
date Tue, 19 Nov 2013 09:25:50 -0800
parents 77533e162654
children 575660fc7a5a
files MoinMoin/config/multiconfig.py
diffstat 1 files changed, 1 insertions(+), 1 deletions(-) [+]
line wrap: on
line diff
--- a/MoinMoin/config/multiconfig.py	Tue Aug 13 12:17:47 2013 +0200
+++ b/MoinMoin/config/multiconfig.py	Tue Nov 19 09:25:50 2013 -0800
@@ -877,7 +877,7 @@
     # and receive a FORBIDDEN for anything except viewing a page
     # list must not contain 'java' because of twikidraw wanting to save drawing uses this useragent
     ('ua_spiders',
-     ('archiver|cfetch|charlotte|crawler|gigabot|googlebot|heritrix|holmes|htdig|httrack|httpunit|'
+     ('archiver|bingbot|cfetch|charlotte|crawler|gigabot|googlebot|heritrix|holmes|htdig|httrack|httpunit|'
       'intelix|jeeves|larbin|leech|libwww-perl|linkbot|linkmap|linkwalk|litefinder|mercator|'
       'microsoft.url.control|mirror| mj12bot|msnbot|msrbot|neomo|nutbot|omniexplorer|puf|robot|scooter|seekbot|'
       'sherlock|slurp|sitecheck|snoopy|spider|teleport|twiceler|voilabot|voyager|webreaper|wget|yeti'),