diTii.com Digital News Hub

Sign up with your email address to be the first to know about latest news and more.

I agree to have my personal information transfered to MailChimp (more information)

Dec122008

New MSNBot coming! Live Search testing new crawler

Live Search is testing an update to MSNBot, which may show up as a new crawler name in your server referrer logs. The new crawler user agent string will appear as: msnbot/2.0b (+http://search.msn.com/msnbot.htm)

You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version, reports Live Search Webmaster Center Blog.

Share This Story, Choose Your Platform!

Do NOT follow this link or you will be banned from the site!