diTii.com Digital News Hub

Sign up with your email address to be the first to know about latest news and more.

I agree to have my personal information transfered to MailChimp (more information)

Aug262010

MSNBot: 5% to 25% Crawler Improvements from August 25th Onwards

Microsoft announced of upcoming crawler improvements; “Bing Engineering team is constantly testing new features to improve crawl efficiency. Such experiments are vital to our ability to innovate and improve our end user and publisher experience. Due to an upcoming experiment, a few sites may encounter an intermittent increase (anywhere from 5% to 25%) in crawl requests from MSNBot over next month (specifically from August 25th through end of September),” said Microsoft.

If you see an increased crawl rate on your site and want to throttle it down, contact bwmc as soon as possible.

[Source]

Share This Story, Choose Your Platform!

Do NOT follow this link or you will be banned from the site!