MSNBot: 5% to 25% Crawler Improvements from August 25th Onwards

Microsoft announced of upcoming crawler improvements; "Bing Engineering team is constantly testing new features to improve crawl efficiency. Such experiments are vital to our ability to innovate and improve our end user and publisher experience. Due to an upcoming experiment, a few sites may encounter an intermittent increase (anywhere from 5% to 25%) in crawl […]

Microsoft announced of upcoming crawler improvements; "Bing Engineering team is constantly testing new features to improve crawl efficiency. Such experiments are vital to our ability to innovate and improve our end user and publisher experience. Due to an upcoming experiment, a few sites may encounter an intermittent increase (anywhere from 5% to 25%) in crawl requests from MSNBot over next month (specifically from August 25th through end of September)," said Microsoft.

If you see an increased crawl rate on your site and want to throttle it down, contact bwmc as soon as possible.

[Source]

About The Author

Deepak Gupta is a IT & Web Consultant. He is the founder and CEO of diTii.com & DIT Technologies, where he's engaged in providing Technology Consultancy, Design and Development of Desktop, Web and Mobile applications using various tools and softwares. Sign-up for the Email for daily updates. Google+ Profile.