Please Login or Register


How to decrease the crawl rate of Bing's search engine bot

The msnbot or BING bot crawls your website to index your website's content and show the results under the Bing search engine. The crawl rate of this bot can be controlled using a robots.txt file. In order to decrease the crawl rate you should add the following content to your robots.txt file:

User-agent: msnbot
Crawl-delay: 1

Bing recommends using the lowest possible value for the crawl-delay. You can consider the value as:

No crawl delay set - Normal
1 - Slow
5 - Very Slow
10 - Extremely Slow

An alternative method of managing the Bing crawl rate for your website is to register for Bing's webmaster tools and set up your settings there.

Was this answer helpful?

Add to Favourites Add to Favourites

Print this Article Print this Article

Also Read


Quick Navigation

Client Login



Remember Me