Limit crawl frequency of the new MSNbot

If you occasionally get high traffic from MSNBot, you can specify a Crawl delay parameter in the robots.txt file to specify how often, in seconds, MSNBot can access your site. To do this, add this syntax to your robots.txt file:

User-agent: msnbot
Crawl-delay: 120

msnbot is the name of the bot

120 is the delay in seconds.