Home 
Support & Knowledge SEO Secrets Limit crawl frequency of the new MSNbot
Support & Knowledge SEO Secrets Limit crawl frequency of the new MSNbot
|
SEO secrets - Knowledgebase |
Loading...
Limit crawl frequency of the new MSNbot
If you occasionally get high traffic from MSNBot, you can specify a Crawl delay parameter in the robots.txt file to specify how often, in seconds, MSNBot can access your site. To do this, add this syntax to your robots.txt file:
User-agent: msnbot
Crawl-delay: 120
msnbot is the name of the bot
120 is the delay in seconds.
YES
NO
|
Try the SEO Effect tools to optimize your site!
The SEO Effect Search Engine Optimization platform provides a full set of SEO tools embedded in an easy, step by step workflow.
|
| Free trial? |
|---|
|
SEO Effect is live! Sign up right now for a free trial. During beta, you can use our free trial without time limitation.
No free trial right now? Stay tuned with our newsletter. |
| Follow us |
|---|
|
Follow us: |
