image_02.jpg
Can You handle their attention ?

Submission to search engines

Submission to search engines

Submitting a web site to search engines is not always enough to be included or to continue to be included. Most search engines analyze the link structures and click streams on the Internet to determine which web pages are most important for them to keep in their indexes.
If no other site is linking to your web site, it will be harder - in some cases, even impossible - to get indexed. You should therefore try to get as many of the biggest and most relevant web sites to link to your site.
Tip: use the submission tool in the SEO Effect
If you use the submission tool in your SEO Effect you can pick the pages from your web site you want to have indexed, including dynamic pages. As long as you have a direct address (URL) to the page, you can have it included through Pay For Inclusion or Pay for Placement programs.

How to submit to search engines

Most search engines have a form you must fill out to submit your web site. You will usually find the link in the bottom of the front page labeled "Add URL" or “submit your site”.
Generally, you should only submit your front (home) page. The search engines will follow links from that page to the rest of your web site. However, if you have important sections of your web site that are not directly accessible through the regular navigation of your home page, you can submit them, too. If you have a site map (a page with links to all the web pages on your web site), you can submit that as well to help the search engine spiders find all of your content.
Tip: get your site indexed by the major directories
The easiest way to get your web site into the search engines is by having it included in the major directories first, such as Yahoo, ODP, About and Zeal. Most search engines will consider a web site that is included in the major directories to be of higher value and therefore put a lot more focus on getting such web sites included.
See also the directory section.

Is your site indexed?

In most of the major search engines, you can verify if your web site or specific web pages have been indexed. This is not the same as your ranking, but serves as the basis for a user to find your site. If your web site is not indexed, it will never have ranking and it will never be found.

Do not over-submit

Some people will tell you that you have to resubmit as often as possible to keep your rankings. This is simply not true. You will not get better rankings by submitting pages that are already included in the search engine index. When you want to resubmit your pages don’t overdo it. Once every 35 days is often enough.
The reality is that a handful of the major search engines and directories have the large majority of all search users - either directly through their own search portals or through distribution of their indexes to other portals. Big search engine technology companies, such as FAST, Inktomi, and Google, distribute their indexes to a huge number of portals and search engines. If you submit to every front-end search engines that you see on the web, you are essentially submitting the same web pages over and over to the same search engine indexes. If you heavily over-submit to search engines, there is a risk that they will penalize your web site by excluding it from the index or by de-ranking your web pages.

Excluding pages from getting indexed

If there are pages or directories on your web site that you do not want search engines to index you can exclude them using one of two different methods:
• Robots.txt
• META-robots code

Robots.txt

Robots.txt is a file that you place in the root of your web server, the same place you put your index file. The file uses a simple syntax to exclude specific types of users - in this case search engine spiders - from parts of your web site. You can exclude either specific search engine spiders or all spiders.
A search engine respecting the robot.txt file asks for it before indexing your site. When your site is under total reconstruction and you want to exclude all search engine spiders from all directories on your web server, you should write the following:

User-agent: *
Disallow: /

Note: This would disallow everything including your home page!
To disallow spiders to certain parts of your site like subdirectories containing JavaScript or CGI scripts input the following.

User-agent: *
Disallow: /cgi-bin/
Disallow: /scripts/

Learn more about how to write robots.txt files at SearchTools.com.
Tip: validate your robot.txt
We recommend that you validate your robots.txt file before uploading it. There is no way to predict how a search engine will interpret a robots.txt file with errors. You can use the free validation at Search Engine World.

META-robots

META-robots are small pieces of code you can place in the header of your HTML documents. You can use META-robots tags if you don't have access to your web Server's root or if you want to exclude single pages on your web site. You can read more about how to use the META-robots code at SearchTools.com.

Tip: Use the robots.txt
Use the robots.txt and not the META-robots. With the robots.txt, you can exclude a complete subdirectory at once. With the META-Robot, you have to use the exclude code in every page you want to exclude.

 
Tag it:
Delicious
Digg
Technorati
YahooMyWeb
Reddit
Furl it!
Stumble
Scuttle
BlinkList
Try Seo Effect
Free premium seo software plan

Order our Free plan: get acces to all premium features now!

As featured in
Book search engine marketing

Handbook Search engine marketing

Tag it:
Delicious
Digg
Technorati
YahooMyWeb
Reddit
Furl it!
Stumble
Scuttle
BlinkList
RSS feed
  • Subscribe
      textbox
      RSS 0.91
      RSS 1.0
      RSS 2.0
      ATOM 0.3
      OPML
      Subscribe with Bloglines
      Add To Google
      Add To MyYahoo
      Add To My AOL
      Subscribe in NewsGator Online
      Add To Pageflakes
      Subscribe With Pluck RSS Reader
      Subscribe in Rojo
      Add To netvibes
Subscribe