08 July 2009

Robots Meta Tags

This tag is meant to help webmasters who cannot control the robots.txt file at their sites. It provides a final attempt to keep their certain pages out of search engines and other web utilities to protect sensitive content or "under construction" pages. (Note, as mentioned in a previous article, if you are using a robots.txt file, please ensure that it is not empty. Some bots interpret this NOINDEX,NOFOLLOW for the entire site!
  • INDEX means that robots are able to include this page in search engines.
  • FOLLOW means that robots are able to follow links (spidering).
A value of "NOINDEX" allows links from the page to be spidered, even though the page itself is not indexed. A value of "NOFOLLOW" allows the page to be indexed, but no links from the page are spidered. A value of "NONE" tells the robot to ignore the page.
(e.g.)
<META NAME="ROBOTS" CONTENT="ALL,NONE,NOINDEX,NOFOLLOW">

default = "ALL"
"NONE" = "NOINDEX, NOFOLLOW"

8 comments:

search engine placement said...

Thanks for clearing that one up. I was actually thinking about it. Cheers.

White Label SEO said...

Great post!! Thanks for sharing such an wonderful information ...

Unknown said...

Congratulations! this information it is very interesting, I invite you to visit my site about Outsource Seo Services

webdesignpatna said...

When you’re writing the title tag for your web page, make sure that it contains your targeted keywords along with your city and your state. This will tell the search engines exactly where to rank you.

webhostingruchi said...

Sometimes it takes a couple of weeks or longer to get a new domain indexed by Google. There are many off-line and on-line SEO techniques that can greatly improve and speed up your inclusion in search engine index.

Unknown said...

Thanks for the sharing of such information. we will pass it on to our readers. This is a great reading. Thanking you.
Seo Company

Anonymous said...

Its on page seo. meta tag must there to shoe your site in good position on search engine.
Thanks.
Website Developer in Bangalore

James Cayetano said...

Awesome tips you got here! A very helpful post for everyone. Thanks for sharing! By the way, I'd like to share SEO Philippines for link building services.

Post a Comment