Hi All,

I am very much surprised to see one site which is using NO Index and No Follow in Meta but still they are regularly crwaled!!

Is it means that meta bot tags are useless???What could be the reason?

Thanks

__________________
PPC Services India
Internet marketing India

No follow means don't follow any of the links on the page, and no index means don't put the page into the search engines index.

Is this the Googlebot, or some other spiders. There are some that are more well behaved than others.

Also you might want to check to make sure your syntax is correct and you don't have any errors that might be causing the spiders to misread the tags.

__________________
AJAX Example Sites is now here! With a nice
AJAX Chat Application Tutorial

the no index, no follow tag is only for outgoing links from the page.

They are regularly crawled coz there are links pointing to their site. Robots indexed your pages thru links from other site.

__________________
Dog Containment | Wireless Dog Fence

You know having a lot of backlinks from the other sites make the search engine's bots to crawl your site.

meta robots tags are use to specify a site that you dont want to index by the SE's crawler.....