MSN names its vertical crawlers

08-01-2006, 07:40 AM

lineops001 lineops001 is offline

SEO

Join Date: May 2006

Location: Canada

Posts: 229 lineops001 will become famous soon enough

MSN names its vertical crawlers

MSN Shopping bot is msnbot-products.
MSN News bot is msnbot-news.
MSN Image Search bot is msnbot-media.
MSN Search bot is still just plain msnbot.

FYI if you want to add to your robots.txt exclusion protocol... more here http://www.seroundtable.com/archives/004259.html
and here http://blog.searchenginewatch.com/

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts vB code is On Smilies are On [IMG] code is On HTML code is Off