SEO forum : Search Engine Optimization Forum

SEO forum : Search Engine Optimization Forum (http://www.seo-guy.com/forum/index.php)
-   MSN Search (http://www.seo-guy.com/forum/forumdisplay.php?f=78)
-   -   MSN Bot - I think there starting the new MSN (http://www.seo-guy.com/forum/showthread.php?t=5483)

wyrickj 12-27-2004 11:24 AM

MSN Bot - I think there starting the new MSN
 
I have noticed a new type of MSN Bot crawling my forum and was thinking could this be the new MSN being deployed?

I get this bot crawling - msnbot.msn.com
msnbot/0.3 (+http://search.msn.com/msnbot.htm)

No where does it say any word beta like it did. Any input or info on this would be great.

Freakindj 12-27-2004 08:25 PM

I don't know if the designers of the new MSN bot deliberately targeted pages that do not have that much traffic but MSN bot 0.3 has been on my forums so much I would kind of like it to leave now.

If that is any indication of things to come the new bot 0.3 is going to index every page you have and some you didn't even know you had

bbott 12-29-2004 10:58 PM

wyrickj, I have had the same bot all over my forums. I'd like to know as well :)

Pokeey 12-30-2004 11:25 AM

Quote:
and some you didn't even know you had


That's no joke. Like every other Webmaster in the world I have "test pages" that just sit there in the /root with no links to them. MSNBOT found'em! No joke.

I have one site just for testing with tons of test pages with NO links to them and MSN found them too.

Spooky. :eek:

Also he isn't too good at obeying the robots.txt file.

Chris


All times are GMT -8. The time now is 03:59 AM.

Powered by: vBulletin Version 3.0.3
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.