MSN Bot - I think there starting the new MSN
I have noticed a new type of MSN Bot crawling my forum and was thinking could this be the new MSN being deployed?
I get this bot crawling - msnbot.msn.com
No where does it say any word beta like it did. Any input or info on this would be great.
I don't know if the designers of the new MSN bot deliberately targeted pages that do not have that much traffic but MSN bot 0.3 has been on my forums so much I would kind of like it to leave now.
If that is any indication of things to come the new bot 0.3 is going to index every page you have and some you didn't even know you had
wyrickj, I have had the same bot all over my forums. I'd like to know as well :)
That's no joke. Like every other Webmaster in the world I have "test pages" that just sit there in the /root with no links to them. MSNBOT found'em! No joke.
I have one site just for testing with tons of test pages with NO links to them and MSN found them too.
Also he isn't too good at obeying the robots.txt file.
|All times are GMT -8. The time now is 03:59 AM.|
Powered by: vBulletin Version 3.0.3
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.