I need a simulator target Yahoo robot
I need a simulator target Yahoo robot. Is there anyone get one?
I don't know if there is one that behaves in exactly the same way as yahoo. The best way maybe is to read your server logs and look for hits with "slurp" in them. Then maybe you can understand how yahoo is crawling your site.
|All times are GMT -8. The time now is 11:11 AM.|
Powered by: vBulletin Version 3.0.3
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.