View Full Version : How to log the spider's visit in my http web server log file?


cheeshong
06-16-2004, 02:42 AM
Hi, there was a time when I use the weblog expert to view the statistic of my site, the sample that came with the software was showing what crawlers that had visited the site within a period. In my http web server log file doesn't show this as well as the analysis result.

My question : Is there anything to be set in order to log the spider's visit to my site?

Thanks a million.

megri
06-16-2004, 05:12 AM
There are lot of free scripts through which you can make analysis of your web log to find which spider visited when you can find free scripts at

http://www.hotscripts.com