SEO | Link Popularity | Search Engine Consulting | SEO Tutorial | SEO Tools | SEO Forum
Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
  #1  
Old 06-17-2004, 07:18 PM
cheeshong cheeshong is offline
SEO
 
Join Date: May 2004
Posts: 245 cheeshong is on a distinguished road
How often a Google spider crawl your site?

How often a google spider crawl your site and update your PR? and how do you know other than mannually checking and monitoring everyday using PR.
Is there anyway to log down its activity on your site?

Last edited by cheeshong : 06-17-2004 at 07:27 PM.
Reply With Quote
  #2  
Old 06-17-2004, 11:15 PM
Robert Robert is offline
Premium member
 
Join Date: May 2004
Location: Colorado
Posts: 173 Robert is on a distinguished road
Hi Cheeshong,

There is no single answer for every page, and there is a big difference between crawling your site, changing the results, and updating your PR.

Google will spider based on several factors that can include frequency the content is updated, popularity of the page, page depth, etc.

In general, a higher PR will get your page(s) indexed more often (daily) and to a greater depth. The new information can also be seen in the index much sooner. The visible PR however is not updated as frequently.

To find out when google spiders your site, you have to look at the server logs. A visible change you can see on Google may have come from a crawl that occured quite some time in the past.

The easiest way to find out when PR has been updated, is to watch for chatter here on the forums.

__________________
arizona real estate california real estate
Reply With Quote
  #3  
Old 06-17-2004, 11:37 PM
cheeshong cheeshong is offline
SEO
 
Join Date: May 2004
Posts: 245 cheeshong is on a distinguished road
the server log has too many IPs and lines. How can i know which particular line is the google's spider?

thanks
Reply With Quote
  #4  
Old 06-18-2004, 01:02 AM
Robert Robert is offline
Premium member
 
Join Date: May 2004
Location: Colorado
Posts: 173 Robert is on a distinguished road
Quote:
Originally Posted by cheeshong
the server log has too many IPs and lines. How can i know which particular line is the google's spider?


Most spiders will indicate who they are.

Lines showing action from google should have something simmilar to:

"Googlebot/2.1+(+http://www.googlebot.com/bot.html)"

...listed toward the end of the line.

If you open your log file in a text reader, you can use the "find" feature and search for "google" to make it easier.

If you server adsense ads, you will see google entries that also say media partners. There are not the same as the regular google spider.

__________________
maine real estate nevada real estate
Reply With Quote
  #5  
Old 06-22-2004, 05:41 PM
cheeshong cheeshong is offline
SEO
 
Join Date: May 2004
Posts: 245 cheeshong is on a distinguished road
thanks
Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Login/Register
User Name
Password
Remember Me?

Forum Links
Forum Home
SEO Forum
Internet Marketing Forum
Web Design Forum
Web Hosting Forum
Programming Forum
SEO Chat

Quick Links
Forum Home
New Posts
Mark Forums Read
Open Buddy List
User Control Panel
Edit Avatar
Edit Profile
Edit Options
Miscellaneous
Subscribed Threads
My Profile

Search Forums

Advanced Search
All times are GMT -8. The time now is 02:43 PM.


Powered by: vBulletin Version 3.0.3
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.