View Full Version : Unlinked pages


GByte
06-05-2004, 11:18 AM
Hi all

Has anyone had any experience with googlebot visiting pages within your site that do not have any links pointing to them?

Today googlebot has visited 2 pages within my site that definatley do not have any links to them. The two pages are part of my shopping cart pages, the first it could have only got to by submiting a form (adding a product to cart) and the second page it could have only got to if there was something in the shopping cart?? (i.e checkout button which is only displayed once items are in cart)

What makes this even more strange is the fact that googlebot normally crawls around 300-400 pages a day, but today these are the only two pages that have been touched so far.

I am not concerned about the pages being crawled, I would just like to know how it got to those pages. Can googlebot now submit forms or see your whole directory structure without following any links?

jocelyn
06-05-2004, 11:34 AM
Can I know if you use adsence?
Because if you load the page to look if it's looking good... it triggers the adsence add.
If the page is new, it's spidered not long after by the googlebot-mediapartners... spider.
This is to get the topic of the page for the ads to display.

GByte
06-05-2004, 11:41 AM
Hey Jocelyn hows ya doin

No, not using adsense, its the site in my sig. What also just came to mind is that at present my cart only works with cookies enabled, and as far as I know googlebot does not accept cookies and therefore could'nt have got to the second page at all. If cookies are not set then the cart page has an error and the continue to checkout button could never be displayed to googlebot.

also definatly not googlebot-mediapartners. The ip address is:

64.68.87.69 crawler9.googlebot.com

disgust
06-06-2004, 06:34 AM
just because YOU don't link to them doesn't mean that perhaps external sites aren't linking to those files..

GByte
06-07-2004, 04:46 PM
You're dead right and I had thought of that but there really is no reason for linking to these pages, all anyone would get by visiting these pages directly would be a message saying "your shopping basket is currently empty" ??