Sites and Subsites

[nkernick]

Dear all

A question I ask myself is why does google STOP indexing when it reaches the 3rd level down. My first page (page 1 - indexed) links to a Subject Page(page 2 - indexed) which has a list of brands (page 3 all indexed)

On the brand page there are links to product pages (not indexed) - apart from products which appeared on the initial (page 2) these are indexed.

Hope you are keeping up here.....

Ok, My question is when does a site become a subsite. So , when does google decide that I have a site within a site. For example a geocities website

http://geocities.yahoo.com/mysite

And does google index this site (above) in full (ie 3 links down) as well as the geocities site. itself (3 links down)

I hope this makes sense.

[megri]

Google takes time in indexing your all level In first go if they have indexd 3 level it is better Wait for the time it will index all of your site if it is having good theme based inbound links

[nkernick]

6 months on and still waiting to be fully indexed !!!

[jocelyn]

[QUOTE=nkernick]6 months on and still waiting to be fully indexed !!![/QUOTE]
Did you make a site map ?
If you link it from your homepage, and has all your site pages listed on it, they become all 3nd level.
It's also usefull for your visitors.

[nkernick]

Yes I have a sitemap however there are 10,000 products which I see as a problem.

[Pyrrhonist]

Hey nkernick,

Ok, from what I understand, one of the primary reasons G-bot doesn't go lower than 3 levels down is due to spider traps.

As far as your 10,000 products - don't worry too much about it. SEO Guy's done some tests with maxiumum link numbers, and has found that the real limitation is really the maximum file size. Due to size and resource limitations, the most that G will spider at once is 255 K (i think... and i've heard rumours this may be increasing)

Jocelyn is right with the site map. A site map is the way to go. Index it right of the home page, and everything is within 3 levels.

[nkernick]

Bob

You would put 10,000 products in the sitemap?

[Pyrrhonist]

What I would do is put 500 links on the first level of site map that pointed down to sub-sitemaps. That would mean that each of the sub-sitemaps would only require 20 links to be present.