Question About The Google Crawling Process

[PuReWebDev]

I run Google's Adsense ads on my site. Normally the first time a page is run with an Adsense ad on it, it will be crawled by the spider Mediapartners-Google/2.1 within five minutes (so they can set targeted ads for the page).

My question is, does the spider Googlebot/2.1 (+http://www.google.com/bot.html) still need to crawl my site afterwards for the actual page's content to be indexed by Google, or does that happen when the Mediapartners bot comes crawling?


Thanks for you response.
--PuRe

[jocelyn]

Yes these are two different processes. The mediapartner one will not tell the googlebot/2.1 to crawl your pages. The googlebot/2.1 will find you through links, but the mediapartner one through executing the adsence code. I did a test, created an orphan dumb page and open it to get the mediapartner to crawl it. Then waited for the page to pop in my logs as being crawled by googlebot/2.1... been almost a year and still no crawling or indexing for that dumb page.

People think they could get a "get me index quick" trick with that... waste of time.