View Full Version : Submitting Pages With .ASP Security


BungalowBill
06-08-2004, 09:30 AM
My problem is I want the spyder bot to map pages of articles that use .asp code to validate if they have a user cookie. If they have a cookie they get the article. If they do not have the cookie then a page asking them to join is displayed. Will the spyder bots map the article pages even though the bot doesn't have a cookie?

Pyrrhonist
06-08-2004, 09:39 AM
I don't think spiders will index cookie dependent sections of a site. If you want a spider to come in, then create an exception for the user-agents that you want to allow. This can be done in PHP, ASP, or Javascript, and isn't very hard to implement.

Cyber-SEO
06-08-2004, 06:52 PM
Well that will also depend on if you want these people to view your cashed pages or not. If you are selling the content of that article to other customers and don't want them to be able to access it without first paying then you may think of doing something like showing only part of the content to the spiders just so that they can grab those pages.

seo guy
06-10-2004, 11:21 PM
Nah, cloak it like WMW does,

example
if Googlebot or cookie pass straight through
if no googlebot or no cookie send to registration or login, quite simple

This is an exceptable instance of cloaking (Not the bad cloaking) and also make sure you insert a pragma no cache in your header so that they cant just get the info by viewing the cached page

Cyber-SEO
06-11-2004, 06:57 AM
Sweet Morgan,

I didn't know you can say no cache to google and it wouldn't cashe the page.

Does that affect page ranking at all? i'm guess not but not sure.