Hi All,

My site is now 10 months old (March 2005) and is still not being spidered by Yahoo (link at bottom of this post). It gets religiously spidered every day by Google, MSN, Ask Jeeves, Lycos etc...
I paid the yahoo search submit to get my homepage spidered every 48 hours which it is being, but still no other pages are being spidered but the homepage.

I was thinking that I would pay for the homepage to be spidered and then hopefully the rest of my site would be spidered automatically. I was then going to stop the payment. No luck though, still just the homepage.

I have quite a lot of good related links, more than many of my competition who are on the first page in yahoo.

Anyone got any further ideas, I've created a sitemap and submitted for the past couple of months from previous advice.

Cheers for your time
Mark

__________________
Pets for Sale - Puppies for Sale at Pets4Homes, the free UK Pet Advertising site.

Hi,

I had a look and yahoo certainly doesn't seem to like your site.

When you say you "paid the search submit", do you mean you applied for entry to the yahoo directory ($300)?

I'm really at a loss to be honest, and think you should write to them.

You COULD try putting a file named robots.txt in the root of your directory (so it will open with http://www.example.com/robots.txt), with this content:

User-agent: *

Disallow:


but really I'm clutching at straws here.

Any more background info, changes, server problems etc. would help.

Cheers,
Paz.

__________________
10.3 million entries for Hotels in Turkey but I'm still chipping away.

Hi Paz,

I mean I subscribed to Yahoo Search Submit, you pay $49 for a site review by yahoo and then $50 deposit for pay per click. This ensures your home URL gets spidered by Yahoo every 48 hours and appears in the SERPs. Everytime someone clicks on your URL you get charged $0.15

This is a bit expensive when you should be able to appear in the SERPs for free, but yahoo wouldnt include my site. Even since I've signed up to this, my site still appears at position 71 in the Serps for 'Pets for Sale' at yahoo.co.uk and selecting UK sites only. I've tried lots of different optimization techniques but my position hardly changes.

Since I've singed up, I have asked their support several questions as to why my site wasnt spidered, i.e. where I being penalized, but they said I wasnt.

I'm not aware of any server issues or other problems, everything seems fine, as all other search engines are visiting daily.

I remember earlier in 2005 around March, April when my site first went live. Yahoo spidered the home page a couple of times but then dropped it from their index. Ever since that, nothing.

Anyone else got any ideas?

__________________
Pets for Sale - Puppies for Sale at Pets4Homes, the free UK Pet Advertising site.

Just a thought, but were you in the Yahoo! Directory then didn't renew?

That's precisly what happened to me. I had at least a dozen #1 rankings in Yahoo! after I paid the Yahoo! Directory fee of USD$299/year. When it came to renew, I neglected to pay the fee promptly and my listing lapsed. Then, the unfortuneate occured. I was dropped from Yahoo! SERPS almost immediately.

Next, I promptly paid my Yahoo! Directory fee but haven't regained the positions I once dominated.

Sounds like you may be in the same boat.

So, just to ask, were you in the Yahoo! Directory before?