MSN has iindexed only about 114 pages on my site. I did not know why until I found that all the pages that it had indexed were just within two clicks from the home page. If MSN had gone down just one more level it would have indexed about 1600 pages.

Is there a way to over come this problem without re-designing the whole web site.

This problem is about the site http://www.lampspecs.co.uk

__________________
My posts are mainly concerned with optimising my site Linolite Direct

I think like most search engine crawlers they're choking on these very search engine unfriendly urls with session IDs;

http://www.lampspecs.co.uk/Light-Bulbs-Tubes/Light-Bulbs;jsessionid=ac112b801f435eaa70926b3341dc90e6a 36f1dea46c9.e3eTaxiPc3mTe3uQax4Tax4Ob41ynknvrkLOlQ zNp65In0

I would lose the session IDs by forcing users to accept cookies. You might lose a very small minority of users who don't accept cookies, but that would be more than made up for by ranking improvements.

Also to help with deep crawling I'd build a sitemap and link it from every page.

__________________
10.3 million entries for Hotels in Turkey but I'm still chipping away.

I have no control over session ID's, they are part of the Netsuite system. I also have both a sitemap.xml(in root) and a sitemap.html(Linked from the home page)

__________________
My posts are mainly concerned with optimising my site Linolite Direct

You won't like to hear this but I have to say it anyway.

I haven't seen a url with a session ID ranking well in Google or Yahoo for a LONG time. Search engines tend to index urls not pages and that has implications if you are using session IDs. SEs hate session IDs because they can end up indexing the same content on a "new" url each time they visit. If they indexed these new urls every time they visited, they would end up storing enormous amounts of duplicate content. Because their resources are finite, they're reluctant to crawl and index a site once they've figured out it's using session IDs and sessionid=ac112b80... in the url is a pretty good giveaway if you think about it.

If I were you I'd either work with Netsuite to get rid of them or get another CMS.

__________________
10.3 million entries for Hotels in Turkey but I'm still chipping away.

PAZ how do you see the session id's, they do not appear in my browser?

__________________
My posts are mainly concerned with optimising my site Linolite Direct

Hi,

I see them from the first click on the page eg light bulbs via the image links. Set your browser to "disable cookies" (to simulate what the search engines will see because they don't accept cookies) and you'll something like the screen below.

__________________
10.3 million entries for Hotels in Turkey but I'm still chipping away.

personaly me also do not like these kinds of URLs... these are very difficult to bookmark...

__________________
Unemployed Loans UK

My Logbook Loans - Logbook Loans in the UK

I get the session IDs also. If I were you, I would look into getting a new shopping cart like www.pinnaclecart.com or www.cs-cart.com - Both very good solutions, check them out and see which one matches your needs. I personally like CS though.