View Full Version : Inner pages are not crawl
02-06-2007, 09:27 PM
Hello Everyone ,
My site working good in Google, yahoo, MSN but major Problem is that my inner pages are crawl by any search engine is very late like resource page ,about us page and other .My home page is crawl with in 3 or 4 days but inner pages are last crawl in 30 dec. It is major problem .Directory summation is continue and updation is also .Please suggest me exact reason and proper ans.
Place text links pointing to inner pages from your home page at top as well at bottom after some time you can remove the top one. And do update your sitemap with new links and resubmit it.
02-07-2007, 05:23 AM
yes thats right.. link all your pages... and try to look if your page are meta robots or robots.txt...
02-07-2007, 11:14 AM
do you have any sitemap? have you tried to submit them in Google and Yahoo?
02-07-2007, 11:25 AM
Jonsmith there can be lots of reasons for that, none will be "exact". But without knowing more about the site structure and pages in question, its going to be hard to help you. Can you give us a link to one of the troublesome pages so we can look at it?
Myself I wouldn’t worry too much about how often its spidered as long as its in the RI. If it’s a deep page, duplicate or void of useful content the frequency of visits will decrease.
02-09-2007, 05:34 AM
Sitemaps are very helpful for indexing inner pages. But also, try deep linking to get your pages indexed faster. :)
02-09-2007, 08:04 AM
you can make sitemaps and be sure that all your pages are linked with each other.
02-09-2007, 08:49 AM
02-09-2007, 08:11 PM
What is use sitemap.
02-10-2007, 01:27 AM
Hi, certainly using a sitemap, a search engine friendly one, and also texts instead of the image links and having more than one navigation system can help.
02-16-2007, 10:23 PM
Updating your sitemap will be a great help. Actually, there are various of reasons regarding your problem. Check also the site structure. If you have a deep site structure, then you may had the problem because of that. You need to (flatten)broaden your site's structure because search engine's spider do not frequently dig down through your site. Advisable deep of your directory is 2 to 3 levels deep.The main disadvantage of deep or vertical directory structures is the fact that search engines spiders may well have difficulty finding and indexing the pages within the deeper directories. Some search engine spiders will only go 2-3 levels deep with their spidering. This is especially so when the deep pages are not well linked, such as from the home page, top level directories or site map.
Make the spidering of your website as easy as possible for search engine spiders. Use keywords for your directory names and website pages. Research and testing has shown that keywords in a url can and do have a ranking benefit albeit often indirectly. Nowadays this has more to do with incoming link text, but it does have an effect never the less.
02-16-2007, 10:26 PM
it will take some time but it will get crawled.
vBulletin v3.0.3, Copyright ©2000-2013, Jelsoft Enterprises Ltd.