How to make your site Spider-Friendly in 5 steps.
How to make your site spider-friendly in 5 steps
These techniques will help search engine spiders index your site
better:
1) Include a sitemap that has a link to every page on the site
that you want to index (basicly all non-admin, non-members pages)
2) Include at least one static text link to all your main pages
on the index page.
3) Never use relative urls, use the full url: eg
http://www.yourdomain.com/page.php instead of page.php
4) Goto this
page and download the freeware spider Phenix Spider (second
file) and spider your page.
5) If you did steps 1 - 3 correctly Phenix Spider should find
all of the pages you want to index.
Now this will help search engines index your site, as long as
you made good use of META tags and keywords, you should come
high up in the rankings, last time I checked I was top on MSN
for