Tuesday, April 20, 2004 12:16 AM
I would like to know the need for the Search Engine(Google, Altavista etc) to crawl. I know this question may sound very weird but i am bit confused. When ever you register your site to a Search engine it will crawl the submitted web page eventually crawling all the links found, but i may have links to other site like (www.java.net) so the crawler will crawl that too ???? if yes why it should ??