Web Design Forums

kr · 12-04-2008, 11:12

hi every one ...
does any one have any idea of how a search engine finds what pages to index ..
ie where does it get the list of web pages it has to index ..

Do Gooder · 12-04-2008, 11:34

spiders!

pgo · 12-04-2008, 11:38

Yep. Spiders.

They run around the web and follow links and keep track of all the pages they visit.

Do Gooder · 12-04-2008, 11:39

Web crawler - Wikipedia, the free encyclopedia

12-04-2008, 11:12	#1 (permalink)
kr Registered User Join Date: Apr 2008 Posts: 1	list of sites in www hi every one ... does any one have any idea of how a search engine finds what pages to index .. ie where does it get the list of web pages it has to index ..

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

12-04-2008, 11:34	#2 (permalink)
Do Gooder Join Date: May 2007 Posts: 5,431	spiders!

12-04-2008, 11:38	#3 (permalink)
pgo Senior Member Join Date: Jan 2005 Posts: 12,358	Yep. Spiders. They run around the web and follow links and keep track of all the pages they visit.

12-04-2008, 11:39	#4 (permalink)
Do Gooder Join Date: May 2007 Posts: 5,431	Web crawler - Wikipedia, the free encyclopedia

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)