STRATEGIZE

Introduction To Search Engine Spiders

Search engines use small computer programs to browse through and read web pages on the Internet. Such programs are often referred to as "search engine spiders" or "search engine robots." When a search engine spider visits a page, it first reads the text on the page and then tries to follow links from that page off to other web pages and websites.

You can think of a search engine spider as a very simple form of automated browser. It traverses the Internet like a human would do with a browser - just many times faster and fully automated.

Unlike ordinary browsers, however, search engine spiders do not "view" web pages - they simply "read" the content and click the links. Search engine spiders do not enjoy or appreciate the great design and "cool" images on your web pages.

Examples of popular spidering search engines include:

• Yahoo
• Google
• Ask Jeeves/Teoma

Back to Strategize