Definition by Web Hosting Ratings:
Also known as spider, an automated software that retrieves webpages and follows the hyperlinks contained in them. Used to generate indexes used by search engines.
Next: D Channel
Go back to the web hosting glossary
© 2002 Advameg, Inc. All Rights Reserved.