Study of an Intelligent Spider Algorithm & Metasearch Engines

The main aim of search engines is to provide most relevant documents to the users in minimum possible time. People search for a variety of reasons. A big reason to search is to look for something known to exist. Determining a user’s preference of Web searches is a difficult problem due to the large amount of data available concerning the searcher. Indexing is performed on the web pages after they have been gathered into a repository by the crawler. In this paper we have made the survey of working of search engines & also analyzed the highly scalable & potential metasearch engines. A metasearch engine is a system that supports unified access to multiple local search engines. It queries other search engines and then combines the results that are received from all. In effect, the user is not using just one search engine but a combination of many search engines at once to optimize Web searching.