Design Issues in Web Crawlers and Review of Parallel Crawlers
Journal: International Journal of Science and Research (IJSR) (Vol.5, No. 6)Publication Date: 2016-06-05
Authors : Komal; Ashutosh Dixit;
Page : 61-64
Keywords : WWW; URL; Mobile Crawler; Web Crawler; Mobile Agents; Parallel Crawler;
Abstract
With the increase in size of web, search engine depends upon the Web Crawler to download and build index of million/billion of pages for efficient information retrieval when user interact through search interface. This paper will include the definition of Web Crawler, criteria on the basis of which various types of crawler are defined [4] and some common issues with the design of crawler, parallel crawler, its issues and comparison of solutions provided by researchers.
Other Latest Articles
- Fabrication of Hydropump
- Prevalence of Color Vision Deficiency among Medical Students in KFU- SA (2014 ? 2015)
- The Nitrate Reductase Assay in the Rapid Detection of Multidrug-Resistant and Extensively Drug- Resistant Tuberculosis in South Gujarat, India
- Hepatitis B Vaccination Status among Medical Students at King Faisal University
- Incorporating Technology into Curriculum from Teacher's Perspective (Blended Language Learning)
Last modified: 2021-07-01 14:39:08