ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

Focused Crawling System based on Improved LSI

Journal: International Journal of Science and Research (IJSR) (Vol.2, No. 9)

Publication Date:

Authors : ; ;

Page : 61-64

Keywords : LSI; Breath first crawler; focused crawler;

Source : Downloadexternal Find it from : Google Scholarexternal


In this research work we have developed a semi-deterministic algorithm and a scoring system that takes advantage of the Latent Semantic indexing scoring system for crawling web pages that belong to particular domain or is specific to the topic .The proposed algorithm calculates a preference factor in addition to the LSI score to determine which web page needs to preferred for crawling by the multi threaded crawler application, by doing this we were able to produce a retrieval system that has high recall and precision values as it builds a queue which is specific to a particular domain/topic which would not have been possible in Breath first and only LSI based information retrieval systems.

Last modified: 2013-10-01 22:38:03