A Hybrid Approach used to Stem Punjabi Words?
Journal: International Journal of Computer Science and Mobile Computing - IJCSMC (Vol.3, No. 11)Publication Date: 2014-11-30
Authors : Puneet Thapar;
Page : 1-9
Keywords : Stemmer; Stemming; Naive Algorithm; Suffix Striping; Under-stemming; Over-stemming; Stemming Algorithm;
Abstract
Stemming is the process of removing the affixes from inflected words, without doing complete morphological analysis. A stemming Algorithm is a procedure to reduce all words with the same stem to a common form [20]. The purpose of stemming is to obtain the stem or radix of those words which are not found in dictionary. If stemmed word is present in dictionary, then that is a genuine word, otherwise it may be proper name or some invalid word. It is useful in many areas of computational linguistics and information-retrieval work. This technique is used by the various search engines to find the best solution for a problem. The algorithm is a basic building block for the stemmer. Stemmer is basically used in information retrieval system to improve the performance .The paper present a stemmer for Punjabi, which uses a Naive algorithm. We also use a suffix stripping technique in our paper. Similar techniques can be used to make stemmer for other languages such as Hindi, Bengali and Marathi. An in depth analysis of Punjabi news corpus was made and various possible noun suffixes were identified like īā?, iā?, ūā?, ā?, ? īē etc. and the various rules for noun and proper name stemming have been generated. The result of stemmer is good and it can be effective in information retrieval system. This stemmer also reduces the problem of over-stemming and under-stemming.
Other Latest Articles
- Editorial
- Original article: Need For Unique Assessment Parameters And Interventional Modalities In Community Dentistry For School Going Children
- Original article: Predictive Factors For A Successful Arterio-Venous Access For Haemodialysis
- Original article: Comparison Of Vitamin B12 Levels In Gastritis With And Without H.Pylori
- Original article: Study Of Pulmonary Functions In Smokers And Non-Smokers In Sugarcane Harvesters In Rural Maharashtra
Last modified: 2014-11-02 00:11:05