Development of a Hindi Named Entity Recognition System without Using Manually Annotated Training Corpus
Journal: The International Arab Journal of Information Technology (Vol.15, No. 6)Publication Date: 2018-11-01
Authors : Sujan Kumar Saha; Mukta Majumder;
Page : 1088-1098
Keywords : Natural language processing; machine learning; named entity recognition; resource scarcity; language transfer; semi-supervised learning;
Abstract
Machine learning based approach for Named Entity Recognition (NER) requires sufficient annotated corpus to train the classifier. Other NER resources like gazetteers are also required to make the classifier more accurate. But in many languages and domains relevant NER resources are still not available. Creation of adequate and relevant resources is costly and time consuming. However a large amount of resources and several NER systems are available in resource-rich languages, like English. Suitable language adaptation techniques, NER resources of a resource-rich language and minimally supervised learning might help to overcome such scenarios. In this paper we have studied a few such techniques in order to develop a Hindi NER system. Without using any Hindi NE annotated corpus we have achieved a reasonable accuracy of F-Measure 73.87 in the developed system
Other Latest Articles
- Recognition of Handwritten Characters Based on Wavelet Transform and SVM Classifier
- Semi Fragile Watermarking for Content based Image Authentication and Recovery in the DWT-DCT Domains
- Explicitly Symplectic Algorithm for Long-time Simulation of Ultra-flexible Cloth
- Modified Binary Bat Algorithm for Feature Selection in Unsupervised Learning
- A Physical Topology Discovery Method Based on AFTs of Down Constraint
Last modified: 2019-04-30 21:39:23