The effects of Pre-Processing Techniques on Arabic Text Classification
Journal: International Journal of Advanced Trends in Computer Science and Engineering (IJATCSE) (Vol.10, No. 1)Publication Date: 2021-02-15
Authors : Anoual El Kah;
Page : 41-48
Keywords : Arabic text classification; Lemmatization; Stemming; Stop words removal; Text preprocessing.;
Abstract
In the last two decades, the amount of available Arabic text data on the World Wide Web is dramatically growing, making it the fourth most used language on the web. Accordingly, the demand for efficient Arabic text classification is increasing, especially for web page content filtering, information retrieval, and e-mail spam detection. Several Machine Learning algorithms have been implemented to classify Arabic documents. However, the results achieved are not comparable with those obtained in other languages such as English, primarily when using preprocessing techniques that do not take into consideration the Arabic language features. This paper investigates the impact of wisely selected preprocessing techniques on the efficiency of different text classification algorithms. The effects of stop words removal, stemming, lemmatization, and all possible combinations are examined. The reported results (+10.75% to +28.73%) prove the effectiveness of using these techniques either individually or in combination.
Other Latest Articles
- Analyzing the Voice of Customer through online user reviews using LDA: Case of Moroccan mobile banking applications
- ENHANCED ALGORITHM OF ARTIFICIAL BEE COLONY (ABC) TO OPTIMIZE MODELS OF SYSTEM RELIABILITY
- A Framework for the Generation of Class Diagram from Text Requirements using Natural language Processing
- CONSISTENCY OF PRIVACY VIEWS ON HIPPOCRATIC AND MULTILEVEL DATABASES USING SMART CONTRACTS
- A Comparative Analysis of Time-frequency Feature Extraction Techniques for Large Scale Electroencephalogram Data
Last modified: 2021-02-18 18:30:54