.png){kind=icon}
返回
Vector representation based on a supervised codebook for Nepali documents classification
.png){kind=icon}
OA
AI
DOI：10.7717/peerj-cs.412.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Document representation with outlier tokens exacerbates the classification performance due to the uncertain orientation of such tokens. Most existing document representation methods in different languages including Nepali mostly ignore the strategies to filter them out from documents before learning their representations. In this article, we propose a novel document representation method based on a supervised codebook to represent the Nepali documents, where our codebook contains only semantic tokens without outliers. Our codebook is domain-specific as it is based on tokens in a given corpus that have higher similarities with the class labels in the corpus. Our method adopts a simple yet prominent representation method for each word, called probability-based word embedding. To show the efficacy of our method, we evaluate its performance in the document classification task using Support Vector Machine and validate against widely used document representation methods such as Bag of Words, Latent Dirichlet allocation, Long Short-Term Memory, Word2Vec, Bidirectional Encoder Representations from Transformers and so on, using four Nepali text datasets (we denote them shortly as A1, A2, A3 and A4). The experimental results show that our method produces state-of-the-art classification performance (77.46% accuracy on A1, 67.53% accuracy on A2, 80.54% accuracy on A3 and 89.58% accuracy on A4) compared to the widely used existing document representation methods. It yields the best classification accuracy on three datasets (A1, A2 and A3) and a comparable accuracy on the fourth dataset (A4). Furthermore, we introduce the largest Nepali document dataset (A4), called NepaliLinguistic dataset, to the linguistic community.
Keyword:
Text classification
Machine learning
Codebook
Nepali documents
Classification
Feature extraction
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.5
论文数:
3.4K
被引数:
6.9K
机构
引用论文
分享收藏Deep neural network to detect COVID-19: one architecture for both CT Scans and Chest X-rays.png)
APPLIED INTELLIGENCEOAAI
APPLIED INTELLIGENCEIF3.5
OAAI分享收藏The Role of Maternal Prepregnancy Body Mass Index in Breastfeeding Outcomes: A Systematic Review
PREAI
分享收藏Advanced Deep Learning-Based Computational Offloading for Multilevel Vehicular Edge-Cloud Computing Networks基于深度学习的多级车载边缘云计算网络计算卸载IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Hydroxyurea does not reverse functional alterations of the nitric oxide-cGMP pathway associated with priapism phenotype in corpus cavernosum from sickle cell mousePLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏分享收藏
查看更多内容