返回
A dictionary based model for bengali document classification
DOI:10.1007/s10489-022-03955-w.png)
摘要
En 中文
Computer-aided documented content analysis is a prominent research area in natural language processing. A realistic implementation of this task is related to the subjectivity of the quantifiable data. One of the most interesting specialisations of this problem is automated document classification, which is a system that can identify the category of a document without human intervention. The problem of document classification has to consider the evaluation of the heart-of-the-matter of the textual material. Being one of the most-spoken languages in the world, a huge number of Bengali documents are present in digital form, and it is increasing rapidly due to the age of the internet. A document classification method is required to organise and categorise these huge documents rapidly and efficiently. In this paper, a decisive dictionary based model has been presented for the classification of documents in the Bengali text. We have introduced the concepts of lexiconid, lexiconaffinity, lexiconunicity, and lexiconassociation to acquire the features. The feature set is integrated with different levels of threshold. The proposed model is supervised, and the entire dataset has been split into testing and training sets. The proposed model has been validated using the k-fold cross-validation strategy. A significant number of dictionary based parameter values have been estimated for each token present in the text. In this paper, the text has been classified using a new rule based classification algorithm, predictive lexicon inference (PLI) classifier. The proposed model has been evaluated on five datasets: ParadiseLost, Iliad, Odyssey, Ramayana, and Mahabharata. In addition to document classification, this algorithm enables name entity classification, and chronology or description classification.
Keyword:
Bengali
Predictive lexicon inference classifier
Dictionary based model
Document classification
Natural language processing
Text classification
期刊
IF:
3.5
论文数:
7.7K
被引数:
2.2W
机构
引用论文
Heavy metals research in Nigeria: a review of studies and prioritization of research needs尼日利亚的重金属研究: 研究回顾和研究需求的优先次序
A multi-class SVM classification system based on learning methods from indistinguishable chinese official documents基于无差别中文公文学习方法的多类SVM分类系统

