arrow
返回

A dictionary based model for bengali document classification

delete2022-10-20
delete2
PRE
AI
D
Debapratim Das Dawn *
A
Abhinandan Khan
S
Soharab Hossain Shaikh
R
Rajat Kumar Pal
DOI:10.1007/s10489-022-03955-wdelete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Computer-aided documented content analysis is a prominent research area in natural language processing. A realistic implementation of this task is related to the subjectivity of the quantifiable data. One of the most interesting specialisations of this problem is automated document classification, which is a system that can identify the category of a document without human intervention. The problem of document classification has to consider the evaluation of the heart-of-the-matter of the textual material. Being one of the most-spoken languages in the world, a huge number of Bengali documents are present in digital form, and it is increasing rapidly due to the age of the internet. A document classification method is required to organise and categorise these huge documents rapidly and efficiently. In this paper, a decisive dictionary based model has been presented for the classification of documents in the Bengali text. We have introduced the concepts of lexiconid, lexiconaffinity, lexiconunicity, and lexiconassociation to acquire the features. The feature set is integrated with different levels of threshold. The proposed model is supervised, and the entire dataset has been split into testing and training sets. The proposed model has been validated using the k-fold cross-validation strategy. A significant number of dictionary based parameter values have been estimated for each token present in the text. In this paper, the text has been classified using a new rule based classification algorithm, predictive lexicon inference (PLI) classifier. The proposed model has been evaluated on five datasets: ParadiseLost, Iliad, Odyssey, Ramayana, and Mahabharata. In addition to document classification, this algorithm enables name entity classification, and chronology or description classification.
Keyword:
Bengali
Predictive lexicon inference classifier
Dictionary based model
Document classification
Natural language processing
Text classification

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.7K
被引数:
2.2W

机构

B
bml munjal university
学者数:
17
论文数: 12
被引数: 144
U
University of Calcutta
学者数:
171
论文数: 72
被引数: 1.9K
引用论文

引用论文

err分享
err收藏
Erythrocyte folate analysis: a cause for concern?
err1998-09-01
err0
errOAAI
errAnthony J A Wright; Paul M Finglas; Susan Southon
err分享
err收藏
Logistic model trees逻辑模型树
err2005-05-01
err943
errOAAI
errLandwehr, N; Hall, M; Frank, E
err分享
err收藏
学者 查看更多内容