arrow
返回

A supervised term selection technique for effective text categorization

delete2015-09-18
delete14
PRE
AI
T
Tanmay Basu *
C
C.A. Murthy
DOI:10.1007/s13042-015-0421-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Term selection methods in text categorization effectively reduce the size of the vocabulary to improve the quality of classifier. Each corpus generally contains many irrelevant and noisy terms, which eventually reduces the effectiveness of text categorization. Term selection, thus, focuses on identifying the relevant terms for each category without affecting the quality of text categorization. A new supervised term selection technique have been proposed for dimensionality reduction. The method assigns a score to each term of a corpus based on its similarity with all the categories, and then all the terms of the corpus are ranked accordingly. Subsequently the significant terms of each category are selected to create the final subset of terms irrespective of the size of the category. The performance of the proposed term selection technique is compared with the performance of nine other term selection methods for categorization of several well known text corpora using kNN and SVM classifiers. The empirical results show that the proposed method performs significantly better than the other methods in most of the cases of all the corpora.
Keyword:
Term selection
Feature selection
Dimensionality reduction
Text categorization
Text mining
Data mining

期刊

International Journal of Machine Learning and Cybernetics 封面图
International Journal of Machine Learning and Cybernetics
IF:
2.7
论文数:
3.2K
被引数:
5.6K

机构

I
Indian Statistical Institute
学者数:
1.7K
论文数: 1.8K
被引数: 1.2K
引用论文

引用论文

EML4-ALK Rearrangement and Its Therapeutic Implications in Inflammatory Myofibroblastic Tumors
err2018-05-08
err0
errOAAI
errFernando Vargas-Madueno; Edwin Gould; Raul Valor; Nhu Ngo; Linsheng Zhang; Miguel A. Villalona-Calero
err分享
err收藏
err分享
err收藏
A Bayesian feature selection paradigm for text classification
err2012-03-01
err34
PREAI
errFeng, Guozhong; Guo, Jianhua; Jing, Bing-Yi; Hao, Lizhu
err分享
err收藏
Attenuation of Pb and Sb in shooting range soils by Fe amendments
err2023-03-01
err0
errOAAI
errAmanda J. Barker; Thomas A. Douglas; Karen J. Spaleta; Tom P. Trainor
err分享
err收藏
err分享
err收藏
学者 查看更多内容