arrow
Return

An alternative framework for univariate filter based feature selection for text categorization

delete2018-02-01
delete30
PRE
AI
D
D. S. Guru *
M
Mahamad Suhil
L
Lavanya Narayana Raju
N
Nitish Kumar
DOI:10.1016/j.patrec.2017.12.025delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we introduce an alternative framework for selecting a most relevant subset of the original set of features for the purpose of text categorization. Given a feature set and a local feature evaluation function (such as chi-square measure, mutual information etc.,) the proposed framework ranks the features in groups instead of ranking individual features. A group of features with rth rank is more powerful than the group of features with (r + 1) th rank. Each group is made up of a subset of features which are supposed to be capable of discriminating every class from every other class. The added advantage of the proposed framework is that it automatically eliminates the redundant features while selecting features without requirement of study of features in combination. Further the proposed framework also helps in handling overlapping classes effectively through selection of low ranked yet powerful features. An extensive experimentation has been conducted on three benchmarking datasets using four different local feature evaluation functions with Support Vector Machine and Naive Bayes classifiers to bring out the effectiveness of the proposed framework over the respective conventional counterparts. (c) 2018 Elsevier B.V. All rights reserved.
Keywords:
Dimensionality reduction
Filter based feature selection
Text classification
Feature redundancy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

U
University of Mysore
Scholars:
2.0K
Papers: 1.4K
Citations: 1.2K