arrow
Return

Supervised Hebb rule based feature selection for text classification

delete2019-01-01
delete31
PRE
AI
H
Heyong Wang *
M
Ming Hong
DOI:10.1016/j.ipm.2018.09.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Text documents usually contain high dimensional non-discriminative (irrelevant and noisy) terms which lead to steep computational costs and poor learning performance of text classification. One of the effective solutions for this problem is feature selection which aims to identify discriminative terms from text data. This paper proposes a method termed Hebb rule based feature selection (HRFS). HRFS is based on supervised Hebb rule and assumes that terms and classes are neurons and select terms under the assumption that a term is discriminative if it keeps exciting the corresponding classes. This assumption can be explained as a term is highly correlated with a class if it is able to keep exciting the class according to the original Hebb postulate. Six benchmarking datasets are used to compare HRFS with other seven feature selection methods. Experimental results indicate that HRFS is effective to achieve better performance than the compared methods. HRFS can identify discriminative terms in the view of synapse between neurons. Moreover, HRFS is also efficient because it can be described in the view of matrix operation to decrease complexity of feature selection.
Keywords:
Text classification
Feature selection
Hebb rule
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

errShare
errSave
An alternative framework for univariate filter based feature selection for text categorization
err2018-02-01
err30
PREAI
errGuru, D. S.; Suhil, Mahamad; Raju, Lavanya Narayana; Kumar, N. Vinay
errShare
errSave
errShare
errSave
Semi-Supervised Text Classification With Universum Learning
err2016-02-01
err63
PREAI
errLiu, Chien-Liang; Hsaio, Wen-Hoar; Lee, Chia-Hoang; Chang, Tao-Hsing; Kuo, Tsung-Hsun
errShare
errSave
A Bayesian feature selection paradigm for text classification
err2012-03-01
err34
PREAI
errFeng, Guozhong; Guo, Jianhua; Jing, Bing-Yi; Hao, Lizhu
errShare
errSave
researcher View more