Feature selection based on a normalized difference measure for text classification

Abdur Rehman

doi:10.1016/j.ipm.2016.12.004

Return

Feature selection based on a normalized difference measure for text classification

2017-03-01

105

PRE

Abdur Rehman *

Kashif Javed

DOI：10.1016/j.ipm.2016.12.004

Original

Original request for help

Save

Abstract

En 中文

The goal of feature selection in text classification is to choose highly distinguishing features for, improving the performance of a classifier. The well-known text classification feature selection metric named balanced accuracy measure (ACC2) (Forman, 2003) evaluates a term by taking the difference of its document frequency in the positive class (also known as true positives) and its document frequency in the negative class (also known as false positives). This however results in assigning equal ranks to terms having equal difference, ignoring their relative document frequencies in the classes. In this paper we propose a new feature ranking (FR) metric, called normalized difference measure (NDM), which takes into account the relative document frequencies. The performance of NDM is investigated against seven well known feature ranking metrics including odds ratio (OR), chi squared (CHI), information gain (IG), distinguishing feature selector (DFS), gini index (GINI),balanced accuracy measure (ACC2) and Poisson ratio (POIS) on seven datasets namely We-bACE(WAP,K1a,K1b), Reuters (REO, RE1),spam email dataset and 20 newsgroups using the multinomial naive Bayes (MNB) and supports vector machines (SVM) classifiers. Our results show that the NDM metric outperforms the seven metrics in 66% cases in terms of macro-Fl measure and in 51% cases in terms of micro F1 measure in our experimental trials on these datasets. (C) 2016 Elsevier Ltd. All rights reserved.

Keywords:

Text classification

Feature selection

Accuracy measure

Document frequency

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.