arrow
返回

Feature selection based on a normalized difference measure for text classification

delete2017-03-01
delete105
PRE
AI
A
Abdur Rehman *
K
Kashif Javed
DOI:10.1016/j.ipm.2016.12.004delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The goal of feature selection in text classification is to choose highly distinguishing features for, improving the performance of a classifier. The well-known text classification feature selection metric named balanced accuracy measure (ACC2) (Forman, 2003) evaluates a term by taking the difference of its document frequency in the positive class (also known as true positives) and its document frequency in the negative class (also known as false positives). This however results in assigning equal ranks to terms having equal difference, ignoring their relative document frequencies in the classes. In this paper we propose a new feature ranking (FR) metric, called normalized difference measure (NDM), which takes into account the relative document frequencies. The performance of NDM is investigated against seven well known feature ranking metrics including odds ratio (OR), chi squared (CHI), information gain (IG), distinguishing feature selector (DFS), gini index (GINI),balanced accuracy measure (ACC2) and Poisson ratio (POIS) on seven datasets namely We-bACE(WAP,K1a,K1b), Reuters (REO, RE1),spam email dataset and 20 newsgroups using the multinomial naive Bayes (MNB) and supports vector machines (SVM) classifiers. Our results show that the NDM metric outperforms the seven metrics in 66% cases in terms of macro-Fl measure and in 51% cases in terms of micro F1 measure in our experimental trials on these datasets. (C) 2016 Elsevier Ltd. All rights reserved.
Keyword:
Text classification
Feature selection
Accuracy measure
Document frequency
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

U
university of engineering & technology lahore
学者数:
2.7K
论文数: 2.2K
被引数: 0
U
University of Gujrat
学者数:
1.9K
论文数: 1.5K
被引数: 2.2K
引用论文

引用论文

Improvement of carbon nanotube dispersion in thermoplastic composites using a three roll mill at elevated temperatures
err2013-01-01
err0
PREAI
errPetra Pötschke; Beate Krause; Samuel T. Buschhorn; Ulf Köpke; Michael T. Müller; Tobias Villmow; Karl Schulte
err分享
err收藏
Effects of anticholinesterase drugs on biomarkers and behavior of pumpkinseed, Lepomis gibbosus (Linnaeus, 1758)
err2012-01-01
err0
PREAI
errSara Rodrigues; Sara C. Antunes; Fátima P. Brandão; Bruno B. Castro; Fernando Gonçalves; Bruno Nunes
err分享
err收藏
Analysis of plating grain size effect on whisker
err2010-01-21
err0
PREAI
errSeung-Jung Shin; Jae-Jung Kim; Young Kap Son
err分享
err收藏
学者 查看更多内容