Mixed feature selection based on granulation and approximation

doi:10.1016/j.knosys.2007.07.001

2008-05-01

234

PRE

胡清华 (Qinghua Hu) *

Jinfu Liu

Daren Yu

DOI：10.1016/j.knosys.2007.07.001

原文链接

原文求助

摘要

En 中文

Feature subset selection presents a common challenge for the applications where data with tens or hundreds of features are available. Existing feature selection algorithms are mainly designed for dealing with numerical or categorical attributes. However, data usually comes with a mixed format in real-world applications. In this paper, we generalize Pawlak's rough set model into delta neighborhood rough set model and k-nearest-neighbor rough set model, where the objects with numerical attributes are granulated with delta neighborhood relations or k-nearest-neighbor relations, while objects with categorical features are granulated with equivalence relations. Then the induced information granules are used to approximate the decision with lower and upper approximations. We compute the lower approximations of decision to measure the significance of attributes. Based on the proposed models, we give the definition of significance of mixed features and construct a greedy attribute reduction algorithm. We compare the proposed algorithm with others in terms of the number of selected features and classification performance. Experiments show the proposed technique is effective. (C) 2007 Elsevier B.V. All rights reserved.

Keyword:

feature selection

numerical feature

categorical feature

delta neighborhood

k-nearest-neighbor

rough sets