arrow
Return

Graph Embedded Nonparametric Mutual Information For Supervised Dimensionality Reduction

delete2015-05-01
delete27
delete
OA
AI
D
Dimitrios Bouzas *
N
Nikolaos Arvanitopoulos
A
Anastasios Tefas
DOI:10.1109/TNNLS.2014.2329240delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this paper, we propose a novel algorithm for dimensionality reduction that uses as a criterion the mutual information (MI) between the transformed data and their corresponding class labels. The MI is a powerful criterion that can be used as a proxy to the Bayes error rate. Furthermore, recent quadratic nonparametric implementations of MI are computationally efficient and do not require any prior assumptions about the class densities. We show that the quadratic nonparametric MI can be formulated as a kernel objective in the graph embedding framework. Moreover, we propose its linear equivalent as a novel linear dimensionality reduction algorithm. The derived methods are compared against the state-of-the-art dimensionality reduction algorithms with various classifiers and on various benchmark and real-life datasets. The experimental results show that nonparametric MI as an optimization objective for dimensionality reduction gives comparable and in most of the cases better results compared with other dimensionality reduction methods.
Keywords:
Data visualization
dimensionality reduction
face recognition
feature extraction
graph embedding framework
mutual information (MI)
quadratic mutual information

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

No organization information available
Cited Papers

Cited Papers

Nonlinear Component Analysis as a Kernel Eigenvalue Problem
err1998-07-01
err0
errOAAI
errBernhard Schölkopf; Alexander Smola; Klaus-Robert Müller
errShare
errSave
errShare
errSave
Molecular clusters as models of metallic catalysts
err1994-01-01
err0
PREAI
errBrian F.G. Johnson; Mark Gallup; Yvonne V. Roberts
errShare
errSave
Effect of addition of multiwalled carbon nanotube/graphite nanoplatelets hybrid on the mechanical properties of aluminium
err2020-04-01
err0
PREAI
errPankaj Shrivastava; Syed Nasimul Alam; Deepankar Panda; Santosh Kumar Sahoo; Taraknath Maity; Krishanu Biswas
errShare
errSave
13C NMR investigation of carbon nanotubes and derivatives
err2001-08-01
err0
PREAI
errC. Goze Bac; P. Bernier; S. Latil; V. Jourdain; A. Rubio; S.H. Jhang; S.W. Lee; Y.W. Park; M. Holzinger; A. Hirsch
errShare
errSave
researcher View more