arrow
Return

Supervised maximum variance unfolding

delete2024-06-19
delete0
delete
OA
AI
D
Deliang Yang *
H
Houduo Qi
DOI:10.1007/s10994-024-06553-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Maximum Variance Unfolding (MVU) is among the first methods in nonlinear dimensionality reduction for data visualization and classification. It aims to preserve local data structure and in the meantime push the variance among data as big as possible. However, MVU in general remains a computationally challenging problem and this may explain why it is less popular than other leading methods such as Isomap and t-SNE. In this paper, based on a key observation that the structure-preserving term in MVU is actually the squared stress in Multi-Dimensional Scaling (MDS), we replace the term with the stress function from MDS, resulting in a model that is usable. The property of the usability guarantees the crowding phenomenon will not happen in the dimension reduced results. The new model also allows us to combine label information and hence we call it the supervised MVU (SMVU). We then develop a fast algorithm that is based on Euclidean distance matrix optimization. By making use of the majorization-mininmization technique, the algorithm at each iteration solves a number of one-dimensional optimization problems, each having a closed-form solution. This strategy significantly speeds up the computation. We demonstrate the advantage of SMVU on some standard data sets against a few leading algorithms including Isomap and t-SNE.
Keywords:
Maximum variance unfolding
Euclidean distance matrix
Multi-dimensional scaling
Dimensionality reduction
Data visualization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

U
University of Hong Kong
Scholars:
4.1W
Papers: 3.9W
Citations: 10.1W
H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921
Cited Papers

Cited Papers

Exploring the effect of library preparation on RNA sequencing experiments
err2019-12-01
err0
errOAAI
errLei Wang; Sara J. Felts; Virginia P. Van Keulen; Larry R. Pease; Yuji Zhang
errShare
errSave
Deep learning based on multi-omics integration identifies potential therapeutic targets in breast cancer
err
IF0
err2022-01-21
err0
errOAAI
errXingxin Pan; Brandon Burgman; Nidhi Sahni; S. Stephen Yi
errShare
errSave
Robust Euclidean embedding via EDM optimization
err2019-08-09
err7
errOAAI
errZhou, Shenglong; Xiu, Naihua; Qi, Hou-Duo
errShare
errSave
Human pharyngeal microbiota in age-related macular degeneration
err2018-08-08
err0
errOAAI
errEliza Xin Pei Ho; Chui Ming Gemmy Cheung; Shuzhen Sim; Collins Wenhan Chu; Andreas Wilm; Clarabelle Bitong Lin; Ranjana Mathur; Doric Wong; Choi Mun Chan; Mayuri Bhagarva; Augustinus Laude; Tock Han Lim; Tien Yin Wong; Ching Yu Cheng; Sonia Davila; Martin Hibberd
errShare
errSave
errShare
errSave
Rank-Constrained Spectral Clustering With Flexible Embedding
err2018-12-01
err217
PREAI
errLi, Zhihui; Nie, Feiping; Chang, Xiaojun; Nie, Liqiang; Zhang, Huaxiang; Yang, Yi
errShare
errSave
researcher View more