.png){kind=icon}
返回
Multimodal manifold learning using kernel interpolation along geodesic paths
.png){kind=icon}
PRE
AI
DOI：10.1016/j.inffus.2024.102637.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper, we present a new spectral analysis and a low-dimensional embedding of two aligned multimodal datasets. Our approach combines manifold learning with the Riemannian geometry of symmetric and positive- definite (SPD) matrices. Manifold learning typically includes the spectral analysis of a single kernel matrix corresponding to a single dataset or a concatenation of several datasets. Here, we use the Riemannian geometry of SPD matrices to devise an interpolation scheme for combining two kernel matrices corresponding to two, possibly multimodal, datasets. We study the way the spectra of the kernels change along geodesic paths on the manifold of SPD matrices. We show that this change enables us, in a purely unsupervised manner, to derive an informative spectral representation of the relations between the two datasets. Based on this representation, we propose a new multimodal manifold learning method. We showcase the performance of the proposed spectral representation and manifold learning method using both simulations and real-measured data from multi-sensor industrial condition monitoring and artificial olfaction. We demonstrate that the proposed method achieves superior results compared to several baselines in terms of the truncated Dirichlet energy.
Keyword:
Manifold learning
Riemannian geometry
Diffusion maps
Symmetric positive definite matrices
Kernel methods
期刊
IF:
15.5
论文数:
4.2K
被引数:
2.7W
机构
引用论文
Exploiting Vibrational Strong Coupling to Make an Optical Parametric Oscillator Out of a Raman Laser
OAAI
OAAI分享收藏分享收藏
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects多模态数据融合: 方法、挑战与展望综述.png)
PROCEEDINGS OF THE IEEEOAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAI分享收藏
查看更多内容