arrow
Return

Compositional Distributed Learning for Multi-View Perception: A Maximal Coding Rate Reduction Perspective

delete2025-01-01
delete0
PRE
AI
Z
Zhuojun Tian
M
Mehdi Bennis
DOI:10.1109/LSP.2025.3633169delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent conducts a periodic singular value decomposition on its learned subspaces and exchanges truncated basis matrices, based on which the fused subspaces are obtained. By introducing a projection matrix and minimizing the distance between the outputs and its projection, the learned representations are enforced towards the fused subspaces. It is proved that the trace on the coding-rate change is bounded and the consistency of basis fusion is guaranteed theoretically. Numerical simulations validate that the proposed algorithm achieves high classification accuracy while maintaining representations' diversity, compared to baselines showing correlated subspaces and coupled representations.
Keywords:
Distributed learning
maximal coding rate reduction
multi-view perception
subspace learning

Journal

I
IEEE Signal Processing Letters
IF:
3.9
Papers:
583
Citations:
0

Organization

U
University of Oulu
Scholars:
1.5W
Papers: 1.3W
Citations: 1.6W