.png){kind=icon}
.png){kind=icon}
Return
Discovering common information in multi-view data
.png){kind=icon}
OA
AI
DOI：10.1016/j.inffus.2024.102400.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We introduce an innovative and mathematically rigorous definition for computing common information from multi-view data, drawing inspiration from Gacs-Korner common information in information theory. Leveraging this definition, we develop a novel supervised multi-view learning framework to capture both common and unique information. By explicitly minimizing a total correlation term, the extracted common information and the unique information from each view are forced to be independent of each other, which, in turn, theoretically guarantees the effectiveness of our framework. To estimate information-theoretic quantities, our framework employs matrix-based Renyi's alpha-order entropy functional, which forgoes the need for variational approximation and distributional estimation in high-dimensional space. Theoretical proof is provided that our framework can faithfully discover both common and unique information from multi-view data. Experiments on synthetic and seven benchmark real-world datasets demonstrate the superior performance of our proposed framework over state-of-the-art approaches.
Keywords:
Multi-view learning
Common information
Matrix-based Renyi's alpha-order entropy functional
Total correlation
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
15.5
Papers:
4.1K
Citations:
2.7W