arrow
Return

Stability-based PAC-Bayes analysis for multi-view learning algorithms

delete2022-10-01
delete7
delete
OA
AI
S
Shiliang Sun *
M
Mengran Yu
J
John Shawe‐Taylor
L
Liang Mao
DOI:10.1016/j.inffus.2022.06.006delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Multi-view learning exploits structural constraints among multiple views to effectively learn from data. Although it has made great methodological achievements in recent years, the current generalization theory is still insufficient to prove the merit of multi-view learning. This paper blends stability into multi-view PAC-Bayes analysis to explore the generalization performance and effectiveness of multi-view learning algorithms. We propose a novel view-consistency regularization to produce an informative prior that helps to obtain a stability-based multi-view bound. Furthermore, we derive an upper bound on the stability coefficient that is involved in the PAC-Bayes bound of multi-view regularization algorithms for the purpose of computation, taking the multi-view support vector machine as an example. Experiments provide strong evidence on the advantageous generalization bounds of multi-view learning over single-view learning. We also explore strengths and weaknesses of the proposed stability-based bound compared with previous non-stability multi-view bounds experimentally.
Keywords:
Multi-viewlearning
PAC-Bayesanalysis
Stability
Generalization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.1K
Citations:
2.7W

Organization

E
east china normal university
Scholars:
3.0W
Papers: 2.1W
Citations: 25
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305