arrow
Return

Optimal margin distribution matrix machine

delete2024-04-01
delete2
PRE
AI
S
Shuangyi Fan
L
Li Jun Liu
张里博 cover
张里博 (Libo Zhang) *
DOI:10.1016/j.eswa.2023.122497delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As a proficient matrix classifier, Support Matrix Machine (SMM) utilizes the structural information within matrices to achieve remarkable classification results. Recent theoretical advancements have emphasized the importance of optimizing margin distribution (MD) for improving generalization performance. Regrettably, this crucial aspect has been neglected within the framework of the SMM. Furthermore, SMM inherits the hinge loss function from Support Vector Machine (SVM), which has a detrimental impact on its robustness to noise interference. To address these issues, we propose a novel matrix classification method called Optimal Margin Distribution Matrix Machine (ODMM) by introducing a novel MD-based loss function. Our model not only leverages the structural information of the matrix through the low-rank condition but also enhances the generalization performance of the classifier by optimizing the margin distribution. Specifically, we derive the MD-based loss function based on the first-order and second-order statistics of the margin, replacing the traditional hinge loss function in SMM. Additionally, to solve the optimization problem of ODMM, we developed an algorithm based on the Alternating Direction Method of Multipliers (ADMM) framework. Finally, we demonstrate the superior performance of our proposed ODMM through comprehensive comparative experimental analysis.
Keywords:
Matrix classifier
Support matrix machine
Margin distribution
Low rank

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

S
southwest university - china
Scholars:
2.6W
Papers: 1.9W
Citations: 21