arrow
Return

Structured large margin machines: sensitive to data distributions

delete2007-07-13
delete70
delete
OA
AI
D
Daniel Yeung
D
Defeng Wang *
W
Wing W. Y. Ng
E
Eric C.C. Tsang
王曦照 cover
王曦照 (Xizhao Wang)
DOI:10.1007/s10994-007-5015-9delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a new large margin classifier-the structured large margin machine (SLMM)-that is sensitive to the structure of the data distribution. The SLMM approach incorporates the merits of structured learning models, such as radial basis function networks and Gaussian mixture models, with the advantages of unstructured large margin learning schemes, such as support vector machines and maxi-min margin machines. We derive the SLMM model from the concepts of structured degree and homospace, based on an analysis of existing structured and unstructured learning models. Then, by using Ward's agglomerative hierarchical clustering on input data (or data mappings in the kernel space) to extract the underlying data structure, we formulate SLMM training as a sequential second order cone programming. Many promising features of the SLMM approach are illustrated, including its accuracy, scalability, extensibility, and noise tolerance. We also demonstrate the theoretical importance of the SLMM model by showing that it generalizes existing approaches, such as SVMs and (MS)-S-4, provides novel insight into learning models, and lays a foundation for conceiving other structured classifiers.
Keywords:
large margin learning
weighted mahalanobis distance (WMD)
homospace
structured learning
agglomerative hierarchical clustering
second order cone programming (SOCP)

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

No organization information available
Cited Papers

Cited Papers

Butorphanol-Mediated Antinociception in Mice: Partial Agonist Effects and Mu Receptor Involvement,
err1997-09-01
err0
PREAI
errH.R. Garner; Timothy F. Burke; C. David Lawhorn; Joanne M. Stoner; William D. Wessinger
errShare
errSave
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
err1998-07-01
err0
errOAAI
errBernhard Schölkopf; Alexander Smola; Klaus-Robert Müller
errShare
errSave
Human homologue of a gene mutated in the slow Wallerian degeneration (C57BL/Wlds) mouse
errGene
IF0
err2002-02-01
err0
PREAI
errF.Shama Fernando; Laura Conforti; Sabrina Tosi; A.David Smith; Michael P Coleman
errShare
errSave
Can primary care research be conducted more efficiently using routinely reported practice-level data: a cluster randomised controlled trial conducted in England?
err2022-07-01
err0
errOAAI
errPeter S Blair; Jenny Ingram; Clare Clement; Grace Young; Penny Seume; Jodi Taylor; Christie Cabral; Patricia Jane Lucas; Elizabeth Beech; Jeremy Horwood; Padraig Dixon; Martin C Gulliford; Nick Francis; Sam T Creavin; Athene Lane; Scott Bevan; Alastair D Hay
errShare
errSave
Stereotyped: Investigating Gender in Introductory Science Courses
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
errShare
errSave
An energy-aware routing protocol for wireless sensor network based on genetic algorithm
err2017-06-22
err0
PREAI
errLingping Kong; Jeng-Shyang Pan; Václav Snášel; Pei-Wei Tsai; Tien-Wen Sung
errShare
errSave
errShare
errSave
researcher View more