arrow
Return

Efficient Exact Inference With Loss Augmented Objective in Structured Learning

delete2017-11-01
delete4
PRE
AI
A
Alexander Bauer
S
Shinichi Nakajima
K
Klaus-Robert Müller *
DOI:10.1109/TNNLS.2016.2598721delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Structural support vector machine (SVM) is an elegant approach for building complex and accurate models with structured outputs. However, its applicability relies on the availability of efficient inference algorithms-the state-of-the-art training algorithms repeatedly perform inference to compute a subgradient or to find the most violating configuration. In this paper, we propose an exact inference algorithm for maximizing nondecomposable objectives due to special type of a high-order potential having a decomposable internal structure. As an important application, our method covers the loss augmented inference, which enables the slack and margin scaling formulations of structural SVM with a variety of dissimilarity measures, e.g., Hamming loss, precision and recall, F-beta-loss, intersection over union, and many other functions that can be efficiently computed from the contingency table. We demonstrate the advantages of our approach in natural language parsing and sequence segmentation applications.
Keywords:
Dynamic programming
graphical models
high-order potentials
inference
margin scaling (MS)
slack scaling (SS)
structural support vector machines (SVMs)
structured output

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

T
Technical University of Berlin
Scholars:
126
Papers: 65
Citations: 0
Cited Papers

Cited Papers

In silico mapping of 1758 new SSR markers developed from public genomic sequences for sorghum
err2009-03-01
err0
PREAI
errManli Li; Nana Yuyama; Le Luo; Mariko Hirata; Hongwei Cai
errShare
errSave
An Anthropogenic Habitat Facilitates the Establishment of Non-Native Birds by Providing Underexploited Resources
err2015-08-14
err0
errOAAI
errMartin J. P. Sullivan; Richard G. Davies; Hannah L. Mossman; Aldina M. A. Franco
errShare
errSave
VITERBI ALGORITHM
err1973-01-01
err3.9K
PREAI
errFORNEY, GD
errShare
errSave
Synthesis and Chromatographic Properties of Liquid Crystalline Polysiloxanes Containing Steroid Substituents
err2007-03-28
err0
PREAI
errNathan W. Adams; Jerald S. Bradshaw; Jose-Maria Bayona; Karin E. Markides; Milton L. Lee
errShare
errSave
Efficient Algorithms for Exact Inference in Sequence Labeling SVMs
err2014-05-01
err17
PREAI
errBauer, Alexander; Goernitz, Nico; Biegler, Franziska; Mueller, Klaus-Robert; Kloft, Marius
errShare
errSave
Cutting-plane training of structural SVMs
err2009-05-09
err674
errOAAI
errJoachims, Thorsten; Finley, Thomas; Yu, Chun-Nam John
errShare
errSave
Chemical and Kinetic Reaction Mechanisms of Quinohemoprotein Amine Dehydrogenase fromParacoccus denitrificans
err2003-08-26
err0
PREAI
errDapeng Sun; Kazutoshi Ono; Toshihide Okajima; Katsuyuki Tanizawa; Mayumi Uchida; Yukio Yamamoto; F. Scott Mathews; Victor L. Davidson
errShare
errSave
researcher View more