arrow
Return

Maximum margin hidden Markov models for sequence classification

delete2016-07-01
delete7
PRE
AI
N
Nikolaus Mutsam *
F
Franz Pernkopf
DOI:10.1016/j.patrec.2016.03.017delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Discriminative learning methods are known to work well in pattern classification tasks and often show benefits compared to generative learning. This is particularly true in case of model mismatch, i.e. the model cannot represent the true data distribution. In this paper, we derive discriminative maximum margin learning for hidden Markov models (HMMs) with emission probabilities represented by Gaussian mixture models (GMMs). The focus is on single-label sequence classification where the margin objective is specified by the probabilistic gap between the true class and the most competing class. In particular, we use the extended Baum-Welch (EBW) framework to optimize this probabilistic margin embedded in a hinge loss function. Approximations of the margin objective and the derivatives are necessary. In the experiments, we compare maximum margin HMMs to generative maximum likelihood and discriminative conditional log-likelihood (CLL) HMM training. We present results of classifying trajectories of handwritten characters, Australian sign language data, digits of speech data and UCR time-series data. Maximum margin HMMs outperform in many cases CLL-HMMs. Furthermore, maximum margin HMMs achieve a significantly better performance than generative maximum likelihood HMMs. (C) 2016 Elsevier B.V. All rights reserved.
Keywords:
Hidden Markov models
Discriminative learning
Maximum margin learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

G
Graz University of Technology
Scholars:
6.7K
Papers: 6.3K
Citations: 8.5K
Cited Papers

Cited Papers

The Friction and Lubrication of elastomers
err1995-01-01
err0
PREAI
errA. Arvanitaki; B.J. Briscoe; M.J. Adams; S.A. Johnson
errShare
errSave
Margin-Based Discriminative Training for String Recognition
err2010-12-01
err11
PREAI
errHeigold, Georg; Dreuw, Philippe; Hahn, Stefan; Schlueter, Ralf; Ney, Hermann
errShare
errSave
errShare
errSave
CAN-Mediated Oxidative Free Radical Reactions in an Ionic Liquid
err2003-03-01
err0
PREAI
errGregory Bar; Fabien Bini; Andrew F. Parsons
errShare
errSave
Stereotyped: Investigating Gender in Introductory Science Courses
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
errShare
errSave
Mobile markerless augmented reality and its application in forensic medicine
err2014-08-23
err0
PREAI
errThomas Kilgus; Eric Heim; Sven Haase; Sabine Prüfer; Michael Müller; Alexander Seitel; Markus Fangerau; Tamara Wiebe; Justin Iszatt; Heinz-Peter Schlemmer; Joachim Hornegger; Kathrin Yen; Lena Maier-Hein
errShare
errSave
errShare
errSave
researcher View more