arrow
Return

Generalized SMO Algorithm for SVM-Based Multitask Learning

delete2012-06-01
delete60
PRE
AI
C
Cai, Feng *
C
Cherkassky, Vladimir
DOI:10.1109/TNNLS.2012.2187307delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Exploiting additional information to improve traditional inductive learning is an active research area in machine learning. In many supervised-learning applications, training data can be naturally separated into several groups, and incorporating this group information into learning may improve generalization. Recently, Vapnik proposed a general approach to formalizing such problems, known as learning with structured data and its support vector machine (SVM) based optimization formulation called SVM+. Liang and Cherkassky showed the connection between SVM+ and multitask learning (MTL) approaches in machine learning, and proposed an SVM-based formulation for MTL called SVM+ MTL for classification. Training the SVM+ MTL classifier requires the solution of a large quadratic programming optimization problem which scales as O(n(3)) with sample size n. So there is a need to develop computationally efficient algorithms for implementing SVM+ MTL. This brief generalizes Platt's sequential minimal optimization (SMO) algorithm to the SVM+ MTL setting. Empirical results show that, for typical SVM+ MTL problems, the proposed generalized SMO achieves over 100 times speed-up, in comparison with general-purpose optimization routines.
Keywords:
Classification
learning with structured data
multitask learning
quadratic optimization
sequential minimal optimization
support vector machine (SVM)
SVM
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

No organization information available
Cited Papers

Cited Papers

Local and Systemic Effects of Immune Checkpoint Blockade on Relapsed Myeloid Malignancies Following Allogeneic Hematopoietic Stem Cell Transplantation
err2020-11-05
err0
errOAAI
errLivius Penter; Yi Zhang; Alexandra Savell; Srinika Ranasinghe; Teddy Huang; Nicoletta Cieri; Satyen H Gohil; Wandi Zhang; Shuqiang Li; Robert Zeiser; Haesook T. Kim; Kenneth J. Livak; Jerome Ritz; Donna S. Neuberg; Robert J. Soiffer; X. Shirley Liu; Matthew S. Davids; Pavan Bachireddy; Catherine J. Wu
errShare
errSave
First-principles study of cobalt silicide nanosheet and nanotubes: Stability and electronic properties
err2009-10-01
err0
PREAI
errTao He; Hongyu Zhang; Zhenhai Wang; Xuejuan Zhang; Zexiao Xi; Xiangdong Liu; Mingwen Zhao; Yueyuan Xia; Liangmo Mei
errShare
errSave
Clinical significance of PD-L1 and PD-L2 copy number gains in non-small-cell lung cancer
err2016-04-01
err0
errOAAI
errYusuke Inoue; Katsuhiro Yoshimura; Kazutaka Mori; Nobuya Kurabe; Tomoaki Kahyo; Hiroki Mori; Akikazu Kawase; Masayuki Tanahashi; Hiroshi Ogawa; Naoki Inui; Kazuhito Funai; Kazuya Shinmura; Hiroshi Niwa; Takafumi Suda; Haruhiko Sugimura
errShare
errSave
Predictive learning with structured (grouped) data
err2009-07-01
err26
PREAI
errLiang, Lichen; Cai, Feng; Cherkassky, Vladimir
errShare
errSave
Support-vector networks
err1995-09-01
err0
errOAAI
errCorinna Cortes; Vladimir Vapnik
errShare
errSave
Magnetism in Transition-Metal-Doped Silicon Nanotubes
err2003-09-30
err0
PREAI
errAbhishek Kumar Singh; Tina M. Briere; Vijay Kumar; Yoshiyuki Kawazoe
errShare
errSave
no more