arrow
返回

Efficient Multitemplate Learning for Structured Prediction

delete2013-02-01
delete8
delete
OA
AI
Q
Qi Mao *
I
Ivor W. Tsang
DOI:10.1109/TNNLS.2012.2228228delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Conditional random fields (CRF) and structural support vector machines (structural SVM) are two state-of-the-art methods for structured prediction that captures the interdependencies among output variables. The success of these methods is attributed to the fact that their discriminative models are able to account for overlapping features on all input observations. These features are usually generated by applying a given set of templates on labeled data, but improper templates may lead to degraded performance. To alleviate this issue, in this paper we propose a novel multiple template learning paradigm to learn structured prediction and the importance of each template simultaneously, so that hundreds of arbitrary templates could be added into the learning model without caution. This paradigm can be formulated as a special multiple kernel learning problem with an exponential number of constraints. Then we introduce an efficient cutting-plane algorithm to solve this problem in the primal and present its convergence. We also evaluate the proposed learning paradigm on two widely studied structured prediction tasks, i.e., sequence labeling and dependency parsing. Extensive experimental results show that the proposed method outperforms CRFs and structural SVMs because of exploiting the importance of each template. Complexity analysis and empirical results also show that the proposed method is more efficient than Online multikernel learning on very sparse and high-dimensional data. We further extend this paradigm for structured prediction using generalized p-block norm regularization with p > 1, and experiments show competitive performances when p is an element of [1, 2).
Keyword:
Dependency parsing
multiple template learning
sequence labeling
structured prediction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Phase engineering of metal nanocatalysts for electrochemical CO2 reduction
err2022-09-01
err0
errOAAI
errYanjie Zhai; Peng Han; Qinbai Yun; Yiyao Ge; Xiao Zhang; Ye Chen; Hua Zhang
err分享
err收藏
Analysis of the Physical Integrity of Earth Dams from Electrical Resistivity Tomography (ERT) in Brazil
err2019-07-08
err0
PREAI
errPedro Lemos Camarero; César Augusto Moreira; Henrique Garcia Pereira
err分享
err收藏
Synthesis and Chromatographic Properties of Liquid Crystalline Polysiloxanes Containing Steroid Substituents
err2007-03-28
err0
PREAI
errNathan W. Adams; Jerald S. Bradshaw; Jose-Maria Bayona; Karin E. Markides; Milton L. Lee
err分享
err收藏
学者 查看更多内容