arrow
返回

An information theoretic sparse kernel algorithm for online learning

delete2014-07-01
delete8
PRE
AI
H
Haijin Fan *
Q
Qing Song
X
Xu Zhao
DOI:10.1016/j.eswa.2014.01.010delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Kernel-based algorithms have been proven successful in many nonlinear modeling applications. However, the computational complexity of classical kernel-based methods grows superlinearly with the increasing number of training data, which is too expensive for online applications. In order to solve this problem, the paper presents an information theoretic method to train a sparse version of kernel learning algorithm. A concept named instantaneous mutual information is investigated to measure the system reliability of the estimated output. This measure is used as a criterion to determine the novelty of the training sample and informative ones are selected to form a compact dictionary to represent the whole data. Furthermore, we propose a robust learning scheme for the training of the kernel learning algorithm with an adaptive learning rate. This ensures the convergence of the learning algorithm and makes it converge to the steady state faster. We illustrate the performance of our proposed algorithm and compare it with some recent kernel algorithms by several experiments. (C) 2014 Elsevier Ltd. All rights reserved.
Keyword:
Kernel methods
Information theoretic
Sparsification
Online learning
Mutual information
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
引用论文

引用论文

ISOLATION OF AMYLOID P COMPONENT (PROTEIN AP) FROM NORMAL SERUM AS A CALCIUM-DEPENDENT BINDING PROTEIN
err1977-05-01
err0
PREAI
errM.B Pepys; A.C Dash; E.A Munn; A Feinstein; Martha Skinner; A.S Cohen; H Gewurz; A.P Osmand; R.H Painter
err分享
err收藏
err分享
err收藏
err分享
err收藏
Thick and thin models of the evolution of carbon dioxide on Mars
err2006-01-01
err0
PREAI
errC MANNING; C MCKAY; K ZAHNLE
err分享
err收藏
err分享
err收藏
Society of Mind Project
err
IF0
err1988-08-01
err0
PREAI
errMarvin Minsky
err分享
err收藏
学者 查看更多内容