arrow
Return

Active Learning With Multiple Kernels

delete2022-07-01
delete12
delete
OA
AI
S
Song‐Nam Hong *
J
Jeongmin Chae
DOI:10.1109/TNNLS.2020.3047953delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Online multiple kernel learning (OMKL) has provided an attractive performance in nonlinear function learning tasks. Leveraging a random feature (RF) approximation, the major drawback of OMKL, known as the curse of dimensionality, has been recently alleviated. These advantages enable RF-based OMKL to be considered in practice. In this article, we introduce a new research problem, named stream-based active MKL (AMKL), in which a learner is allowed to label some selected data from an oracle according to a selection criterion. This is necessary for many real-world applications as acquiring a true label is costly or time consuming. We theoretically prove that the proposed AMKL achieves an optimal sublinear regret O(root T) as in OMKL with little labeled data, implying that the proposed selection criterion indeed avoids unnecessary label requests. Furthermore, we present AMKL with an adaptive kernel selection (named AMKL-AKS) in which irrelevant kernels can be excluded from a kernel dictionary ``on the fly.'' This approach improves the efficiency of active learning and the accuracy of function learning. Via numerical tests with real data sets, we verify the superiority of AMKL-AKS, yielding a similar accuracy performance with OMKL counterpart using a fewer number of labeled data.
Keywords:
Kernel
Task analysis
Labeling
Dictionaries
Radio frequency
Optimization
Biomedical imaging
Active learning (AL)
multiple kernel learning (MKL)
online learning
reproducing kernel Hilbert space (RKHS)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

U
university of southern california
Scholars:
4.6W
Papers: 3.8W
Citations: 51
H
hanyang university
Scholars:
2.8W
Papers: 2.7W
Citations: 36