Approximate multiple kernel learning with least-angle regression

Martin Stražar

doi:10.1016/j.neucom.2019.02.030

Return

Approximate multiple kernel learning with least-angle regression

2019-05-01

Martin Stražar

Tomaž Curk *

DOI：10.1016/j.neucom.2019.02.030

Original

Save

View PDF

Abstract

En 中文

Kernel methods provide a principled way for general data representations. Multiple kernel learning and kernel approximation are often treated as separate tasks, with considerable savings in time and memory expected if the two are performed simultaneously. Our proposed Mklaren algorithm selectively approximates multiple kernel matrices in regression. It uses Incomplete Cholesky Decomposition and Least-angle regression (LAR) to select basis functions, achieving linear complexity both in the number of data points and kernels. Since it approximates kernel matrices rather than functions, it allows to combine an arbitrary set of kernels. Compared to single kernel-based approximations, it selectively approximates different kernels in different regions of the input spaces. The LAR criterion provides a robust selection of inducing points in noisy settings, and an accurate modelling of regression functions in continuous and discrete input spaces. Among general kernel matrix decompositions, Mklaren achieves minimal approximation rank required for performance comparable to using the exact kernel matrix, at a cost lower than 1% of required operations. Finally, we demonstrate the scalability and interpretability in settings with millions of data points and thousands of kernels. (C) 2019 The Authors. Published by Elsevier B.V.

Keywords:

Kernel methods

Kernel approximation

Multiple kernel learning

Least-angle regression

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.