Adaptive Sparse Gaussian Process

Vanessa Gómez-Verdejo

doi:10.1109/TNNLS.2023.3294089

Adaptive Sparse Gaussian Process

2024-11-01

2

OA

AI

V

Vanessa Gómez-Verdejo *

E

Emilio Parrado-Hernández

M

Manel Martínez‐Ramón

DOI：10.1109/TNNLS.2023.3294089

原文链接

摘要

En 中文

Adaptive learning is necessary for nonstationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data and with the lowest possible computational cost for online parameter updating. Existing solutions only partially cover these needs. Here, we propose the first adaptive sparse Gaussian process (GP) able to address all these issues. We first reformulate a variational sparse GP (VSGP) algorithm to make it adaptive through a forgetting factor. Next, to make the model inference as simple as possible, we propose updating a single inducing point of the SGP model together with the remaining model parameters every time a new sample arrives. As a result, the algorithm presents a fast convergence of the inference process, which allows an efficient model update (with a single inference iteration) even in highly nonstationary environments. Experimental results demonstrate the capabilities of the proposed algorithm and its good performance in modeling the predictive posterior in mean and confidence interval estimation compared to state-of-the-art approaches.

Keyword:

& nbsp

Adaptive learning

online learning

sparse Gaussian process (GP)

variational learning

Adaptive Sparse Gaussian Process

摘要

期刊

机构

引用论文