arrow
Return

Mixed-Precision Kernel Recursive Least Squares

delete2022-03-01
delete3
delete
OA
AI
J
Junkyu Lee *
D
Dimitrios S. Nikolopoulos
H
Hans Vandierendonck
DOI:10.1109/TNNLS.2020.3041677delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Kernel recursive least squares (KRLS) is a widely used online machine learning algorithm for time series predictions. In this article, we present the mixed-precision KRLS, producing equivalent prediction accuracy to double-precision KRLS with a higher training throughput and a lower memory footprint. The mixed-precision KRLS applies single-precision arithmetic to the computation components being not only numerically resilient but also computationally intensive. Our mixedprecision KRLS demonstrates the 1.32, 1.15, 1.29, 1.09, and 1.08x training throughput improvements using 24.95%, 24.74%, 24.89%, 24.48%, and 24.20% less memory footprint without losing any prediction accuracy compared to double-precision KRLS for a 3-D nonlinear regression, a Lorenz chaotic time series, a Mackey-Glass chaotic time series, a sunspot number time series, and a sea surface temperature time series, respectively.
Keywords:
Budget machine learning
kernel method
mixed-precision training
online learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

Q
Queen's University Belfast
Scholars:
1.6W
Papers: 1.7W
Citations: 2.5W