arrow
返回

Competitive Normalized Least-Squares Regression

delete2021-07-01
delete2
delete
OA
AI
W
Waqas Jamil *
A
Abdelhamid Bouchachia
DOI:10.1109/TNNLS.2020.3009777delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Online learning has witnessed an increasing interest over the recent past due to its low computational requirements and its relevance to a broad range of streaming applications. In this brief, we focus on online regularized regression. We propose a novel efficient online regression algorithm, called online normalized least-squares (ONLS). We perform theoretical analysis by comparing the total loss of ONLS against the normalized gradient descent (NGD) algorithm and the best off-line LS predictor. We show, in particular, that ONLS allows for a better bias-variance tradeoff than those state-of-the-art gradient descent-based LS algorithms as well as a better control on the level of shrinkage of the features toward the null. Finally, we conduct an empirical study to illustrate the great performance of ONLS against some state-of-the-art algorithms using real-world data.
Keyword:
Prediction algorithms
Approximation algorithms
Protocols
Learning systems
Covariance matrices
Time complexity
Stability analysis
Competitive analysis
least-squares
prediction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

B
Bournemouth University
学者数:
2.7K
论文数: 3.1K
被引数: 3.5K
引用论文

引用论文

err分享
err收藏
Disentangling in vivo the effects of iron content and atrophy on the ageing human brain
err2014-12-01
err0
errOAAI
errS. Lorio; A. Lutti; F. Kherif; A. Ruef; J. Dukart; R. Chowdhury; R.S. Frackowiak; J. Ashburner; G. Helms; N. Weiskopf; B. Draganski
err分享
err收藏
Neocortical Ectopias in BXSB Mice: Effects upon Reference and Working Memory Systems
err1996-01-01
err0
errOAAI
errGary W. Boehm; Gordon F. Sherman; Glenn D. Rosen; Albert M. Galaburda; Victor H. Denenberg
err分享
err收藏
New Synthesis of trans-Disubstituted Cyclam Macrocycles – Elucidation of the Disubstitution Mechanism on the Basis of X-ray Data and Molecular Modeling
err1998-09-01
err0
PREAI
errGuy Royal; Valérie Dahaoui-Gindrey; Slimane Dahaoui; Alain Tabard; Roger Guilard; Pluton Pullumbi; Claude Lecomte
err分享
err收藏
A Raman spectroscopic study of the XeOF4/XeF2 system and the X-ray crystal structure of α-XeOF4·XeF2
err2011-10-01
err0
PREAI
errMichael J. Hughes; David S. Brock; Hélène P.A. Mercier; Gary J. Schrobilgen
err分享
err收藏
学者 查看更多内容