arrow
返回

Optimal One-Pass Nonparametric Estimation Under Memory Constraint

delete2022-10-10
delete5
delete
OA
AI
M
Mingxue Quan
Z
Zhenhua Lin *
DOI:10.1080/01621459.2022.2115374delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
For nonparametric regression in the streaming setting, where data constantly flow in and require real-time analysis, a main challenge is that data are cleared from the computer system once processed due to limited computer memory and storage. We tackle the challenge by proposing a novel one-pass estimator based on penalized orthogonal basis expansions and developing a general framework to study the interplay between statistical efficiency and memory consumption of estimators. We show that, the proposed estimator is statistically optimal under memory constraint, and has asymptotically minimal memory footprints among all one-pass estimators of the same estimation quality. Numerical studies demonstrate that the proposed one-pass estimator is nearly as efficient as its nonstreaming counterpart that has access to all historical data.
Keyword:
Communication complexity
Minimaxity
Nonparametric regression
Space lower bound
Streaming algorithm

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

R
Renmin University of China
学者数:
8.1K
论文数: 7.7K
被引数: 1.1W
N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Analysis of the emission spectrum of Xe and Sn
err2006-03-10
err0
PREAI
errA. Sasaki; K. Nishihara; A. Sunahara; T. Nishikawa; F. Koike; K. Kagawa; H. Tanuma
err分享
err收藏
Synthesis of Mesoporous SiO2@TiO2 Core/Shell Nanospheres with Enhanced Photocatalytic Properties
err2013-02-08
err0
PREAI
errJin‐Lin Hu; Hai‐Sheng Qian; Jia‐Jia Li; Yong Hu; Zheng‐Quan Li; Shu‐Hong Yu
err分享
err收藏
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容