返回
Optimal One-Pass Nonparametric Estimation Under Memory Constraint
DOI:10.1080/01621459.2022.2115374.png)
摘要
En 中文
For nonparametric regression in the streaming setting, where data constantly flow in and require real-time analysis, a main challenge is that data are cleared from the computer system once processed due to limited computer memory and storage. We tackle the challenge by proposing a novel one-pass estimator based on penalized orthogonal basis expansions and developing a general framework to study the interplay between statistical efficiency and memory consumption of estimators. We show that, the proposed estimator is statistically optimal under memory constraint, and has asymptotically minimal memory footprints among all one-pass estimators of the same estimation quality. Numerical studies demonstrate that the proposed one-pass estimator is nearly as efficient as its nonstreaming counterpart that has access to all historical data.
Keyword:
Communication complexity
Minimaxity
Nonparametric regression
Space lower bound
Streaming algorithm
期刊
J
IF:
3
论文数:
5.2K
被引数:
4.8W
机构
引用论文
Enrichment of chlorine isotopes by selective photoaddition of iodine chloride to acetylene通过选择性光加成碘氯化物到乙炔中富集氯同位素

