.png){kind=icon}
返回
A Sequential Addressing Subsampling Method for Massive Data Analysis Under Memory Constraint
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2023.3241075.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The emergence of massive data in recent years brings challenges to automatic statistical inference. This is particularly true if the data are too numerous to be read into memory as a whole. Accordingly, new sampling techniques are needed to sample data from a hard drive. In this paper, we propose a sequential addressing subsampling (SAS) method that can sample data directly from the hard drive. The newly proposed SAS method is time saving in terms of addressing cost compared to that of the random addressing subsampling (RAS) method. Estimators (e.g., the sample mean) based on the SAS subsamples are constructed, and their properties are studied. We conduct a series of simulation studies to verify the finite sample performance of the proposed SAS estimators. The time cost is also compared between the SAS and RAS methods. An analysis of the airline data is presented for illustration purpose.
Keyword:
Massive data
random addressing subsampling
sequential addressing subsampling
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
.png){kind=icon}
分享收藏Increased medial orbitofrontal [18F]fluorodopa uptake in Parkinsonian impulse control disorders
PREAI
分享收藏Renewable estimation and incremental inference in generalized linear models with streaming data sets
OAAI
OAAI分享收藏
查看更多内容