arrow
Return

Multi-resolution subsampling for linear classification with massive data

delete2025-04-09
delete0
PRE
AI
H
Haolin Chen
H
Holger Dette
虞俊 cover
虞俊 (Jun Yu) *
DOI:10.1093/jrsssb/qkaf017delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Subsampling is one of the popular methods to balance statistical efficiency and computational efficiency in the big data era. Most approaches aim to select informative or representative sample points to achieve good overall information of the full data. The present work takes the view that sampling techniques are recommended for the region we focus on and summary measures are enough to collect the information for the rest according to a well-designed data partitioning. We propose a subsampling strategy that collects global information described by summary measures and local information obtained from selected subsample points. Thus, we call it multi-resolution subsampling. We show that the proposed method leads to a more efficient subsample-based estimator for general linear classification problems. Some asymptotic properties of the proposed method are established and connections to existing subsampling procedures are explored. Finally, we illustrate the proposed subsampling strategy via simulated and real-world examples.
Keywords:
classification
linear projection
M-estimator
optimal design
Rao-Blackwellization

Journal

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
Papers:
1.5K
Citations:
3.2W

Organization

B
Beijing Inst Technol
Scholars:
4.3K
Papers: 1.8K
Citations: 688