arrow
返回

Optimal Subsampling via Predictive Inference

delete2024-01-04
delete2
PRE
AI
X
Xiaoyang Wu
Y
Yuyang Huo
任浩杰 (Haojie Ren)
C
Changliang Zou *
DOI:10.1080/01621459.2023.2282644delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the big data era, subsampling or sub-data selection techniques are often adopted to extract a fraction of informative individuals from the massive data. Existing subsampling algorithms focus mainly on obtaining a representative subset to achieve the best estimation accuracy under a given class of models. In this article, we consider a semi-supervised setting wherein a small or moderate sized labeled data is available in addition to a much larger sized unlabeled data. The goal is to sample from the unlabeled data with a given budget to obtain informative individuals that are characterized by their unobserved responses. We propose an optimal subsampling procedure that is able to maximize the diversity of the selected subsample and control the false selection rate (FSR) simultaneously, allowing us to explore reliable information as much as possible. The key ingredients of our method are the use of predictive inference for quantifying the uncertainty of response predictions and a reformulation of the objective into a constrained optimization problem. We show that the proposed method is asymptotically optimal in the sense that the diversity of the subsample converges to its oracle counterpart with FSR control. Numerical simulations and a real-data example validate the superior performance of the proposed strategy. Supplementary materials for this article are available online.
Keyword:
Convex quadratic programming
Cross-validation
Density estimation
False selection rate
Local false discovery rate
Uniform convergence

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
引用论文

引用论文

TESTING FOR OUTLIERS WITH CONFORMAL P-VALUES
err2023-02-01
err36
errOAAI
errBates, Stephen; Candes, Emmanuel; Lei, Lihua; Romano, Yaniv; Sesia, Matteo
err分享
err收藏
PREDICTIVE INFERENCE WITH THE JACKKNIFE用折刀进行预测推理
err2021-02-01
err155
errOAAI
errBarber, Rina Foygel; Candes, Emmanuel J.; Ramdas, Aaditya; Tibshirani, Ryan J.
err分享
err收藏
PECVD-grown carbon nanotubes on silicon substrates with a nickel-seeded tip-growth structure具有镍种子尖端生长结构的硅衬底上的PECVD生长的碳纳米管
err2006-07-01
err0
PREAI
errY. Abdi; J. Koohsorkhi; J. Derakhshandeh; S. Mohajerzadeh; H. Hoseinzadegan; M.D. Robertson; J.C. Bennett; X. Wu; H. Radamson
err分享
err收藏
Penalized time-varying model averaging
err2023-08-01
err8
PREAI
errSun, Yuying; Hong, Yongmiao; Wang, Shouyang; Zhang, Xinyu
err分享
err收藏
The detection and measurement of mite infestation in animal feed using near infra-red reflectance
err2009-03-27
err0
PREAI
errD. R. Wilkin; I. A. Cowe; B. B. Thind; J. W. McNicol; D. C. Cuthbertson
err分享
err收藏
学者 查看更多内容