arrow
Return

Model-Free Subsampling Method Based on Uniform Designs

delete2024-03-01
delete6
delete
OA
AI
M
Mei Zhang
Y
Yongdao Zhou
Z
Zheng Zhou
A
Aijun Zhang *
DOI:10.1109/TKDE.2023.3297167delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Subsampling or subdata selection is a useful approach in large-scale statistical learning. Most existing studies focus on model-based subsampling methods which significantly depend on the model assumption. In this paper, we consider the model-free subsampling strategy for generating subdata from the original full data. In order to measure the goodness of representation of a subdata with respect to the original data, we propose a criterion, generalized empirical F-discrepancy (GEFD), and study its theoretical properties in connection with the classical generalized L2-discrepancy in the theory of uniform designs. These properties allow us to develop a kind of low-GEFD data-driven subsampling method based on the existing uniform designs. By simulation examples and a real case study, we show that the proposed subsampling method is superior to the random sampling method. Moreover, our method keeps robust under diverse model specifications while other popular subsampling methods are under-performing. In practice, such a model-free property is more appealing than the model-based subsampling methods, where the latter may have poor performance when the model is misspecified, as demonstrated in our simulation studies.
Keywords:
Kernel
Data models
Numerical models
Hypercubes
Computational modeling
Big Data
Statistical learning
Empirical F -discrepancy
generalized l (2) -discrepancy
koksma-hlawka inequality
model-free subsampling
reproducing kernel

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

S
Southwest Minzu University
Scholars:
3.2K
Papers: 2.0K
Citations: 2.9K
W
wells fargo company
Scholars:
18
Papers: 22
Citations: 0
N
nankai university
Scholars:
4.8W
Papers: 3.3W
Citations: 74
researcher View more organizations
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Sliced Latin Hypercube Designs for Computer Experiments With Unequal Batch Sizes
err2018-01-01
err4
errOAAI
errXu, Jin; He, Xu; Duan, Xiaojun; Wang, Zhengming
errShare
errSave
On the Structure of Ge/GeO2 Glasses
err2001-06-18
err0
PREAI
errIan R. Beattie; Peter J. Jones; Stephen Roberts
errShare
errSave
Somatic mosaicism for the p.His1047Arg mutation in PIK3CA in a girl with mesenteric lipomatosis
err2014-06-05
err0
errOAAI
errAna S. A. Cohen; Katelin N. Townsend; Qing‐San Xiang; Raj Attariwala; Christof Borchers; Christof Senger; Wayne Picker; Jasna Levi; Lila Yewchuk; Joelle Tan; Patrice Eydoux; Amy Lum; Siu‐Li Yong; Margaret L. McKinnon; Scott A. Lear; Robert Everett; Steven J. M. Jones; Stephen Yip; William T. Gibson
errShare
errSave
SUPPORT POINTS
err2018-12-01
err106
errOAAI
errMak, Simon; Joseph, V. Roshan
errShare
errSave
errShare
errSave
researcher View more