arrow
返回

Optimal and Safe Estimation for High-Dimensional Semi-Supervised Learning

delete2024-01-04
delete0
delete
OA
AI
S
Siyi Deng
Y
Yang Ning
J
Jiwei Zhao
H
Heping Zhang *
DOI:10.1080/01621459.2023.2277409delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We consider the estimation problem in high-dimensional semi-supervised learning. Our goal is to investigate when and how the unlabeled data can be exploited to improve the estimation of the regression parameters of linear model in light of the fact that such linear models may be misspecified in data analysis. We first establish the minimax lower bound for parameter estimation in the semi-supervised setting, and show that this lower bound cannot be achieved by supervised estimators using the labeled data only. We propose an optimal semi-supervised estimator that can attain this lower bound and therefore improves the supervised estimators, provided that the conditional mean function can be consistently estimated with a proper rate. We further propose a safe semi-supervised estimator. We view it safe, because this estimator is always at least as good as the supervised estimators. We also extend our idea to the aggregation of multiple semi-supervised estimators caused by different misspecifications of the conditional mean function. Extensive numerical simulations and a real data analysis are conducted to illustrate our theoretical results. Supplementary materials for this article are available online.
Keyword:
High dimensionality
Model aggregation
Model misspecification
Optimal estimation
Safe estimation
Semi-supervised learning

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

U
university of wisconsin madison
学者数:
3.8W
论文数: 2.9W
被引数: 53
University of Wisconsin System 封面图
University of Wisconsin System
学者数:
6.7W
论文数: 5.8W
被引数: 382
C
Cornell University
学者数:
6.3W
论文数: 5.4W
被引数: 10.9W
学者 查看更多机构
引用论文

引用论文

Factors associated with Danish cancer patients’ return to work. A report from the population-based study ‘The Cancer Patient's World’
err2012-04-01
err0
PREAI
errLone Ross; Morten Aagaard Petersen; Anna Thit Johnsen; Louise Hyldborg Lundstroem; Kathrine Carlsen; Mogens Groenvold
err分享
err收藏
err分享
err收藏
SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
err分享
err收藏
The Epidemiology of Intensive Care Unit Readmissions in the United States
err2012-05-01
err102
errOAAI
errBrown, Sydney E. S.; Ratcliffe, Sarah J.; Kahn, Jeremy M.; Halpern, Scott D.
err分享
err收藏
Preparation and Photocatalytic Properties of CQDs-Modified 26-Facet Cu/Cu2O CompositesCQDs改性26面体Cu/Cu₂O复合材料的制备及其光催化性能
err2023-05-28
err0
PREAI
errWenwen Sun; Ruyue Guo; Chaojie Shi; Xuechen Li; Jiayi Wu; He Tian; Huayi Li; Jie He; Zhengchun Yang; Jiahui Li; Shanfeng Sun
err分享
err收藏
学者 查看更多内容