arrow
返回

A PARTIALLY LINEAR FRAMEWORK FOR MASSIVE HETEROGENEOUS DATA

delete2016-08-01
delete118
delete
OA
AI
赵天琦 (Tianqi Zhao) *
G
Guang Cheng
H
Han Liu
DOI:10.1214/15-AOS1410delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We consider a partially linear framework for modeling massive heterogeneous data. The major goal is to extract common features across all subpopulations while exploring heterogeneity of each subpopulation. In particular, we propose an aggregation type estimator for the commonality parameter that possesses the (nonasymptotic) minimax optimal bound and asymptotic distribution as if there were no heterogeneity. This oracle result holds when the number of subpopulations does not grow too fast. A plug-in estimator for the heterogeneity parameter is further constructed, and shown to possess the asymptotic distribution as if the commonality information were available. We also test the heterogeneity among a large number of subpopulations. All the above results require to regularize each subestimation as though it had the entire sample. Our general theory applies to the divide-and-conquer approach that is often used to deal with massive homogeneous data. A technical by-product of this paper is statistical inferences for general kernel ridge regression. Thorough numerical results are also provided to back up our theory.
Keyword:
Divide-and-conquer method
heterogeneous data
kernel ridge regression
massive data
partially linear model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Annals of Statistics 封面图
Annals of Statistics
IF:
3.7
论文数:
2.8K
被引数:
2.9W

机构

P
Princeton University
学者数:
2.1W
论文数: 2.3W
被引数: 5.1W
Purdue University System 封面图
Purdue University System
学者数:
3.9W
论文数: 3.6W
被引数: 66
引用论文

引用论文

THE BENEFIT OF GROUP SPARSITY
err2010-08-01
err397
errOAAI
errHuang, Junzhou; Zhang, Tong
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容