arrow
返回

Optimal Subsampling for Large Sample Logistic Regression

delete2018-06-06
delete223
delete
OA
AI
H
HaiYing Wang *
朱荣 (Zhu, Rong)
马萍 (Ping Ma)
DOI:10.1080/01621459.2017.1292914delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least-square estimate in linear regression, where statistical leverage scores are often used to define subsampling probabilities. In this article, we propose fast subsampling algorithms to efficiently approximate the maximum likelihood estimate in logistic regression. We first establish consistency and asymptotic normality of the estimator from a general subsampling algorithm, and then derive optimal subsampling probabilities that minimize the asymptotic mean squared error of the resultant estimator. An alternative minimization criterion is also proposed to further reduce the computational cost. The optimal subsampling probabilities depend on the full data estimate, so we develop a two-step algorithm to approximate the optimal subsampling procedure. This algorithm is computationally efficient and has a significant reduction in computing time compared to the full data approach. Consistency and asymptotic normality of the estimator from a two-step algorithm are also established. Synthetic and real datasets are used to evaluate the practical performance of the proposed method. Supplementary materials for this article are available online.
Keyword:
A-optimality
Logistic regression
Massive data
Optimal subsampling
Rare event
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

University System of New Hampshire 封面图
University System of New Hampshire
学者数:
5.3K
论文数: 4.9K
被引数: 13
U
University of Connecticut
学者数:
2.4W
论文数: 2.2W
被引数: 2.5W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Simulation of switching effects in electrically dipolar manganites
err2009-03-17
err0
errOAAI
errV. Morchshakov; M. P. Annaorazov; H. Ş. Aybar; C. P. Yang; I. O. Troyanchuk; K. Bärner
err分享
err收藏
err分享
err收藏
Adsorption of human salivary mucins to hydroxyapatite
err1985-01-01
err0
PREAI
errL.A. Tabak; M.J. Levine; N.K. Jain; Amy R. Bryan; R.E. Cohen; Laura D. Monte; S. Zawacki; G.H. Nancollas; Amalia Slomiany; B.L. Slomiany
err分享
err收藏
学者 查看更多内容