返回
ONLINE INFERENCE WITH MULTI-MODAL LIKELIHOOD FUNCTIONS
DOI:10.1214/21-AOS2076.png)
摘要
En 中文
Let (Y-t)(t >= 1) be a sequence of i.i.d. observations and {f(theta), theta is an element of R-d} be a parametric model. We introduce a new online algorithm for computing a sequence ((theta) over cap (t))(t >= 1), which is shown to converge almost surely to argmax(theta is an element of Rd) E[log f(theta)(Y-1)] at rate O(log(t)((1+epsilon)/2t-1/2)), with epsilon > 0 a user specified parameter. This convergence result is obtained under standard conditions on the statistical model and, most notably, we allow the mapping theta bar right arrow E[log f(theta)(Y-1)] to be multi-modal. However, the computational cost to process each observation grows exponentially with the dimension of theta, which makes the proposed approach applicable to low or moderate dimensional problems only. We also derive a version of the estimator (theta) over cap (t), which is well suited to student-t linear regression models that are popular tools for robust linear regression. As shown by experiments on simulated and real data, the corresponding estimator of the regression coefficients is, as expected, robust to the presence of outliers and thus, as a by-product, we obtain a new adaptive and robust online estimation procedure for linear regression models.
Keyword:
Online inference
scalable inference
multi-modal likelihood functions
期刊
IF:
3.7
论文数:
2.8K
被引数:
2.9W
机构
引用论文
Correction: The origin of room temperature ferromagnetism mediated by Co–VZn complexes in the ZnO grain boundary
RSC Advances
IF0
Hyperbolastic modeling of tumor growth with a combined treatment of iodoacetate and dimethylsulphoxide
BMC CANCER
IF3.4
ASYMPTOTIC AND FINITE-SAMPLE PROPERTIES OF ESTIMATORS BASED ON STOCHASTIC GRADIENTS
ANNALS OF STATISTICS
IF3.7
Synthesis of dimethacrylates monomers with low polymerization shrinkage and its application in dental composites materials低聚合收缩二甲基丙烯酸酯单体的合成及其在牙科复合材料中的应用
Autophagy execution protein beclin1 regulates radiation-induced osteopontin in human lung cancer cell
Lung Cancer
IF0

