arrow
返回

Semi-supervised learning with density-ratio estimation

delete2013-02-09
delete29
delete
OA
AI
M
Masanori Kawakita
T
Takafumi Kanamori *
DOI:10.1007/s10994-013-5329-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper we study statistical properties of semi-supervised learning, which is considered to be an important problem in the field of machine learning. In standard supervised learning only labeled data is observed, and classification and regression problems are formalized as supervised learning. On the other hand, in semi-supervised learning, unlabeled data is also obtained in addition to labeled data. Hence, the ability to exploit unlabeled data is important to improve prediction accuracy in semi-supervised learning. This problem is regarded as a semiparametric estimation problem with missing data. Under discriminative probabilistic models, it was considered that unlabeled data is useless to improve the estimation accuracy. Recently, the weighted estimator using unlabeled data achieves a better prediction accuracy compared to the learning method using only labeled data, especially when the discriminative probabilistic model is misspecified. That is, improvement under the semiparametric model with missing data is possible when the semiparametric model is misspecified. In this paper, we apply the density-ratio estimator to obtain the weight function in semi-supervised learning. Our approach is advantageous because the proposed estimator does not require well-specified probabilistic models for the probability of the unlabeled data. Based on statistical asymptotic theory, we prove that the estimation accuracy of our method outperforms supervised learning using only labeled data. Some numerical experiments present the usefulness of our methods.
Keyword:
Semi-supervised learning
Density ratio
Semiparametric model
Missing data

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

N
Nagoya University
学者数:
3.3W
论文数: 2.5W
被引数: 2.6W
K
Kyushu University
学者数:
3.2W
论文数: 2.6W
被引数: 2.8W
引用论文

引用论文

User-Controllable Security and Privacy for Pervasive Computing
err2007-03-01
err0
errOAAI
errJason Cornwell; Ian Fette; Gary Hsieh; Madhu Prabaker; Jinghai Rao; Karen Tang; Kami Vaniea; Lujo Bauer; Lorrie Cranor; Jason Hong; Bruce McLaren; Mike Reiter; Norman Sadeh
err分享
err收藏
err分享
err收藏
Determination of the Temperature-Dependent OH (H2O) + CH3I Rate Constant by Experiment and Simulation
err2015-10-02
err0
PREAI
errJing Xie; Michael J. Scott; William L. Hase; Peter M. Hierl; Albert A. Viggiano
err分享
err收藏
err分享
err收藏
学者 查看更多内容