arrow
Return

Inductive transfer for learning Bayesian networks

delete2009-12-22
delete62
delete
OA
AI
R
Roger Luis
L
Luis Enrique Sucar *
E
Eduardo F. Morales
DOI:10.1007/s10994-009-5160-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In several domains it is common to have data from different, but closely related problems. For instance, in manufacturing, many products follow the same industrial process but with different conditions; or in industrial diagnosis, where there is equipment with similar specifications. In these cases it is common to have plenty of data for some scenarios but very little for others. In order to learn accurate models for rare cases, it is desirable to use data and knowledge from similar cases; a technique known as transfer learning. In this paper we propose an inductive transfer learning method for Bayesian networks, that considers both structure and parameter learning. For structure learning we use conditional independence tests, by combining measures from the target task with those obtained from one or more auxiliary tasks, using a novel weighted sum of the conditional independence measures. For parameter learning, we propose two variants of the linear pool for probability aggregation, combining the probability estimates from the target task with those from the auxiliary tasks. To validate our approach, we used three Bayesian networks models that are commonly used for evaluating learning techniques, and generated variants of each model by changing the structure as well as the parameters. We then learned one of the variants with a small dataset and combined it with information from the other variants. The experimental results show a significant improvement in terms of structure and parameters when we transfer knowledge from similar tasks. We also evaluated the method with real-world data from a manufacturing process considering several products, obtaining an improvement in terms of log-likelihood between the data and the model when we do transfer learning from related products.
Keywords:
Inductive transfer
Bayesian networks
Structure learning
Parameter learning

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

I
instituto nacional de astrofisica, optica y electronica
Scholars:
1.7K
Papers: 1.5K
Citations: 1
Cited Papers

Cited Papers

Characterization of α<sub>2A</sub>-Adrenergic Receptors in GT1 Neurosecretory Cells
err2008-04-09
err0
PREAI
errAmy Lee; Edmund Talley; Diane L. Rosin; Kevin R. Lynch
errShare
errSave
Nr2f1a balances atrial chamber and atrioventricular canal size via BMP signaling-independent and -dependent mechanisms
err2018-02-01
err0
errOAAI
errTiffany B. Duong; Padmapriyadarshini Ravisankar; Yuntao Charlie Song; Jacob T. Gafranek; Ariel B. Rydeen; Tracy E. Dohn; Lindsey A. Barske; J. Gage Crump; Joshua S. Waxman
errShare
errSave
Multitask learning
err1997-01-01
err4.9K
errOAAI
errCaruana, R
errShare
errSave
The vibrational frequencies of TiFnCl4−n, n=0,4
err1990-03-15
err0
PREAI
errCharles W. Bauschlicher; Peter R. Taylor; Andrew Komornicki
errShare
errSave
Inductive transfer with context-sensitive neural networks
err2008-10-21
err40
errOAAI
errSilver, Daniel L.; Poirier, Ryan; Currie, Duane
errShare
errSave
Adaptive probabilistic networks with hidden variables
err1997-01-01
err237
errOAAI
errBinder, J; Koller, D; Russell, S; Kanazawa, K
errShare
errSave
Methylation of CHFR sensitizes esophageal squamous cell cancer to docetaxel and paclitaxel
err2014-12-31
err0
errOAAI
errTianyang Yun; Yang Liu; Dan Gao; Enqiang Linghu; Malcolm V. Brock; Dongtao Yin; Qimin Zhan; James G. Herman; Mingzhou Guo
errShare
errSave
no more