arrow
Return

Bayesian network parameter learning with constraint tradeoff

delete2025-11-01
delete0
PRE
AI
X
Xiaoguang Gao *
Y
Yangyang Wang
X
Xiaohan Liu
Y
Yao Li
DOI:10.1016/j.ins.2025.122839delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
When training data are insufficient, purely using data to learn the Bayesian network (BN) parameters may cause overfitting, making it challenging to obtain precise parameters. Numerous studies have improved learning accuracy by translating expert knowledge into parameter constraints. However, the credibility of the constraints is difficult to ensure, and over-reliance on constraints may cause parameters to be underfitted. Therefore, this paper attempts to design a simple and effective constraint control mechanism by weighing the roles played by data and constraints in learning to balance underfitting and overfitting. The control mechanism follows two rules: the samples for each parameter have more impact on the learning accuracy than samples for the network; the more data there are, the less constraint intervention is required, and vice versa. Then, the mechanism is applied to maximum a posteriori estimation (MAP) and data extension. A constrained control mechanism MAP (CCM-MAP) is proposed. CCM-MAP quantifies prior parameters via constraints and selects hyperparameters using the mechanism. A constraint control mechanism bootstrap (CCM-B) is proposed. CCM-B quantifies prior parameters through constraints and determines the extension function of the parametric bootstrap using the mechanism. Extensive experiments have verified that the two presented methods can enhance the accuracy of parameter learning.
Keywords:
Bayesian network
Parameter learning
Overfitting
Underfitting

Journal

Information Sciences cover
Information Sciences
IF:
6.8
Papers:
540
Citations:
6.2W

Organization

N
northwestern polytechnical university
Scholars:
1.3W
Papers: 4.6K
Citations: 0
Cited Papers

Cited Papers

Discriminative learning of bayesian network parameters by differential evolution
err2021-05-01
err0
PREAI
errAlejandro Platas-López; Efrén Mezura-Montes; Nicandro Cruz-Ramírez; Alejandro Guerra-Hernández
errShare
errSave
A Correlation-Based Feature Weighting Filter for Naive Bayes
err2019-02-01
err200
PREAI
errJiang, Liangxiao; Zhang, Lungan; Li, Chaoqun; Wu, Jia
errShare
errSave
Bayesian network parameter learning using constraint-based data extension method
err2022-08-13
err3
PREAI
errRu, Xinxin; Gao, Xiaoguang; Wang, Yangyang; Liu, Xiaohan
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more