arrow
返回

Learning Bayesian network structures using weakest mutual-information-first strategy

delete2019-11-01
delete22
delete
OA
AI
綦小龙 (Xiaolong Qi)
高扬 封面图
高扬 (Yang Gao) *
刘艳芳 (Yanfang Liu)
DOI:10.1016/j.ijar.2019.08.004delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In Bayesian network structure learning, the quality of the directed graph learned by the constraint-based approaches can be greatly affected by the order of choosing variable pairs and the order of selecting condition sets for testing conditional independence. Inspired by the strong connection between the degree of mutual information shared by two variables and their conditional independence, we introduce the M-ordering concept, where a matrix is precomputed from the observational data with variables ordered increasingly by their respective degree of mutual information with the target variable under concern. Given the M-ordering matrix, we propose a strategy called Weakest Mutual-Information-First Strategy (WMIF), which is integrated into the PC-algorithm in two aspects: an MI-based edge removal strategy, and an MI-based condition set generation strategy. The MI-based edge removal strategy is to always select the variable pair with the weakest mutual information to test their conditional independence; the condition set generation strategy is to construct a conditioning set where variables bearing a weaker degree of mutual information with the target variable are always considered first. We prove that the weakest MI-based edge removal strategy is sound, and our PC-MI algorithm, a PC variant empowered by the WMIF strategy, is order-independent. Moreover, in PC algorithms, the number of conditional independence tests increases exponentially with the number of random variables; we. show that the WMIF strategy can effectively reduce the complexity (bounded by o(vertical bar V vertical bar(2(vertical bar adj(X)vertical bar) - vertical bar v vertical bar(2)/2))). We have conducted experiments with both low-dimensional and high-dimensional data sets, and the results indicate that PC-MI outperforms the state-of-the-art approaches. More importantly, the order-agnostic property of PC-MI can be extremely useful when it is hard to prescribe a meaningful variable ordering as needed in some other PC algorithms. (C) 2019 Elsevier Inc. All rights reserved.
Keyword:
Bayesian network
PC-algorithm
Mutual information
Variable ordering
Conditional independence
Markov chain
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Approximate Reasoning 封面图
International Journal of Approximate Reasoning
IF:
3
论文数:
3.0K
被引数:
5.1K

机构

California State University System 封面图
California State University System
学者数:
2.8W
论文数: 2.4W
被引数: 457
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87