arrow
Return

Gradient-based boosting for statistical relational learning: the Markov logic network and missing data cases

delete2015-02-20
delete33
delete
OA
AI
T
Tushar Khot *
S
Sriraam Natarajan
K
Kristian Kersting
J
Jude Shavlik
DOI:10.1007/s10994-015-5481-4delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Recent years have seen a surge of interest in Statistical Relational Learning (SRL) models that combine logic with probabilities. One prominent and highly expressive SRL model is Markov Logic Networks (MLNs), but the expressivity comes at the cost of learning complexity. Most of the current methods for learning MLN structure follow a two-step approach where first they search through the space of possible clauses (i.e. structures) and then learn weights via gradient descent for these clauses. We present a functional-gradient boosting algorithm to learn both the weights (in closed form) and the structure of the MLN simultaneously. Moreover most of the learning approaches for SRL apply the closed-world assumption, i.e., whatever is not observed is assumed to be false in the world. We attempt to open this assumption. We extend our algorithm for MLN structure learning to handle missing data by using an EM-based approach and show this algorithm can also be used to learn Relational Dependency Networks and relational policies. Our results in many domains demonstrate that our approach can effectively learn MLNs even in the presence of missing data.
Keywords:
Statistical relational learning
Markov logic networks
Missing data
Expectation maximization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

I
indiana university system
Scholars:
4.0W
Papers: 3.5W
Citations: 38
U
university of wisconsin madison
Scholars:
3.8W
Papers: 2.9W
Citations: 53
University of Wisconsin System cover
University of Wisconsin System
Scholars:
6.7W
Papers: 5.8W
Citations: 382
researcher View more organizations