arrow
Return

Modeling PU learning using probabilistic logic programming

delete2023-11-27
delete0
PRE
AI
V
Victor Verreet *
L
Luc De Raedt
J
Jessa Bekker
DOI:10.1007/s10994-023-06461-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The goal of learning from positive and unlabeled (PU) examples is to learn a classifier that predicts the posterior class probability. The challenge is that the available labels in the data are determined by (1) the true class, and (2) the labeling mechanism that selects which positive examples get labeled, where often certain examples have a higher probability to be selected than others. Incorrectly assuming an unbiased labeling mechanism leads to learning a biased classifier. Yet, this is what most existing methods do. A handful of methods makes more realistic assumptions, but they are either so general that it is impossible to distinguish between the effects of the true classification and of the labeling mechanism, or too restrictive to correctly model the real situation, or require knowledge that is typically unavailable. This paper studies how to formulate and integrate more realistic assumptions for learning better classifiers, by exploiting the strengths of probabilistic logic programming (PLP). Concretely, (1) we propose PU ProbLog: a PLP-based general method that allows to (partially) model the labeling mechanism. (2) We show that our method generalizes existing methods, in the sense that it can model the same assumptions. (3) Thanks to the use of PLP, our method supports also PU learning in relational domains. (4) Our empirical analysis shows that partially modeling the labeling bias, improves the learned classifiers.
Keywords:
Positive unlabeled learning
Weak supervision
Probabilistic logic programming
Modeling
Unidentifiability

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

K
KU Leuven
Scholars:
5.7W
Papers: 5.2W
Citations: 8.1W
Cited Papers

Cited Papers

errShare
errSave
Overview
err2007-11-01
err0
PREAI
errAaditya Mattoo; Robert M. Stern
errShare
errSave
CAUSAL AND STATISTICAL MODELS
err1987-01-01
err0
PREAI
errClark Glymour; Richard Scheines; Peter Spirtes; Kevin Kelly
errShare
errSave
Cellular infiltrates in skin and sural nerve of patients with polyneuropathies
err2017-03-28
err0
PREAI
errNurcan Üçeyler; Silvia Braunsdorf; Ekkehard Kunze; Nadja Riediger; Sarah Scheytt; Šarka Divisova; Can Ebru Bekircan‐kurt; Klaus Viktor Toyka; Claudia Sommer
errShare
errSave
errShare
errSave
researcher View more