arrow
Return

aILP: thinking visual scenes as differentiable logic programs

delete2023-03-14
delete6
delete
OA
AI
H
Hikaru Shindo *
V
Viktor Pfanschilling
D
Devendra Singh Dhami
K
Kristian Kersting
DOI:10.1007/s10994-023-06320-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep neural learning has shown remarkable performance at learning representations for visual object categorization. However, deep neural networks such as CNNs do not explicitly encode objects and relations among them. This limits their success on tasks that require a deep logical understanding of visual scenes, such as Kandinsky patterns and Bongard problems. To overcome these limitations, we introduce aILP, a novel differentiable inductive logic programming framework that learns to represent scenes as logic programs & mdash;intuitively, logical atoms correspond to objects, attributes, and relations, and clauses encode high-level scene information. aILP has an end-to-end reasoning architecture from visual inputs. Using it, aILP performs differentiable inductive logic programming on complex visual scenes, i.e., the logical rules are learned by gradient descent. Our extensive experiments on Kandinsky patterns and CLEVR-Hans benchmarks demonstrate the accuracy and efficiency of aILP in learning complex visual-logical concepts.
Keywords:
Differentiable reasoning
Inductive logic programming
Object-centric learning
Neuro-symbolic AI

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

T
Technical University of Darmstadt
Scholars:
1.3W
Papers: 10.0K
Citations: 1.2W
Cited Papers

Cited Papers

errShare
errSave
Semantic-based regularization for learning and inference
err2017-03-01
err104
PREAI
errDiligenti, Michelangelo; Gori, Marco; Sacca, Claudio
errShare
errSave
Identification and Characterization of Latex-Specific Proteins in Opium Poppy
err1985-10-01
err0
errOAAI
errCraig L. Nessler; Randy D. Allen; Samuel Galewsky
errShare
errSave
Lifted discriminative learning of probabilistic logic programs
err2018-08-20
err9
errOAAI
errFadja, Arnaud Nguembang; Riguzzi, Fabrizio
errShare
errSave
errShare
errSave
Learning programs by learning from failures
err2021-02-19
err37
errOAAI
errCropper, Andrew; Morel, Rolf
errShare
errSave
Absence of aluminium in neuritic plaque cores in Alzheimer's disease
err1992-11-01
err0
PREAI
errJ. P. Landsberg; B. McDonald; F. Watt
errShare
errSave
researcher View more