arrow
返回

Refining neural network predictions using background knowledge

delete2023-03-14
delete4
delete
OA
AI
A
Alessandro Daniele
E
Emile van Krieken *
L
Luciano Serafini
F
Frank van Harmelen
DOI:10.1007/s10994-023-06310-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent work has shown learning systems can use logical background knowledge to compensate for a lack of labeled training data. Many methods work by creating a loss function that encodes this knowledge. However, often the logic is discarded after training, even if it is still helpful at test time. Instead, we ensure neural network predictions satisfy the knowledge by refining the predictions with an extra computation step. We introduce differentiable refinement functions that find a corrected prediction close to the original prediction. We study how to effectively and efficiently compute these refinement functions. Using a new algorithm called iterative local refinement (ILR), we combine refinement functions to find refined predictions for logical formulas of any complexity. ILR finds refinements on complex SAT formulas in significantly fewer iterations and frequently finds solutions where gradient descent can not. Finally, ILR produces competitive results in the MNIST addition task.
Keyword:
Neurosymbolic AI
Fuzzy logic
Optimization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

V
Vrije Universiteit Amsterdam
学者数:
4.2W
论文数: 3.7W
被引数: 3.7W
F
Fondazione Bruno Kessler
学者数:
1.8K
论文数: 1.7K
被引数: 3.2K
引用论文

引用论文

Semantic-based regularization for learning and inference
err2017-03-01
err104
PREAI
errDiligenti, Michelangelo; Gori, Marco; Sacca, Claudio
err分享
err收藏
Guillain–Barré syndrome associated with cytomegalovirus infection after allogeneic hematopoietic stem cell transplantation
err2005-09-08
err0
PREAI
errJ.‐C. Hernández‐Boluda; M.‐J. Lis; R. Goterris; C. Arbona; M.‐J. Terol; M. Tormo; C. Solano
err分享
err收藏
Tillage Energy of a Vibrating Tillage Tool
err1963-01-01
err0
PREAI
errJ. G. Hendrick and W. F. Buchele
err分享
err收藏
err分享
err收藏
Analyzing Differentiable Fuzzy Logic Operators分析可微模糊逻辑算子
err2022-01-01
err64
errOAAI
errvan Krieken, Emile; Acar, Erman; van Harmelen, Frank
err分享
err收藏
On a Convex Logic Fragment for Learning and Reasoning
err2019-07-01
err8
errOAAI
errGiannini, Francesco; Diligenti, Michelangelo; Gori, Marco; Maggini, Marco
err分享
err收藏
学者 查看更多内容