返回
Multi-Label Contrastive Learning for Abstract Visual Reasoning
DOI:10.1109/TNNLS.2022.3185949.png)
摘要
En 中文
For a long time, the ability to solve abstract reasoning tasks was considered one of the hallmarks of human intelligence. Recent advances in the application of deep learning (DL) methods led to surpassing human abstract reasoning performance, specifically in the most popular type of such problems-Raven's progressive matrices (RPMs). While the efficacy of DL systems is indeed impressive, the way they approach the RPMs is very different from that of humans. State-of-the-art systems solving RPMs rely on massive pattern-based training and sometimes on exploiting biases in the dataset, whereas humans concentrate on the identification of the rules/concepts underlying the RPM to be solved. Motivated by this cognitive difference, this work aims at combining DL with the human way of solving RPMs. Specifically, we cast the problem of solving RPMs into a multilabel classification framework where each RPM is viewed as a multilabel data point, with labels determined by the set of abstract rules underlying the RPM. For efficient training of the system, we present a generalization of the noise contrastive estimation algorithm to the case of multilabel samples and a new sparse rule encoding scheme for RPMs. The proposed approach is evaluated on the two most popular benchmark datasets I-RAVEN and procedurally generated matrices (PGM) and on both of them demonstrate an advantage over the state-of-the-art results.
Keyword:
Cognition
Visualization
Training
Task analysis
Human intelligence
Learning systems
Estimation
Abstract visual reasoning
contrastive learning
Raven's progressive matrices (RPMs)
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Distributed representations of structure: A theory of analogical access and mapping
PSYCHOLOGICAL REVIEW
IF5.8
WHAT ONE INTELLIGENCE-TEST MEASURES - A THEORETICAL ACCOUNT OF THE PROCESSING IN THE RAVEN PROGRESSIVE MATRICES TEST一项智力测验的措施-对RAVEN渐进式矩阵测验中处理的理论解释
PSYCHOLOGICAL REVIEW
IF5.8

