arrow
Return

Recurrent computations for visual pattern completion

delete2018-08-13
delete112
delete
OA
AI
H
Hanlin Tang
M
Martin Schrimpf
W
William Lotter
C
Charlotte Moerman
A
Ana Paredes
J
Josue Ortega
W
Walter Hardesty
D
David Cox
G
Gabriel Kreiman *
DOI:10.1073/pnas.1719397115delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Making inferences from partial information constitutes a critical aspect of cognition. During visual perception, pattern completion enables recognition of poorly visible or occluded objects. We combined psychophysics, physiology, and computational models to test the hypothesis that pattern completion is implemented by recurrent computations and present three pieces of evidence that are consistent with this hypothesis. First, subjects robustly recognized objects even when they were rendered <15% visible, but recognition was largely impaired when processing was interrupted by backward masking. Second, invasive physiological responses along the human ventral cortex exhibited visually selective responses to partially visible objects that were delayed compared with whole objects, suggesting the need for additional computations. These physiological delays were correlated with the effects of backward masking. Third, state-of-the-art feed-forward computational architectures were not robust to partial visibility. However, recognition performance was recovered when the model was augmented with attractor-based recurrent connectivity. The recurrent model was able to predict which images of heavily occluded objects were easier or harder for humans to recognize, could capture the effect of introducing a backward mask on recognition behavior, and was consistent with the physiological delays along the human ventral visual stream. These results provide a strong argument of plausibility for the role of recurrent computations in making visual inferences from partial information.
Keywords:
visual object recognition
computational neuroscience
pattern completion
artificial intelligence
machine learning

Journal

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
Papers:
10.8W
Citations:
82.1W

Organization

U
university of munich
Scholars:
347
Papers: 112
Citations: 1.4K
H
Harvard University
Scholars:
5.7K
Papers: 2.0K
Citations: 1.0W
Cited Papers

Cited Papers

European Stroke Organisation (ESO)- European Society for Minimally Invasive Neurological Therapy (ESMINT) guidelines on mechanical thrombectomy in acute ischemic stroke
err2019-05-31
err0
errOAAI
errGuillaume Turc; Pervinder Bhogal; Urs Fischer; Pooja Khatri; Kyriakos Lobotesis; Mikaël Mazighi; Peter D Schellinger; Danilo Toni; Joost de Vries; Philip White; Jens Fiehler
errShare
errSave
Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex
errNEURON
IF15
err2009-04-01
err328
errOAAI
errLiu, Hesheng; Agam, Yigal; Madsen, Joseph R.; Kreiman, Gabriel
errShare
errSave
Top-down influences on visual processing
err2013-04-18
err818
errOAAI
errGilbert, Charles D.; Li, Wu
errShare
errSave
errShare
errSave
Maturational Changes of Lymphocyte Surface Antigens in Human Blood: Comparison between Fetuses, Neonates and Adults
err2000-08-31
err0
PREAI
errC. Schultz; I. Reiss; P. Bucsky; W. Göpel; U. Gembruch; S. Ziesenitz; L. Gortner
errShare
errSave
errShare
errSave
Controlling Rydberg-dressed four-wave mixing via dual electromagnetically induced transparency windows
err2016-07-14
err0
PREAI
errZhaoyang Zhang; Haijun Tang; Irfan Ahmed; Noor Ahmed; Ghulam Abbas Khan; Abdul Rasheed Mahesar; Yanpeng Zhang
errShare
errSave
researcher View more