arrow
Return

Evidence for Visual Simulation During Sign Language Processing

delete2021-10-01
delete4
delete
OA
AI
G
Gerardo Ortega *
M
Markus Ostarek
DOI:10.1037/xge0001041delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
What are the mental processes that allow us to understand the meaning of words? A large body of evidence suggests that when we process speech, we engage a process of perceptual simulation whereby sensorimotor states are activated as a source of semantic information. But does the same process take place when words are expressed with the hands and perceived through the eyes? To date, it is not known whether perceptual simulation is also observed in sign languages, the manual-visual languages of deaf communities. Continuous flash suppression is a method that addresses this question by measuring the effect of language on detection sensitivity to images that are suppressed from awareness. In spoken languages, it has been reported that listening to a word (e.g., bottle) activates visual features of an object (e.g., the shape of a bottle), and this in turn facilitates image detection. An interesting but untested question is whether the same process takes place when deaf signers see signs. We found that processing signs boosted the detection of congruent images, making otherwise invisible pictures visible. A boost of visual processing was observed only for signers but not for hearing nonsigners, suggesting that the penetration of the visual system through signs requires a fully fledged manual language. Iconicity did not modulate the effect of signs on detection, neither in signers nor in hearing nonsigners. This suggests that visual simulation during language processing occurs regardless of language modality (sign vs. speech) or iconicity, pointing to a foundational role of simulation for language comprehension.
Keywords:
perceptual simulation
language processing
continuous flash suppression
sign languages
iconicity

Journal

J
Journal of Experimental Psychology-General
IF:
3.5
Papers:
2.9K
Citations:
1.6W

Organization

U
University of Birmingham
Scholars:
4.1W
Papers: 3.8W
Citations: 5.0W
M
Max Planck Society
Scholars:
8.2W
Papers: 7.7W
Citations: 3.3W
Cited Papers

Cited Papers

No cited papers available