arrow
Return

Multimodal Language Processing in Human Communication

delete2019-08-01
delete188
delete
OA
AI
J
Judith Holler *
S
Stephen C. Levinson
DOI:10.1016/j.tics.2019.05.006delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The natural ecology of human language is face-to-face interaction comprising the exchange of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of language in its natural niche raises new issues, first and foremost the binding of multiple, temporally offset signals under tight time constraints posed by a turn-taking system. This might be expected to overload and slow our cognitive system, but the reverse is in fact the case. We propose cognitive mechanisms that may explain this phenomenon and call for a multimodal, situated psycholinguistic framework to unravel the full complexities of human language processing.
Keywords:
REACTION-TIME-TASK
TURN-TAKING
ICONIC GESTURES
HAND GESTURES
SPEECH
COMPREHENSION
INTEGRATION
BODY
REPRESENTATION
ORGANIZATION
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Trends in Cognitive Sciences cover
Trends in Cognitive Sciences
IF:
17.2
Papers:
3.6K
Citations:
3.5W

Organization

M
Max Planck Society
Scholars:
8.2W
Papers: 7.7W
Citations: 3.3W