arrow
返回

Multimodal interaction: A review

delete2014-01-01
delete301
PRE
AI
M
Matthew Turk *
DOI:10.1016/j.patrec.2013.07.003delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
People naturally interact with the world multimodally, through both parallel and sequential use of multiple perceptual modalities. Multimodal human-computer interaction has sought for decades to endow computers with similar capabilities, in order to provide more natural, powerful, and compelling interactive experiences. With the rapid advance in non-desktop computing generated by powerful mobile devices and affordable sensors in recent years, multimodal research that leverages speech, touch, vision, and gesture is on the rise. This paper provides a brief and personal review of some of the key aspects and issues in multimodal interaction, touching on the history, opportunities, and challenges of the area, especially in the area of multimodal integration. We review the question of early vs. late integration and find inspiration in recent evidence in biological sensory integration. Finally, we list challenges that lie ahead for research in multimodal human-computer interaction. (C) 2013 Elsevier B.V. All rights reserved.
Keyword:
Multimodal interaction
Perceptual interface
Multimodal integration
Review

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
7.9K
被引数:
1.6W

机构

暂无机构信息
引用论文

引用论文

Enantiomeric 2-anilino-2-oxo-1,3,2-oxazaphosphorinanes: Synthesis and NMR-investigation of their non-racemic mixtures
err1995-07-01
err0
PREAI
errAndrei B. Ouryupin; Mikhail I. Kadyko; Pavel V. Petrovskii; Erlen I. Fedin; Andrzej Okruszek; Ryszard Kinas; Wojciech J. Stec
err分享
err收藏
Rectifying behaviors of Langmuir–Blodgett films of an asymmetrically substituted phthalocyanine
err1998-11-01
err0
PREAI
errShuqin Zhou; Yunqi Liu; Yu Xu; Wenping Hu; Daoben Zhu; Xiaohui Qiu; Chen Wang; Chunli Bai
err分享
err收藏
err分享
err收藏
Interrogation of brain miRNA and mRNA expression profiles reveals a molecular regulatory network that is perturbed by mutant huntingtin
err2012-09-28
err0
errOAAI
errJing Jin; Yong Cheng; Yongqing Zhang; William Wood; Qi Peng; Emmette Hutchison; Mark P. Mattson; Kevin G. Becker; Wenzhen Duan
err分享
err收藏
学者 查看更多内容