返回
Multimodal object oriented user interfaces in mobile affective interaction
DOI:10.1007/s11042-011-0744-y.png)
摘要
En 中文
In this paper, we investigate an object oriented (OO) architecture for multimodal emotion recognition in interactive applications through mobile phones or handheld devices. Mobile phones are different from desktop computers since mobile phones are not performing any processing involving emotion recognition whereas desktop computers can perform such processing. In fact, in our approach, mobile phones have to pass all data collected to a server and then perform emotion recognition. The object oriented architecture that we have created, combines evidence from multiple modalities of interaction, namely the mobile device's keyboard and the mobile device's microphone, as well as data from emotion stereotypes. Moreover, the OO method classifies them into well structured objects with their own properties and methods. The resulting emotion detection server is capable of using and handling transmitted information from different mobile sources of multimodal data during human-computer interaction. As a test bed for the affective mobile interaction we have used an educational application that is incorporated into the mobile system.
Keyword:
Multimodal interaction
Affective computing
Mobile interaction
Object oriented programming
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
Overlay improvement roadmap: strategies for scanner control and product disposition for 5-nm overlay套合改善路线图:针对5-nm套合的扫描仪控制与产品处置策略
User-centered Modeling and evaluation of multimodal interfaces以用户为中心的多模态界面建模与评价
PROCEEDINGS OF THE IEEE
IF25.9
Composition analysis of semiconductor quantum wells by energy filtered convergent-beam electron diffraction半导体量子阱的能量过滤会聚束电子衍射成分分析
The Perceptual and Cognitive Role of Visual and Auditory Channels in Conveying Emotional Information视觉和听觉渠道在传达情感信息中的感知和认知作用

