arrow
Return

Augmenting Conversations With Comic-Style Word Balloons

delete2023-04-01
delete1
PRE
AI
H
Heng Zhang
朱利丰 (Lifeng Zhu) *
Q
Qingdi Chen
A
Aiguo Song
DOI:10.1109/THMS.2022.3224767delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a novel approach for enabling comic-style conversation in mixed reality to assist face-to-face conversation on-site or remotely. Our approach brings word balloons of comic-style conversation to the real world. The word balloons can adapt to mixed reality scenes, such as the 3-D head motion of the speaker, the comic styles, and the speech. During the conversation, our approach updates the word balloons continuously in the object space and discretely in the image space, guided by a field learned from comics. Quantitative experiments and perceptual studies were conducted to evaluate and compare our approach with alternatives. The results from the user study and ablation study demonstrated that our approach turns out to be practical for assisting face-to-face conversation.
Keywords:
Oral communication
Faces
Visualization
Layout
Cameras
Real-time systems
Man-machine systems
Comics
mixed reality
word balloons

Journal

IEEE Transactions on Human-Machine Systems cover
IEEE Transactions on Human-Machine Systems
IF:
4.4
Papers:
1.1K
Citations:
3.5K

Organization

G
George Mason University
Scholars:
7.7K
Papers: 7.9K
Citations: 1.0W
S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57