.png){kind=icon}
返回
SonicFace: Tracking Facial Expressions Using a Commodity Microphone Array
.png){kind=icon}
PRE
AI
DOI：10.1145/3494988.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Accurate recognition of facial expressions and emotional gestures is promising to understand the audience's feedback and engagement on the entertainment content. Existing methods are primarily based on various cameras or wearable sensors, which either raise privacy concerns or demand extra devices. To this aim, we propose a novel ubiquitous sensing system based on the commodity microphone array - SonicFace, which provides an accessible, unobtrusive, contact-free, and privacy-preserving solution to monitor the user's emotional expressions continuously without playing hearable sound. SonicFace utilizes a pair of speaker and microphone array to recognize various fine-grained facial expressions and emotional hand gestures by emitted ultrasound and received echoes. Based on a set of experimental evaluations, the accuracy of recognizing 6 common facial expressions and 4 emotional gestures can reach around 80%. Besides, the extensive system evaluations with distinct configurations and an extended real-life case study have demonstrated the robustness and generalizability of the proposed SonicFace system.
Keyword:
Acoustic sensing
smart speaker
facial expression
emotion
期刊
P
IF:
4.5
论文数:
1.1K
被引数:
7.2K
机构
引用论文
Evolution of the tan Locus Contributed to Pigment Loss in Drosophila santomea: A Response to Matute et al..png)
Cell
OAAI
CellIF0
OAAI分享收藏分享收藏Multi-Target Intense Human Motion Analysis and Detection Using Channel State InformationSENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容