arrow
返回

Visual Social Relationship Recognition

delete2020-02-03
delete15
PRE
AI
J
Junnan Li *
Y
Yongkang Wong
Q
Qi Zhao
M
Mohan Kankanhalli
DOI:10.1007/s11263-020-01295-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Social relationships form the basis of social structure of humans. Developing computational models to understand social relationships from visual data is essential for building intelligent machines that can better interact with humans in a social environment. In this work, we study the problem of visual social relationship recognition in images. We propose a dual-glance model for social relationship recognition, where the first glance fixates at the person of interest and the second glance deploys attention mechanism to exploit contextual cues. To enable this study, we curated a large scale People in Social Context dataset, which comprises of 23,311 images and 79,244 person pairs with annotated social relationships. Since visually identifying social relationship bears certain degree of uncertainty, we further propose an adaptive focal loss to leverage the ambiguous annotations for more effective learning. We conduct extensive experiments to quantitatively and qualitatively demonstrate the efficacy of our proposed method, which yields state-of-the-art performance on social relationship recognition.
Keyword:
Social relationship
Label ambiguity
Context-driven analysis
Attention
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

err分享
err收藏
GEOTRACES IC1 (BATS) contamination‐prone trace element isotopes Cd, Fe, Pb, Zn, Cu, and Mo intercalibration
err2012-09-19
err0
errOAAI
errEdward A. Boyle; Seth John; Wafa Abouchami; Jess F. Adkins; Yolanda Echegoyen‐Sanz; Michael Ellwood; A. Russell Flegal; Kyrstin Fornace; Celine Gallon; Steve Galer; Melanie Gault‐Ringold; Francois Lacan; Amandine Radic; Mark Rehkamper; Olivier Rouxel; Yoshiki Sohrin; Claudine Stirling; Claire Thompson; Derek Vance; Zichen Xue; Ye Zhao
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
Stress, predators, and survival: Exploring permit (Trachinotus falcatus) catch-and-release fishing mortality in the Florida Keys
err2020-03-01
err0
errOAAI
errPeter E. Holder; Lucas P. Griffin; Aaron J. Adams; Andy J. Danylchuk; Steven J. Cooke; Jacob W. Brownscombe
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容