.png){kind=icon}
返回
Adaptive depth-aware visual relationship detection
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2022.108786.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual relationship detection aims at detecting the interaction between objects from flat image, where visual appearance and spatial relationship between different objects are two key factors for detection. However, most existing methods usually extract 2D information of object from flat images, which lacks depth information compared to actual 3D space. To obtain and utilize depth information for visual relationship detection, we construct Depth VRDs dataset as an extension of the VRD dataset and propose adaptive depth-aware visual relationship detection network(ADVRD). In terms of visual appearance, we propose depth-aware visual fusion module to use additional depth visual information to guide RGB visual information where needs to be strengthened. In terms of spatial relationship, to generate a more accurate depth representation when locating object depth spatial position, we propose adaptive depth spatial location method which uses regional information variance to measure information relevance in each small region in object bounding box. Experiment results show that depth information can significantly improve the performance of our network on visual relationship detection tasks, especially for zero shots.
Keyword:
Visual relationship detection
Estimated depth maps
Depth-aware visual fusion
Adaptive depth spatial location
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
分享收藏
分享收藏
X-ray investigation of the coordination and complex formation of lanthanoid ions in aqueous perchlorate and selenate solutions高氯酸盐和硒酸水溶液中镧系离子的配位和络合物形成的x射线研究
PREAI
分享收藏Spatial attention based visual semantic learning for action recognition in still images基于空间注意的视觉语义学习在静止图像动作识别中的应用.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容