.png){kind=icon}
返回
Knowledge guided relation enhancement for human-object interaction detection
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-025-06279-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The Human-Object Interaction (HOI) detection task aims to locate humans and objects, find their matching relationships, and infer their interactions. While existing HOI methods have leveraged the CLIP model, a pre-trained visual-language model capable of understanding both images and text, to improve performance, they still fall short in fully capturing the complexity and fine-grained details of human-object interactions. As a result, their ability to reason about interactions accurately and in-depth remains limited. Therefore, we propose a knowledge-guided interaction perception module that combines multiple relationship information with CLIP's visual feature information. Then, we utilize prior interaction knowledge from intersection regions to guide the process, resulting in more accurate human-object interaction detection. Moreover, we find that the potential interaction of images relies on subtle visual cues but is masked by other irrelevant information, making it difficult for algorithms to capture the basic features of interaction accurately. To address this, we have designed a human-object salient region enhancement module to enhance the feature information of humans and objects and enable better interaction pairing. Experimental results demonstrate that our method with knowledge guided (KGRE) achieves state-of-the-art performance on both the HICO-DET and V-COCO benchmark datasets.
Keyword:
Human-object interaction
CLIP
Knowledge-guidance
Region enhancement
Interaction learning
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
分享收藏CLVIN: Complete language-vision interaction network for visual question answeringCLVIN: 完整的语言视觉互动网络，用于视觉问答
PREAI
分享收藏Modeling the Relationship of Survival to Longitudinal Data Measured with Error. Applications to Survival and CD4 Counts in Patients with AIDS对生存率与误差测量的纵向数据的关系进行建模。在艾滋病患者的生存和CD4计数中的应用
PREAI
分享收藏分享收藏Urbanisation at Multiple Scales Is Associated with Larger Size and Higher Fecundity of an Orb-Weaving Spider.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏
查看更多内容