arrow
返回

IPGN: Interactiveness Proposal Graph Network for Human-Object Interaction Detection

delete2021-01-01
delete25
PRE
AI
王浩然 (Haoran Wang)
L
Licheng Jiao *
刘芳 (Fang Liu)
L
Lingling Li
刘旭 (Xu Liu)
D
Deyi Ji
W
Weihao Gan
DOI:10.1109/TIP.2021.3096333delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human-Object Interaction (HOI) Detection is an important task to understand how humans interact with objects. Most of the existing works treat this task as an exhaustive triplet (human, verb, object) classification problem. In this paper, we decompose it and propose a novel two-stage graph model to learn the knowledge of interactiveness and interaction in one network, namely, Interactiveness Proposal Graph Network (IPGN). In the first stage, we design a fully connected graph for learning the interactiveness, which distinguishes whether a pair of human and object is interactive or not. Concretely, it generates the interactiveness features to encode high-level semantic interactiveness knowledge for each pair. The class-agnostic interactiveness is a more general and simpler objective, which can be used to provide reasonable proposals for the graph construction in the second stage. In the second stage, a sparsely connected graph is constructed with all interactive pairs selected by the first stage. Specifically, we use the interactiveness knowledge to guide the message passing. By contrast with the feature similarity, it explicitly represents the connections between the nodes. Benefiting from the valid graph reasoning, the node features are well encoded for interaction learning. Experiments show that the proposed method achieves state-of-the-art performance on both V-COCO and HICO-DET datasets.
Keyword:
Human-object interaction detection
two-stage graph model
interactiveness proposal
interaction learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Effectiveness of five personal shark-bite deterrents for surfers
err2018-08-31
err0
errOAAI
errCharlie Huveneers; Sasha Whitmarsh; Madeline Thiele; Lauren Meyer; Andrew Fox; Corey J.A. Bradshaw
err分享
err收藏
Development of a Whole Agency Approach to Market Segmentation in Parks
err2017-12-13
err0
PREAI
errDino Zanon; John Hall; Leonie Lockstone-Binney; Delene Weber
err分享
err收藏
Osteomyelitis in dogs and cats caused by anaerobic bacteria
err2008-03-10
err0
PREAI
errK. A. JOHNSON; G. R. LOMAS; A. K. W. WOOD
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
学者 查看更多内容