.png){kind=icon}
返回
CHA: Conditional Hyper-Adapter method for detecting human-object interaction
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.111075.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Human-object interactions (HOI) detection aims at capturing human-object pairs in images and predicting their actions. It is an essential step for many visual reasoning tasks, such as VQA, image retrieval and surveillance event detection. The challenge of this task is to tackle the compositional learning problem, especially in a few-shot setting. A straightforward approach is designing a group of dedicated models for each specific pair. However, the maintenance of these independent models is unrealistic due to combinatorial explosion. To address the above problems, we propose a new Conditional Hyper-Adapter (CHA) method based on meta-learning. Different from previous works, our approach regards each as an independent sub-task. Meanwhile, we design two kinds of Hyper-Adapter structures to guide the model to learn how to address the HOI detection. By combining the different conditions and hypernetwork, the CHA can adaptively generate partial parameters and improve the representation and generalization ability of the model. Finally, our proposed method can be viewed as a plug-and-play module to boost existing HOI detection models on the widely used HOI benchmarks.
Keyword:
Human-object interaction detection
Hypernetwork
Meta learning
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏分享收藏分享收藏The Alkaloid Compound Harmane Increases the Lifespan of Caenorhabditis elegans during Bacterial Infection, by Modulating the Nematode’s Innate Immune Response.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Urbanisation at Multiple Scales Is Associated with Larger Size and Higher Fecundity of an Orb-Weaving SpiderPLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏
查看更多内容