.png){kind=icon}
返回
HOIEdit: Human-object interaction editing with text-to-image diffusion model
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-024-03781-w.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A scene consists of objects and relationships. Despite the success in large-scale text-to-image generation and text-guided image editing, most existing studies focus on single-object synthesis and editing, while controllable relationship or interaction synthesis and editing receive less attention. In this paper, we focus on a specific type of relationship, human-object interaction (HOI), and propose the HOIEdit method to achieve consistent HOI editing. Specifically, HOIEdit method learns the interaction token embeddings with less semantic ambiguity on several exemplar images, which would provide the information about the object locations and shapes. To edit the HOI and maintain the appearance of the human and object meanwhile, the object-wise mutual-attention control mechanism is proposed to query the correlated contents of the human and object from the source image. Furthermore, we employ a segmentation model to extract precise masks of the human and object from the first-round synthetic image, which are used to replace the coarse attention masks for a second-round refinement. Experiments show that HOIEdit achieves consistent interaction editing on both real images and synthetic images. Our implementation will be available at https://github.com/Kenneth-Wong/hoiedit.
Keyword:
HOI
Diffusion
Object-wise mutual-attention
Token embeddings
Image editing
期刊
IF:
2.9
论文数:
4.7K
被引数:
6.5K
机构
引用论文
Exergaming improves self-efficacy in sustaining physical activity among sedentary university students体感游戏提高了久坐不动的大学生维持身体活动自我效能感。
OAAI
OAAI分享收藏Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
PREAI
分享收藏Childhood adversities and 5-HTTLPR polymorphism as risk factors of substance use disorders: retrospective case-control study in Murcia (Spain)童年逆境和5-HTTLPR多态性作为物质使用障碍的风险因素：在穆尔西亚（西班牙）进行的回顾性病例对照研究.png)
BMJ Open
OAAI
BMJ OpenIF0
OAAI分享收藏分享收藏Regulatory flexibilities and access to COVID-19 vaccines during the pandemic in Bhutan疫情期间不丹的监管灵活性及新冠疫苗可及性OAAI
OAAI分享收藏
查看更多内容