.png){kind=icon}
返回
Diverse Visual Question Generation Based on Multiple Objects Selection
.png){kind=icon}
PRE
AI
DOI：10.1145/3640014.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual question generation task aims at generating high-quality questions about a given image. To make this tak applicable to various scenarios, e.g., the growing demand for exams, it is important to generate diverse questions. The existing methods for this task control diverse question generation based on different question types, e.g., what and when. Although different question types lead to description diversity, they cannot guarantee semantic diversity when asking the same objects. Research in the field of psychology shows that humans pay attention to different objects in an image based on their preferences, which is beneficial to constructing semantically diverse questions. According to the research, we propose a multi-selector visual question generation (MS-VQG) model that aims to focus on different objects to generate diverse questions. Specifically, our MS-VQG model employs multiple selectors to imitate different humans to select different objects in a given image. Based on these different selected objects, our MS-VQG model can generate diverse questions corresponding to each selector. Extensive experiments on two datasets show that our proposed model outperforms the baselines in generating diverse questions.
Keyword:
Multimodal
visual question generation
mixture of experts
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
How Will We Dine? Prospective Shifts in International Haute Cuisine and Innovation beyond Kitchen and Plate.png)
Foods
OAAI
FoodsIF0
OAAI分享收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉OAAI
OAAI分享收藏分享收藏
查看更多内容