.png){kind=icon}
Return
Diverse Visual Question Generation Based on Multiple Objects Selection
.png){kind=icon}
PRE
AI
DOI：10.1145/3640014.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Visual question generation task aims at generating high-quality questions about a given image. To make this tak applicable to various scenarios, e.g., the growing demand for exams, it is important to generate diverse questions. The existing methods for this task control diverse question generation based on different question types, e.g., what and when. Although different question types lead to description diversity, they cannot guarantee semantic diversity when asking the same objects. Research in the field of psychology shows that humans pay attention to different objects in an image based on their preferences, which is beneficial to constructing semantically diverse questions. According to the research, we propose a multi-selector visual question generation (MS-VQG) model that aims to focus on different objects to generate diverse questions. Specifically, our MS-VQG model employs multiple selectors to imitate different humans to select different objects in a given image. Based on these different selected objects, our MS-VQG model can generate diverse questions corresponding to each selector. Extensive experiments on two datasets show that our proposed model outperforms the baselines in generating diverse questions.
Keywords:
Multimodal
visual question generation
mixture of experts
Journal
IF:
6
Papers:
2.0K
Citations:
5.4K
Organization
Cited Papers
How Will We Dine? Prospective Shifts in International Haute Cuisine and Innovation beyond Kitchen and Plate.png)
Foods
OAAI
FoodsIF0
OAAIShareSave
ShareSaveShareSaveShareSave
View more