.png){kind=icon}
返回
State Graph Reasoning for Multimodal Conversational Recommendation
.png){kind=icon}
OA
AI
DOI：10.1109/TMM.2022.3155900.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Conversational recommendation system (CRS) attracts increasing attention in various application domains such as retail and travel. It offers an effective way to capture users' dynamic preferences with multi-turn conversations. However, most current studies center on the recommendation aspect while over-simplifying the conversation process. The negligence of complexity in data structure and conversation flow hinders their practicality and utility. In reality, there exist various relationships among slots and values, while users' requirements may dynamically adjust or change. Moreover, the conversation often involves visual modality to facilitate the conversation. These actually call for a more advanced internal state representation of the dialogue and a proper reasoning scheme to guide the decision making process. In this paper, we explore multiple facets of multimodal conversational recommendation and try to address the above mentioned challenges. In particular, we represent the structured back-end database as a multimodal knowledge graph which captures the various relations and evidence in different modalities. The user preferences expressed via conversation utterances will then be gradually updated to the state graph with clear polarity. Based on these, we train an end-to-end State Graph-based Reasoning model (SGR) to perform reasoning over the whole state graph. The prediction of our proposed model benefits from the structure of the graph. It not only allows for zero-shot reasoning for items unseen in training conversations, but also provides a natural way to explain the policies. Extensive experiments show that our model achieves better performance compared with existing methods.
Keyword:
Index Terms-Conversation
knowledge graph
recommend-ation systems
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy使用激光诱导击穿光谱检测土壤中Pb和Ba的基质效应
PREAI
分享收藏Feeding Mechanisms in Extracellular Babesia microti and Plasmodium lophurae*†细胞外 巴贝斯虫 和 疟原虫 *† 的摄食机制
PREAI
分享收藏Seed Dispersal by Cassowaries (Casuarius casuarius) in North Queensland's Rainforests.png)
Biotropica
BiotropicaIF0
PREAI
分享收藏
查看更多内容