.png){kind=icon}
返回
Towards Efficient Coarse-grained Dialogue Response Selection
.png){kind=icon}
PRE
AI
DOI：10.1145/3597609.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Coarse-grained response selection is a fundamental and essential subsystem for the widely used retrieval-based chatbots, aiming to recall a coarse-grained candidate set from a large-scale dataset. The dense retrieval technique has recently been proven very effective in building such a subsystem. However, dialogue dense retrieval models face two problems in real scenarios: (1) the multi-turn dialogue history is re-computed in each turn, leading to inefficient inference; (2) the index storage of the offline index is enormous, significantly increasing the deployment cost. To address these problems, we propose an efficient coarse-grained response selection subsystem consisting of two novel methods. Specifically, to address the first problem, we propose the Hierarchical Dense Retrieval. It caches rich multi-vector representations of the dialogue history and only encodes the latest user's utterance, leading to better inference efficiency. Then, to address the second problem, we design the Deep Semantic Hashing to reduce the index storage while effectively saving its recall accuracy notably. Extensive experimental results prove the advantages of the two proposed methods over previous works. Specifically, with the limited performance loss, our proposed coarse-grained response selection model achieves over 5x FLOPs speedup and over 192x storage compression ratio. Moreover, our source codes have been publicly released.(1)
Keyword:
Retrieval-based dialogue system
deep semantic hashing
dense retrieval
期刊
IF:
9.1
论文数:
1.2K
被引数:
4.7K
机构
引用论文
Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy使用激光诱导击穿光谱检测土壤中Pb和Ba的基质效应
PREAI
分享收藏Deep Cross-Modal Hashing With Hashing Functions and Unified Hash Codes Jointly Learning基于哈希函数和统一哈希码联合学习的深度跨模态哈希
OAAI
OAAI分享收藏Plasma enhanced deposition of ‘silicon nitride’ for use as an encapsulant for silicon ion-implanted gallium arsenide等离子体增强沉积‘silicon nitride’用于作为硅离子注入砷化镓的封装材料.png)
Vacuum
VacuumIF0
PREAI
分享收藏PONE: A Novel Automatic Evaluation Metric for Open-domain Generative Dialogue SystemsPONE: 一种用于开放域生成对话系统的新型自动评估度量
PREAI
分享收藏
查看更多内容