arrow
返回

Exploring Dense Retrieval for Dialogue Response Selection

delete2024-01-22
delete0
delete
OA
AI
T
Tian Lan
D
Deng Cai *
Y
Yan Wang
Y
Yixuan Su
黄河燕 封面图
黄河燕 (Heyan Huang)
X
Xian-Ling Mao *
DOI:10.1145/3632750delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent progress in deep learning has continuously improved the accuracy of dialogue response selection. However, in real-world scenarios, the high computation cost forces existing dialogue response selection models to rank only a small number of candidates, recalled by a coarse-grained model, precluding many high-quality candidates. To overcome this problem, we present a novel and efficient response selection model and a set of tailor-designed learning strategies to train it effectively. The proposed model consists of a dense retrieval module and an interaction layer, which could directly select the proper response from a large corpus. We conduct re-rank and full-rank evaluations on widely used benchmarks to evaluate our proposed model. Extensive experimental results demonstrate that our proposed model notably outperforms the state-of-the-art baselines on both re-rank and full-rank evaluations. Moreover, human evaluation results show that the response quality could be improved further by enlarging the candidate pool with nonparallel corpora. In addition, we also release high-quality benchmarks that are carefully annotated for more accurate dialogue response selection evaluation. All source codes, datasets, model parameters, and other related resources have been publicly available.
Keyword:
Retrieval-based dialogue system
deep semantic hashing
dense retrieval
dialogue evaluation

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

U
University of Hong Kong
学者数:
4.1W
论文数: 3.9W
被引数: 10.1W
B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
学者 查看更多机构
引用论文

引用论文

A novel endoesophageal magnetic device to prevent gastroesophageal reflux
err2008-12-31
err0
PREAI
errMauro Bortolotti; Annamaria Grandis; Giosuè Mazzero
err分享
err收藏
err分享
err收藏
Using Disorder to Identify Bogoliubov Fermi-Surface States
err2021-12-17
err0
errOAAI
errHanbit Oh; Daniel F. Agterberg; Eun-Gook Moon
err分享
err收藏
OGTT results in obese adolescents with normal HOMA-IR values
err2013-01-01
err0
PREAI
errNursel Muratoglu Sahin; Sibel Tulgar Kinik; Mustafa Agah Tekindal
err分享
err收藏
学者 查看更多内容