arrow
返回

Survey on evaluation methods for dialogue systems

delete2020-06-25
delete132
delete
OA
AI
J
Jan Deriu *
R
Rodrigo, Alvaro
O
Otegi, Arantxa
E
Echegoyen, Guillermo
S
Sophie Rosset
E
Eneko Agirre
M
Mark Cieliebak
DOI:10.1007/s10462-020-09866-xdelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In this paper, we survey the methods and concepts developed for the evaluation of dialogue systems. Evaluation, in and of itself, is a crucial part during the development process. Often, dialogue systems are evaluated by means of human evaluations and questionnaires. However, this tends to be very cost- and time-intensive. Thus, much work has been put into finding methods which allow a reduction in involvement of human labour. In this survey, we present the main concepts and methods. For this, we differentiate between the various classes of dialogue systems (task-oriented, conversational, and question-answering dialogue systems). We cover each class by introducing the main technologies developed for the dialogue systems and then present the evaluation methods regarding that class.
Keyword:
Dialogue systems
Evaluation metrics
Discourse model
Conversational AI
Chatbots
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

C
centre national de la recherche scientifique (cnrs)
学者数:
24.5W
论文数: 18.2W
被引数: 279
U
universidad nacional de educacion a distancia (uned)
学者数:
4.3K
论文数: 2.9K
被引数: 7
Z
Zurich University of Applied Sciences
学者数:
2.2K
论文数: 1.6K
被引数: 2
U
university of basque country
学者数:
1.9W
论文数: 1.6W
被引数: 17
学者 查看更多机构
引用论文

引用论文

Aging interacts with tumor biology to produce major changes in the immune tumor microenvironment
err
IF0
err2020-06-08
err0
errOAAI
errRossin Erbe; Zheyu Wang; Neeha Zaidi; Michael Topper; Stephen Baylin; Elizabeth M Jaffee; Hariharan Easwaran; Elana J Fertig
err分享
err收藏
err分享
err收藏
GPNMB mitigates Alzheimer’s disease and enhances autophagy via suppressing the mTOR signal
err2022-01-01
err0
PREAI
errZhongkang Zhu; Yuxi Liu; Xinyun Li; Lin Zhang; Huihui Liu; Yong Cui; Yanjie Wang; Danyu Zhao
err分享
err收藏
Protein interactions and consensus clustering analysis uncover insights into herpesvirus virion structure and function relationships
err2019-06-14
err0
errOAAI
errAnna Hernández Durán; Todd M. Greco; Benjamin Vollmer; Ileana M. Cristea; Kay Grünewald; Maya Topf
err分享
err收藏
学者 查看更多内容