.png){kind=icon}
返回
Experimentation for Chatbot Usability Evaluation: A Secondary Study
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3145323.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Interest in chatbot development is on the rise. As a usability evaluation is an essential step in chatbot development, the number of experimental studies on chatbot usability has grown as well. As a result, we think a systematic mapping study is opportune. We analyzed more than 700 sources and retrieved 28 primary studies. By aggregating the research questions and examining the characteristics and metrics used to evaluate the usability of chatbots in experiments, it is possible to identify the state of the art in chatbot usability experimentation. We conducted a systematic mapping study to identify the research questions, characteristics, and metrics used to evaluate the usability of chatbots in experiments. Most experiments adopted a within-subjects design. On the other hand, few experiments provided raw data, and only one of the identified papers was part of a family of experiments. Effectiveness, efficiency, and satisfaction are usability characteristics used to identify how well users can learn and use chatbots to achieve their goals and how satisfied users are during the interaction. Generally, the experimental results revealed that chatbots have several advantages (e.g., they provide a real-time response and they improve ease of use) and some shortcomings (e.g., natural language processing, which is rated as the weakness most in need of improvement). This research offers an overview of chatbot usability experimentation. The increasing interest in this area is very recent, as works did not start to be published until 2018. Chatbot usability experiments should be more replicable to improve the reliability and transparency of the experimental results.
Keyword:
Chatbots
Usability
Measurement
Bibliographies
Systematics
Social networking (online)
Size measurement
Usability
chatbots
experiments
family of experiments
systematic mapping study
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Current practice in measuring usability:: Challenges to usability studies and research当前测量可用性的实践: 可用性研究和研究面临的挑战
PREAI
分享收藏Addressing limitations of the Gait Variability Index to enhance its applicability: The enhanced GVI (EGVI).png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏An ultracompact 3×1 MMI power-combiner based on Si slot-waveguide structures基于Si槽波导结构的超小型化3 × 1 MMI功率合成器
PREAI
分享收藏Electricity market prices for day-ahead ancillary services and energy: Texas前一天辅助服务和能源的电力市场价格: 德克萨斯州
PREAI
分享收藏
查看更多内容