arrow
Return

Explaining machine learning models with interactive natural language conversations using TalkToModel

delete2023-07-27
delete20
delete
OA
AI
D
Dylan Slack *
S
Satyapriya Krishna
H
Himabindu Lakkaraju
S
Sameer Singh
DOI:10.1038/s42256-023-00692-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To ensure that a machine learning model has learned the intended features, it can be useful to have an explanation of why a specific output was given. Slack et al. have created a conversational environment, based on language models and feature importance, which can interactively explore explanations with questions asked in natural language. Practitioners increasingly use machine learning (ML) models, yet models have become more complex and harder to understand. To understand complex models, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use explainability methods because they do not know which explanation to choose and how to interpret the explanation. Here we address the challenge of using explainability methods by proposing TalkToModel: an interactive dialogue system that explains ML models through natural language conversations. TalkToModel consists of three components: an adaptive dialogue engine that interprets natural language and generates meaningful responses; an execution component that constructs the explanations used in the conversation; and a conversational interface. In real-world evaluations, 73% of healthcare workers agreed they would use TalkToModel over existing systems for understanding a disease prediction model, and 85% of ML professionals agreed TalkToModel was easier to use, demonstrating that TalkToModel is highly effective for model explainability.
Keywords:
EXPLANATIONS

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
U
university of california irvine
Scholars:
2.3W
Papers: 1.7W
Citations: 55
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Efficacy and safety of danoprevir plus sofosbuvir in GT 1, 2, 3, or 6 chronic hepatitis C patients with or without cirrhosis in China
err2021-06-18
err0
errOAAI
errShufang Pan; Kai Feng; Ping Huang; Yingfu Zeng; Liu Ke; Xiaodong Yang; Jing Liu; Chaoshuang Lin
errShare
errSave
Parsimonious dictionary learning
err2009-04-01
err0
PREAI
errMehrdad Yaghoobi; Thomas Blumensath; Michael E. Davies
errShare
errSave
Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset
err2022-05-03
err86
errOAAI
errMeng, Chuizheng; Trinh, Loc; Xu, Nan; Enouen, James; Liu, Yan
errShare
errSave
researcher View more