arrow
返回

Rule extraction with guarantees from regression models

delete2022-06-01
delete14
delete
OA
AI
U
Ulf Johansson *
C
Cecilia Sönströd
T
Tuve Löfström
H
Henrik Boström
DOI:10.1016/j.patcog.2022.108554delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Tools for understanding and explaining complex predictive models are critical for user acceptance and trust. One such tool is rule extraction, i.e., approximating opaque models with less powerful but interpretable models. Pedagogical (or black-box) rule extraction, where the interpretable model is induced using the original training instances, but with the predictions from the opaque model as targets, has many advantages compared to the decompositional (white-box) approach. Most importantly, pedagogical methods are agnostic to the kind of opaque model used, and any learning algorithm producing interpretable models can be employed for the learning step. The pedagogical approach has, however, one main problem, clearly limiting its utility. Specifically, while the extracted models are trained to mimic the opaque, there are absolutely no guarantees that this will transfer to novel data. This potentially low test set fidelity must be considered a severe drawback, in particular when the extracted models are used for explanation and analysis. In this paper, a novel approach, solving the problem with test set fidelity by utilizing the conformal prediction framework, is suggested for extracting interpretable regression models from opaque models. The extracted models are standard regression trees, but augmented with valid prediction intervals in the leaves. Depending on the exact setup, the use of conformal prediction guarantees that either the test set fidelity or the test set accuracy will be equal to a preset confidence level, in the long run. In the extensive empirical investigation, using 20 publicly available data sets, the validity of the extracted models is demonstrated. In addition, it is shown how normalization can be used to provide individualized prediction intervals, thus providing highly informative extracted models. (c) 2022 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
Keyword:
Rule extraction
Interpretability
Conformal prediction
Explainable AI
Predictive regression
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

J
jonkoping university
学者数:
1.2K
论文数: 1.4K
被引数: 0
R
Royal Institute of Technology
学者数:
1.8W
论文数: 1.8W
被引数: 25
引用论文

引用论文

Textural properties of the medical Algo clay as influenced by calcination
err2010-11-01
err0
PREAI
errM. Tămăşan; A. Vulpoi; E. Vanea; V. Simon
err分享
err收藏
Regression conformal prediction with random forests
err2014-07-09
err126
errOAAI
errJohansson, Ulf; Bostrom, Henrik; Lofstrom, Tuve; Linusson, Henrik
err分享
err收藏
err分享
err收藏
err分享
err收藏
A Survey of Methods for Explaining Black Box Models黑箱模型的解释方法综述
err2018-08-22
err2.5K
errOAAI
errGuidotti, Riccardo; Monreale, Anna; Ruggieri, Salvatore; Turin, Franco; Giannotti, Fosca; Pedreschi, Dino
err分享
err收藏
Aging and the Immune System
err2003-01-01
err0
PREAI
errSian M. Henson; Richard Aspinall
err分享
err收藏
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI可解释人工智能 (XAI): 负责任人工智能的概念、分类、机遇和挑战
err2020-06-01
err3.9K
errOAAI
errBarredo Arrieta, Alejandro; Diaz-Rodriguez, Natalia; Del Ser, Javier; Bennetot, Adrien; Tabik, Siham; Barbado, Alberto; Garcia, Salvador; Gil-Lopez, Sergio; Molina, Daniel; Benjamins, Richard; Chatila, Raja; Herrera, Francisco
err分享
err收藏
Electronic and chemical properties of the c-Si/Al2O3 interface
err2011-06-01
err0
PREAI
errFlorian Werner; Boris Veith; Dimitri Zielke; Lisa Kühnemund; Christoph Tegenkamp; Michael Seibt; Rolf Brendel; Jan Schmidt
err分享
err收藏
学者 查看更多内容