arrow
Return

Explaining Deep Learning Models Through Rule-Based Approximation and Visualization

delete2021-08-01
delete19
delete
OA
AI
E
Eduardo Soares *
P
Plamen Angelov
B
Bruno Sielly Jales Costa
M
Marcos Castro
S
Subramanya Nageshrao
D
Dimitar Filev
DOI:10.1109/TFUZZ.2020.2999776delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This article describes a novel approach to the problem of developing explainable machine learning models. We consider a deep reinforcement learning (DRL) model representing a highway path planning policy for autonomous highway driving [1]. The model constitutes a mapping from the continuous multidimensional state space characterizing vehicle positions and velocities to a discrete set of actions in longitudinal and lateral direction. It is obtained by applying a customized version of the double deep Q-network learning algorithm [2]. The main idea is to approximate the DRL model with a set of IF-THEN rules that provide an alternative interpretable model, which is further enhanced by visualizing the rules. This concept is rationalized by the universal approximation properties of the rule-based models with fuzzy predicates. The proposed approach includes a learning engine composed of zero-order fuzzy rules, which generalize locally around the prototypes by using multivariate function models. The adjacent (in the data space) prototypes, which correspond to the same action, are further grouped and merged into the so-called MegaClouds reducing significantly the number of fuzzy rules. The input selection method is based on ranking the density of the individual inputs. Experimental results show that the specific DRL agent can be interpreted by approximating with families of rules of different granularity. The method is computationally efficient and can be potentially extended to addressing the explainability of the broader set of fully connected deep neural network models.
Keywords:
Autonomous driving
deep reinforcement learning
density-based input selection
explainable artificial intelligence
prototype- and density-based models
rule-based models
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Fuzzy Systems cover
IEEE Transactions on Fuzzy Systems
IF:
11.9
Papers:
4.9K
Citations:
2.9W

Organization

L
Lancaster University
Scholars:
9.5K
Papers: 1.1W
Citations: 1.7W
F
Ford Motor Company
Scholars:
1.1K
Papers: 971
Citations: 2