.png){kind=icon}
Return
Why Do Tree Ensemble Approximators Not Outperform the Recursive-Rule eXtraction Algorithm?
.png){kind=icon}
OA
AI
DOI：10.3390/make6010031.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Although machine learning models are widely used in critical domains, their complexity and poor interpretability remain problematic. Decision trees (DTs) and rule-based models are known for their interpretability, and numerous studies have investigated techniques for approximating tree ensembles using DTs or rule sets, even though these approximators often overlook interpretability. These methods generate three types of rule sets: DT based, unordered, and decision list based. However, very few metrics exist that can distinguish and compare these rule sets. Therefore, the present study proposes an interpretability metric to allow for comparisons of interpretability between different rule sets and investigates the interpretability of the rules generated by the tree ensemble approximators. We compare these rule sets with the Recursive-Rule eXtraction algorithm (Re-RX) with J48graft to offer insights into the interpretability gap. The results indicate that Re-RX with J48graft can handle categorical and numerical attributes separately, has simple rules, and achieves a high interpretability, even when the number of rules is large. RuleCOSI+, a state-of-the-art method, showed significantly lower results regarding interpretability, but had the smallest number of rules.
Keywords:
interpretable machine learning
explainable artificial intelligence
rule extraction
rule-based model
decision list
decision tree
tree ensemble approximator
Journal
M
IF:
6
Papers:
834
Citations:
1.8K
Organization
Cited Papers
Can Anthropometry and Body Composition Explain Physical Fitness Levels in School-Aged Children?.png)
Children
OAAI
ChildrenIF0
OAAIShareSaveRuleCOSI plus : Rule extraction for interpreting classification tree ensemblesINFORMATION FUSIONOAAI
INFORMATION FUSIONIF15.5
OAAIShareSaveMechanical Properties of Natural Rubber Nanocomposites Filled with Thermally Treated AttapulgiteOAAI
OAAIShareSaveShareSaveShareSaveShareSaveShareSaveBeyond explaining: Opportunities and challenges of XAI-based model improvementINFORMATION FUSIONOAAI
INFORMATION FUSIONIF15.5
OAAIShareSaveExplainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directionsINFORMATION FUSIONOAAI
INFORMATION FUSIONIF15.5
OAAIShareSave
View more