arrow
Return

An imprecise deep forest for classification

delete2020-03-01
delete14
PRE
AI
L
Lev V. Utkin *
DOI:10.1016/j.eswa.2019.112978delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
An imprecise deep forest classifier, which can be regarded as a modification of the deep forest proposed by Zhou and Feng, is presented in the paper. In the proposed classifier, the precise class probabilities at leaf nodes of decision trees in the deep forest are replaced with interval-valued probabilities produced by Walley's imprecise Dirichlet model. The obtained sets of probabilities are averaged over all trees in a random forest as the imprecise probability masses. In order to use the stacking algorithm in the deep forest, a number of the class probability distributions are generated from sets of the random forest class probabilities such that decision trees of the next level of the deep forest cascade are trained on the basis of the extended training set which is added by new generated class distributions. Numerical examples illustrate how the incorporated imprecision may lead to outperforming results, especially, when the training set is rather small. The proposed classifier is the first modification of the deep forest, which efficiently deals with small datasets and takes into account a lack of sufficient training data. The ideas underlying the classifier may be a basis for development of a set on new machine learning models for small datasets. (C) 2019 Elsevier Ltd. All rights reserved.
Keywords:
Classification
Random forest
Decision tree
Deep forest
Imprecise Dirichlet model
Imprecise probabilities
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

P
Peter the Great St. Petersburg Polytechnic University
Scholars:
2.7K
Papers: 1.7K
Citations: 4
Cited Papers

Cited Papers

Sonochemistry
err
IF0
err2023-08-31
err0
PREAI
errTimothy J. Mason
errShare
errSave
Report on the Third Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE3)
err2016-10-21
err0
errOAAI
errDaniel S. Katz; Sou-Cheng T. Choi; Kyle E. Niemeyer; James Hetherington; Frank Löffler; Dan Gunter; Ray Idaszak; Steven R. Brandt; Mark A. Miller; Sandra Gessing; Nick D. Jones; Nic Weber; Suresh Marru; Gabrielle Allen; Birgit Penzenstadler; Colin C. Venters; Ethan Davis; Lorraine Hwang; Ilian Todorov; Abani Patra; Miguel De Val-Borro
errShare
errSave
The strength of weak learnability
err1990-06-01
err0
errOAAI
errRobert E. Schapire
errShare
errSave
Increasing diversity in random forest learning algorithm via imprecise probabilities
err2018-05-01
err38
errOAAI
errAbellan, Joaquin; Mantas, Carlos J.; Castellano, Javier G.; Moral-Garcia, SerafIn
errShare
errSave
Bagging predictors
err1996-08-01
err1.0W
PREAI
errBreiman, L
errShare
errSave
A Siamese Deep Forest
err2018-01-01
err43
PREAI
errUtkin, Lev V.; Ryabinin, Mikhail A.
errShare
errSave
researcher View more