arrow
Return

Classification Trees for Imbalanced Data: Surface-to-Volume Regularization

delete2022-01-05
delete0
PRE
AI
Y
Yichen Zhu
C
Cheng Li
D
David B. Dunson *
DOI:10.1080/01621459.2021.2005609delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Classification algorithms face difficulties when one or more classes have limited training data. We are particularly interested in classification trees, due to their interpretability and flexibility. When data are limited in one or more of the classes, the estimated decision boundaries are often irregularly shaped due to the limited sample size, leading to poor generalization error. We propose a novel approach that penalizes the Surface-to-Volume Ratio (SVR) of the decision set, obtaining a new class of SVR-Tree algorithms. We develop a simple and computationally efficient implementation while proving estimation consistency for SVR-Tree and rate of convergence for an idealized empirical risk minimizer of SVR-Tree. SVR-Tree is compared with multiple algorithms that are designed to deal with imbalance through real data applications. Supplementary materials for this article are available online.
Keywords:
CART
Categorical data
Decision boundary
Shape penalization

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.2K
Citations:
4.8W

Organization

D
Duke University
Scholars:
6.3W
Papers: 5.7W
Citations: 6.5W
N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
Cited Papers

Cited Papers

Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
errShare
errSave
Atypical 22q11.2 deletion in a patient with DGS/VCFS spectrum
err2008-05-01
err0
errOAAI
errSintia Iole Nogueira; April M. Hacker; Fernanda T.S. Bellucco; Denise M. Christofolini; Leslie Domenici Kulikowski; Mirlene C.S.P. Cernach; Beverly S. Emanuel; Maria Isabel Melaragno
errShare
errSave
Allergens as trigger factors for allergic respiratory diseases and severe asthma during thunderstorms in pollen season
err2019-01-22
err0
PREAI
errGennaro D’Amato; Emma Tedeschini; Giuseppe Frenguelli; Maria D’Amato
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
An insight into imbalanced Big Data classification: outcomes and challenges
err2017-03-01
err168
errOAAI
errFernandez, Alberto; del Rio, Sara; Chawla, Nitesh V.; Herrera, Francisco
errShare
errSave
CONSISTENCY OF RANDOM FORESTS
err2015-08-01
err378
errOAAI
errScornet, Erwan; Biau, Gerard; Vert, Jean-Philippe
errShare
errSave
researcher View more