arrow
Return

Adjusted weight voting algorithm for random forests in handling missing values

delete2017-09-01
delete80
PRE
AI
J
Jing Xia
S
Shengyu Zhang
G
Guolong Cai
L
Li Li
Q
Qing Pan
J
Jing Yan *
G
Gangmin Ning *
DOI:10.1016/j.patcog.2017.04.005delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Random forests (RF) is known as an efficient algorithm in classification, however it depends on the integrity of datasets. Conventional methods in dealing with missing values usually employ estimation and imputation approaches whose efficiency is tied to the assumptions of data features. Recently, algorithm of surrogate decisions in RF was developed and this paper proposes a random forests algorithm with modified surrogate splits (Adjusted Weight Voting Random Forest, AWVRF) which is able to address the incomplete data without imputation. Differing from the present surrogate method, in AWVRF algorithm, when the primary splitting attribute and the surrogate attributes of an internal node are all missing, the undergoing instance is allowed to exit at the current node with a vote. Then the weight of the vote is adjusted by the strength of the involved attributes and the final decision is made by weighted voting. AWVRF does not comprise imputation step, thus it is independent of data features. AWVRF is compared with the methods of mean imputation, LeoFill, knnimpute, BPCAfill and conventional RF with surrogate decisions (surrRF) using 50 times repeated 5-fold cross validation on 10 acknowledged datasets. In a total of 22 experiment settings, the method of AWVRF harvests the highest accuracy in 14 settings and the largest AUC in 7 settings, exhibiting its superiority over other methods. Compared with surrRF, AWVRF is significantly more efficient and remain good discrimination of prediction. Experimental results show that the present AWVRF algorithm can successfully handle the classification task for incomplete data. (C) 2017 Elsevier Ltd. All rights reserved.
Keywords:
Random forests
Missing values
Imputation approaches
Surrogate decisions
Weighted voting
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Z
zhejiang university of technology
Scholars:
3.3W
Papers: 2.0W
Citations: 22
Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Do wildlife crimes against less charismatic species go unnoticed? A case study of Golden Jackal Canis aureus Linnaeus, 1758 poaching and trade in India
err2020-03-26
err0
errOAAI
errMalaika Mathew Chawla; Arjun Srivathsa; Priya Singh; Iravatee Majgaonkar; Sushma Sharma; Girish Punjabi; Aditya Banerjee
errShare
errSave
Learn++.MF: A random subspace approach for the missing feature problem
err2010-11-01
err64
PREAI
errPolikar, Robi; DePasquale, Joseph; Mohammed, Hussein Syed; Brown, Gavin; Kuncheva, Ludmilla I.
errShare
errSave
Selection-fusion approach for classification of datasets with missing values
err2010-06-01
err31
errOAAI
errGhannad-Rezaie, Mostafa; Soltanian-Zadeh, Hamid; Ying, Hao; Dong, Ming
errShare
errSave
Machine learning in bioinformatics
err2006-03-01
err613
errOAAI
errLarranaga, Pedro; Calvo, Borja; Santana, Roberto; Bielza, Concha; Galdiano, Josu; Inza, Inaki; Lozano, Jose A.; Armananzas, Ruben; Santafe, Guzman; Perez, Aritz; Robles, Victor
errShare
errSave
A classifier ensemble approach for the missing feature problem
err2012-05-01
err43
PREAI
errNanni, Loris; Lumini, Alessandra; Brahnam, Sheryl
errShare
errSave
A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures
err2012-07-11
err154
errOAAI
errKarahalios, Amalia; Baglietto, Laura; Carlin, John B.; English, Dallas R.; Simpson, Julie A.
errShare
errSave
researcher View more