arrow
Return

Performance and efficiency of machine learning algorithms for analyzing rectangular biomedical data

delete2021-04-01
delete35
delete
OA
AI
F
Fei Deng
J
Jibing Huang
X
Xiaoling Yuan
C
Chao Cheng
L
Lanjing Zhang *
DOI:10.1038/s41374-020-00525-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Most biomedical datasets, including those of 'omics, population studies, and surveys, are rectangular in shape and have few missing data. Recently, their sample sizes have grown significantly. Rigorous analyses on these large datasets demand considerably more efficient and more accurate algorithms. Machine learning (ML) algorithms have been used to classify outcomes in biomedical datasets, including random forests (RF), decision tree (DT), artificial neural networks (ANN), and support vector machine (SVM). However, their performance and efficiency in classifying multi-category outcomes of rectangular data are poorly understood. Therefore, we compared these metrics among the 4 ML algorithms. As an example, we created a large rectangular dataset using the female breast cancers in the surveillance, epidemiology, and end results-18 database, which were diagnosed in 2004 and followed up until December 2016. The outcome was the five-category cause of death, namely alive, non-breast cancer, breast cancer, cardiovascular disease, and other cause. We analyzed the 54 dichotomized features from similar to 45,000 patients using MatLab (version 2018a) and the tenfold cross-validation approach. The accuracy in classifying five-category cause of death with DT, RF, ANN, and SVM was 69.21%, 70.23%, 70.16%, and 69.06%, respectively, which was higher than the accuracy of 68.12% with multinomial logistic regression. Based on the features' information entropy, we optimized dimension reduction (i.e., reduce the number of features in models). We found 32 or more features were required to maintain similar accuracy, while the running time decreased from 55.57 s for 54 features to 25.99 s for 32 features in RF, from 12.92 s to 10.48 s in ANN, and from 175.50 s to 67.81 s in SVM. In summary, we here show that RF, DT, ANN, and SVM had similar accuracy for classifying multi-category outcomes in this large rectangular dataset. Dimension reduction based on information gain will increase the model's efficiency while maintaining classification accuracy.
Keywords:
BREAST-CANCER
DECISION TREE
COLORECTAL-CANCER
TUMOR DEPOSIT
RANDOM FOREST
DIAGNOSIS
SURVIVAL
DEATH
TERM
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Laboratory Investigation cover
Laboratory Investigation
IF:
4.2
Papers:
5.4K
Citations:
1.1W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
S
shanghai institute of technology
Scholars:
5.8K
Papers: 3.7K
Citations: 1
R
rutgers university system
Scholars:
4.1W
Papers: 3.7W
Citations: 53
B
Baylor College of Medicine
Scholars:
4.1W
Papers: 3.0W
Citations: 4.2W
researcher View more organizations