1
Return

Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets

delete2020-12-14
delete85
PRE
AI
W
Wu, Zhenxing
朱闽峰 (Minfeng Zhu)
Y
Yu Kang
E
Elaine Lai‐Han Leung
T
Tailong Lei
C
Chao Shen
蒋德军 cover
蒋德军 (Dejun Jiang)
Z
Zhe Wang
曹东升 cover
曹东升 (Dongsheng Cao) *
侯廷军 (Tingjun Hou) *
DOI:10.1093/bib/bbaa321delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although a wide variety of machine learning (ML) algorithms have been utilized to learn quantitative structure-activity relationships (QSARs), there is no agreed single best algorithm for QSAR learning. Therefore, a comprehensive understanding of the performance characteristics of popular ML algorithms used in QSAR learning is highly desirable. In this study, five linear algorithms [linear function Gaussian process regression (linear-GPR), linear function support vector machine (linear-SVM), partial least squares regression (PLSR), multiple linear regression (MLR) and principal component regression (PCR)], three analogizers [radial basis function support vector machine (rbf-SVM), K-nearest neighbor (KNN) and radial basis function Gaussian process regression (rbf-GPR)], six symbolists [extreme gradient boosting (XGBoost), Cubist, random forest (RF), multiple adaptive regression splines (MARS), gradient boosting machine (GBM), and classification and regression tree (CART)] and two connectionists [principal component analysis artificial neural network (pca-ANN) and deep neural network (DNN)] were employed to learn the regression-based QSAR models for 14 public data sets comprising nine physicochemical properties and five toxicity endpoints. The results show that rbf-SVM, rbf-GPR, XGBoost and DNN generally illustrate better performances than the other algorithms. The overall performances of different algorithms can be ranked from the best to the worst as follows: rbf-SVM>XGBoost > rbf-GPR>Cubist > GBM>DNN>RF>pca-ANN>MARS > linear-GPR approximate to KNN>linear-SVM approximate to PLSR > CART approximate to PCR approximate to MLR. In terms of prediction accuracy and computational efficiency, SVM and XGBoost are recommended to the regression learning for small data sets, and XGBoost is an excellent choice for large data sets. We then investigated the performances of the ensemble models by integrating the predictions of multiple ML algorithms. The results illustrate that the ensembles of two or three algorithms in different categories can indeed improve the predictions of the best individual ML algorithms. [GRAPHICS]
Keywords:
QSAR
machine learning
XGBoost
support vector machine
ensemble learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Briefings in Bioinformatics cover
Briefings in Bioinformatics
IF:
7.7
Papers:
5.6K
Citations:
2.7W

Organization

C
Central South University
Scholars:
10.0W
Papers: 7.2W
Citations: 10.9W
Z
zhejiang university
Scholars:
17.0W
Papers: 11.9W
Citations: 152
Cited Papers

Cited Papers

Citing Papers

Citing Papers