arrow
Return

Can human experts predict solubility better than computers?

delete2017-12-13
delete49
delete
OA
AI
S
Samuel Boobier
A
Anne Osbourn
J
John B. O. Mitchell *
DOI:10.1186/s13321-017-0250-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this study, we design and carry out a survey, asking human experts to predict the aqueous solubility of drug-like organic compounds. We investigate whether these experts, drawn largely from the pharmaceutical industry and academia, can match or exceed the predictive power of algorithms. Alongside this, we implement 10 typical machine learning algorithms on the same dataset. The best algorithm, a variety of neural network known as a multi-layer perceptron, gave an RMSE of 0.985 log S units and an R-2 of 0.706. We would not have predicted the relative success of this particular algorithm in advance. We found that the best individual human predictor generated an almost identical prediction quality with an RMSE of 0.942 log S units and an R-2 of 0.723. The collection of algorithms contained a higher proportion of reasonably good predictors, nine out of ten compared with around half of the humans. We found that, for either humans or algorithms, combining individual predictions into a consensus predictor by taking their median generated excellent predictivity. While our consensus human predictor achieved very slightly better headline figures on various statistical measures, the difference between it and the consensus machine learning predictor was both small and statistically insignificant. We conclude that human experts can predict the aqueous solubility of druglike molecules essentially equally well as machine learning algorithms. We find that, for either humans or algorithms, combining individual predictions into a consensus predictor by taking their median is a powerful way of benefitting from the wisdom of crowds.
Keywords:
INTRINSIC AQUEOUS SOLUBILITY
DRUG SOLUBILITY
MELTING-POINTS
RANDOM FOREST
MODELS
TOOL
CLASSIFICATION
REGRESSION
CHALLENGE
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Cheminformatics cover
Journal of Cheminformatics
IF:
5.7
Papers:
1.5K
Citations:
1.1W

Organization

U
university of st andrews
Scholars:
9.4K
Papers: 1.0W
Citations: 15
U
uk research & innovation (ukri)
Scholars:
2.7W
Papers: 2.3W
Citations: 32