arrow
Return

Resolving data bias improves generalization in binding affinity prediction

delete2025-10-21
delete0
delete
OA
AI
D
David Graber
P
Peter Stockinger
F
Fabian Meyer
S
Siddhartha Mishra *
C
Claus Horn *
R
Rebecca Buller *
DOI:10.1038/s42256-025-01124-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The field of computational drug design requires accurate scoring functions to predict binding affinities for protein–ligand interactions. However, train–test data leakage between the PDBbind database and the Comparative Assessment of Scoring Function benchmark datasets has severely inflated the performance metrics of currently available deep-learning-based binding affinity prediction models, leading to overestimation of their generalization capabilities. Here we address this issue by proposing PDBbind CleanSplit, a training dataset curated by a new structure-based filtering algorithm that eliminates train–test data leakage as well as redundancies within the training set. Retraining current top-performing models on CleanSplit caused their benchmark performance to drop substantially, indicating that the performance of existing models is largely driven by data leakage. By contrast, our graph neural network model maintains high benchmark performance when trained on CleanSplit. Leveraging a sparse graph modelling of protein–ligand interactions and transfer learning from language models, our model is able to generalize to strictly independent test datasets. Graber et al. characterize biases and data leakage in protein–ligand datasets and show that a cleanly filtered training–test split leads to improved generalization in binding affinity prediction tasks.
Keywords:
binding affinity prediction
data leakage
graph neural network
protein–ligand interactions
transfer learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

D
department for bioinformatics and data science
Scholars:
1
Papers: 2
Citations: 0
D
department of mathematics and eth ai center
Scholars:
2
Papers: 1
Citations: 0
Z
Zurich University of Applied Sciences
Scholars:
2.2K
Papers: 1.6K
Citations: 2
researcher View more organizations