arrow
Return

Resolving data bias improves generalization in binding affinity prediction

delete2025-10-21
delete0
delete
OA
AI
D
David Graber
P
Peter Stockinger
F
Fabian Meyer
S
Siddhartha Mishra *
C
Claus Horn *
R
Rebecca Buller *
DOI:10.1038/s42256-025-01124-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The field of computational drug design requires accurate scoring functions to predict binding affinities for protein–ligand interactions. However, train–test data leakage between the PDBbind database and the Comparative Assessment of Scoring Function benchmark datasets has severely inflated the performance metrics of currently available deep-learning-based binding affinity prediction models, leading to overestimation of their generalization capabilities. Here we address this issue by proposing PDBbind CleanSplit, a training dataset curated by a new structure-based filtering algorithm that eliminates train–test data leakage as well as redundancies within the training set. Retraining current top-performing models on CleanSplit caused their benchmark performance to drop substantially, indicating that the performance of existing models is largely driven by data leakage. By contrast, our graph neural network model maintains high benchmark performance when trained on CleanSplit. Leveraging a sparse graph modelling of protein–ligand interactions and transfer learning from language models, our model is able to generalize to strictly independent test datasets. Graber et al. characterize biases and data leakage in protein–ligand datasets and show that a cleanly filtered training–test split leads to improved generalization in binding affinity prediction tasks.
Keywords:
binding affinity prediction
data leakage
graph neural network
protein–ligand interactions
transfer learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Machine Intelligence cover
Nature Machine Intelligence
IF:
23.9
Papers:
1.3K
Citations:
1.5W

Organization

D
department for bioinformatics and data science
Scholars:
1
Papers: 2
Citations: 0
D
department of mathematics and eth ai center
Scholars:
2
Papers: 1
Citations: 0
Z
Zurich University of Applied Sciences
Scholars:
2.2K
Papers: 1.6K
Citations: 2
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
KDEEP: Protein-Ligand Absolute Binding Affinity Prediction via 3D-Convolutional Neural Networks
err2018-01-29
err605
PREAI
errJimenez, Jose; Skalic, Miha; Martinez-Rosell, Gerard; De Fabritiis, Gianni
errShare
errSave
PDB-wide collection of binding data: current status of the PDBbind database
err2014-10-09
err0
errOAAI
errZhihai Liu; Yan Li; Li Han; Jie Li; Jie Liu; Zhixiong Zhao; Wei Nie; Yuchen Liu; Renxiao Wang
errShare
errSave
Extended connectivity interaction features: improving binding affinity prediction through chemical description
err2020-12-07
err0
PREAI
errNorberto Sánchez-Cruz; José L Medina-Franco; Jordi Mestres; Xavier Barril
errShare
errSave
A generalized protein-ligand scoring framework with balanced scoring, docking, ranking and screening powers
err2023-01-01
err18
errOAAI
errShen, Chao; Zhang, Xujun; Hsieh, Chang-Yu; Deng, Yafeng; Wang, Dong; Xu, Lei; Wu, Jian; Li, Dan; Kang, Yu; Hou, Tingjun; Pan, Peichen
errShare
errSave
OctSurf: Efficient hierarchical voxel-based molecular surface representation for protein-ligand affinity prediction
err2021-06-01
err0
PREAI
errQinqing Liu; Peng-Shuai Wang; Chunjiang Zhu; Blake Blumenfeld Gaines; Tan Zhu; Jinbo Bi; Minghu Song
errShare
errSave
Assessing protein-ligand interaction scoring functions with the CASF-2013 benchmark
err2018-03-08
err82
PREAI
errLi, Yan; Su, Minyi; Liu, Zhihai; Li, Jie; Liu, Jie; Han, Li; Wang, Renxiao
errShare
errSave
researcher View more