.png){kind=icon}
Return
Augmented Memory: Sample-Efficient Generative Molecular Design with Reinforcement Learning
.png){kind=icon}
OA
AI
DOI：10.1021/jacsau.4c00066.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Sample efficiency is a fundamental challenge in de novo molecular design. Ideally, molecular generative models should learn to satisfy a desired objective under minimal calls to oracles (computational property predictors). This problem becomes more apparent when using oracles that can provide increased predictive accuracy but impose significant computational cost. Consequently, designing molecules that are optimized for such oracles cannot be achieved under a practical computational budget. Molecular generative models based on simplified molecular-input line-entry system (SMILES) have shown remarkable sample efficiency when coupled with reinforcement learning, as demonstrated in the practical molecular optimization (PMO) benchmark. Here, we first show that experience replay drastically improves the performance of multiple previously proposed algorithms. Next, we propose a novel algorithm called Augmented Memory that combines data augmentation with experience replay. We show that scores obtained from oracle calls can be reused to update the model multiple times. We compare Augmented Memory to previously proposed algorithms and show significantly enhanced sample efficiency in an exploitation task, a drug discovery case study requiring both exploration and exploitation, and a materials design case study optimizing explicitly for quantum-mechanical properties. Our method achieves a new state-of-the-art in sample-efficient de novo molecular design, outperforming all of the previously reported methods. The code is available at https://github.com/schwallergroup/augmented_memory.
Keywords:
generative molecular design
sample efficiency
drug discovery
materials design
reinforcementlearning
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.7
Papers:
2.3K
Citations:
8.0K
Organization
Cited Papers
Generative deep learning enables the discovery of a potent and selective RIPK1 inhibitor.png)
NATURE COMMUNICATIONSOAAI
NATURE COMMUNICATIONSIF15.7
OAAIShareSaveShareSaveNatural deformation fabrics of plagioclase: implications for slip systems and seismic anisotropy
PREAI
ShareSaveEarlGAN: An enhanced actor-critic reinforcement learning agent-driven GAN for de novo drug design
PREAI
ShareSave
View more