.png){kind=icon}
返回
Augmented Memory: Sample-Efficient Generative Molecular Design with Reinforcement Learning
.png){kind=icon}
OA
AI
DOI：10.1021/jacsau.4c00066.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Sample efficiency is a fundamental challenge in de novo molecular design. Ideally, molecular generative models should learn to satisfy a desired objective under minimal calls to oracles (computational property predictors). This problem becomes more apparent when using oracles that can provide increased predictive accuracy but impose significant computational cost. Consequently, designing molecules that are optimized for such oracles cannot be achieved under a practical computational budget. Molecular generative models based on simplified molecular-input line-entry system (SMILES) have shown remarkable sample efficiency when coupled with reinforcement learning, as demonstrated in the practical molecular optimization (PMO) benchmark. Here, we first show that experience replay drastically improves the performance of multiple previously proposed algorithms. Next, we propose a novel algorithm called Augmented Memory that combines data augmentation with experience replay. We show that scores obtained from oracle calls can be reused to update the model multiple times. We compare Augmented Memory to previously proposed algorithms and show significantly enhanced sample efficiency in an exploitation task, a drug discovery case study requiring both exploration and exploitation, and a materials design case study optimizing explicitly for quantum-mechanical properties. Our method achieves a new state-of-the-art in sample-efficient de novo molecular design, outperforming all of the previously reported methods. The code is available at https://github.com/schwallergroup/augmented_memory.
Keyword:
generative molecular design
sample efficiency
drug discovery
materials design
reinforcementlearning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.7
论文数:
2.3K
被引数:
8.0K
机构
引用论文
分享收藏Generative deep learning enables the discovery of a potent and selective RIPK1 inhibitor生成式深度学习可以发现一种有效的选择性RIPK1抑制剂.png)
NATURE COMMUNICATIONSOAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏Natural deformation fabrics of plagioclase: implications for slip systems and seismic anisotropy斜长石的自然变形织物: 对滑移系统和地震各向异性的影响
PREAI
分享收藏EarlGAN: An enhanced actor-critic reinforcement learning agent-driven GAN for de novo drug designEarlGAN: 一种用于从头药物设计的增强型演员-批评家强化学习代理驱动的GAN
PREAI
分享收藏
查看更多内容