arrow
Return

ChatMolData: A Multimodal Agent for Automatic Molecular Data Processing

delete2025-05-29
delete0
delete
OA
AI
Y
Yi Yu
H
Huien Wang
L
Libin Zong
陈博 cover
陈博 (Bo Chen)
Y
Yaqin Li *
X
Xiaohui Yu *
DOI:10.1002/aisy.202401089delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent years, the development of large language models (LLMs) has revolutionized various fields of natural science. However, their application in dealing with various molecular data remains constrained due to the reliance on single-modality inputs and outputs. ChatMolData, a novel LLM-based multimodal agent designed to handle diverse molecular data forms, including molecular databases, images, structure-specific files, and unstructured and structured documents, is introduced. ChatMolData integrates the capabilities of LLMs (e.g., GPT-4 and GPT-3.5) with the robust toolset that supports data retrieval, structuring, prediction, visualization, and search tasks. The agent employs a systematic cycle of reasoning and action to efficiently process complex tasks in molecular science. The evaluation demonstrates that ChatMolData achieves over 90% accuracy for 128 diverse tasks, effectively bridging the gap between experimenters and computational tools. Moreover, it is anticipated that the multimodal-agent strategy provides a pathway to expand data size and improve data accessibility, ultimately promoting molecular research and innovation.
Keywords:
cheminformatics
data mining
large language models
multimodal agents

Journal

Advanced Intelligent Systems cover
Advanced Intelligent Systems
IF:
6.1
Papers:
2.0K
Citations:
8.4K

Organization

T
The Hong Kong Polytechnic University
Scholars:
5.1K
Papers: 3.0K
Citations: 17
researcher View more organizations
Cited Papers

Cited Papers

DECIMER: towards deep learning for chemical image recognition
err2020-10-27
err63
errOAAI
errRajan, Kohulan; Zielesny, Achim; Steinbeck, Christoph
errShare
errSave
Mining Toxicity Information from Large Amounts of Toxicity Data
err2021-05-07
err64
PREAI
errWu, Zhenxing; Jiang, Dejun; Wang, Jike; Hsieh, Chang-Yu; Cao, Dongsheng; Hou, Tingjun
errShare
errSave
Large language models for reticular chemistry
err2025-02-01
err7
PREAI
errRampal, Nakul; Inizan, Theo Jaffrelot; Borgs, Christian; Chayes, Jennifer T.
errShare
errSave
MoleculeNet: a benchmark for molecular machine learning
err2018-01-01
err1.6K
errOAAI
errWu, Zhenqin; Ramsundar, Bharath; Feinberg, Evan N.; Gomes, Joseph; Geniesse, Caleb; Pappu, Aneesh S.; Leswing, Karl; Pande, Vijay
errShare
errSave
Learning continuous and data-driven molecular descriptors by translating equivalent chemical representations
err2019-01-01
err329
errOAAI
errWinter, Robin; Montanari, Floriane; Noe, Frank; Clevert, Djork-Arne
errShare
errSave
Graph neural networks for materials science and chemistry
err2022-11-26
err218
errOAAI
errReiser, Patrick; Neubert, Marlen; Eberhard, Andre; Torresi, Luca; Zhou, Chen; Shao, Chen; Metni, Houssam; van Hoesel, Clint; Schopmans, Henrik; Sommer, Timo; Friederich, Pascal
errShare
errSave
Augmenting large language models with chemistry tools
err2024-05-08
err44
errOAAI
errBran, Andres M.; Cox, Sam; Schilter, Oliver; Baldassari, Carlo; White, Andrew D.; Schwaller, Philippe
errShare
errSave
researcher View more