arrow
返回

Cognition-enhanced instruction framework: Accelerating structured battery knowledge extraction with low-parameter models

delete2025-07-30
delete0
PRE
AI
郑
郑岳久 (Yuejiu Zheng)
S
Suran Li
Z
Zhiyong Liu
Y
Yiduo Wang
D
Dongxu Guo *
Y
Yu Wang
X
Xuebing Han
M
Minggao Ouyang
DOI:10.1016/j.jechem.2025.07.056delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
锂电池文献的爆炸式增长导致了严重的知识过载,挑战了研究人员高效提取结构化信息的能力。尽管大型语言模型(LLMs)在自动化该任务方面具有巨大潜力,但其在科学领域的实际应用仍受限于高昂的应用程序编程接口(API)成本和微调所需的计算资源。为解决这些限制,提出了一种认知增强指令框架(CEIF),其中高性能教师模型(如DeepSeek-R1)通过提供动态反馈、提示优化和训练数据优化来指导低参数模型的学习过程。实验结果表明,通过CEIF优化的低参数模型(6B–9B)在锂电池文献提取任务中达到约85%的准确率,其性能接近GPT-4,而仅需单块NVIDIA RTX 3090 GPU。此外,观察到在专业化学习过程中出现“顿悟时刻”(Aha moment),表现为性能快速提升,为领域特定模型的设计与优化提供了新颖的理论见解。
Keyword:
lithium-ion batteries
large language models
knowledge extraction
instruction tuning
low-parameter models
cognitive enhancement

期刊

Journal of Energy Chemistry 封面图
Journal of Energy Chemistry
IF:
14.9
论文数:
6.4K
被引数:
4.5W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
U
university of shanghai for science and technology
学者数:
6.0K
论文数: 2.3K
被引数: 4
引用论文

引用论文

Extracting structured data from organic synthesis procedures using a fine-tuned large language model
err2024-01-01
err3
errOAAI
errAi, Qianxiang; Meng, Fanwang; Shi, Jiale; Pelkie, Brenden; Coley, Connor W.
err分享
err收藏
From text to insight: large language models for chemical data extraction
err2025-01-01
err0
errOAAI
errMara Schilling-Wilhelmi; Martiño Ríos-García; Sherjeel Shabih; María Victoria Gil; Santiago Miret; Christoph T. Koch; José A. Márquez; Kevin Maik Jablonka
err分享
err收藏
TextLens: large language models-powered visual analytics enhancing text clustering
err2025-06-01
err0
PREAI
errPeng,Ruixiao; Dong,Yu; Li,Guan; Tian,Dong; Shan,Guihua
err分享
err收藏
Extracting structured information from unstructured histopathology reports using generative pre-trained transformer 4 (GPT-4)使用生成式预训练transformer 4 (GPT-4) 从非结构化组织病理学报告中提取结构化信息
err2023-12-14
err15
errOAAI
errTruhn, Daniel; Loeffler, Chiara M. L.; Mueller-Franzes, Gustav; Nebelung, Sven; Hewitt, Katherine J.; Brandner, Sebastian; Bressem, Keno K.; Foersch, Sebastian; Kather, Jakob Nikolas
err分享
err收藏
err分享
err收藏
Structured information extraction from scientific text with large language models基于大语言模型的科学文本结构化信息提取
err2024-02-15
err53
errOAAI
errDagdelen, John; Dunn, Alexander; Lee, Sanghoon; Walker, Nicholas; Rosen, Andrew S.; Ceder, Gerbrand; Persson, Kristin A.; Jain, Anubhav
err分享
err收藏
学者 查看更多内容