arrow
返回

A Composable Generative Framework Based on Prompt Learning for Various Information Extraction Tasks

delete2023-08-01
delete2
PRE
AI
Z
Zhigang Kan
L
Linhui Feng
Z
Zhangyue Yin
L
Linbo Qiao
X
Xipeng Qiu *
D
Dongsheng Li *
DOI:10.1109/TBDATA.2023.3278977delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Prompt learning is an effective paradigm that bridges gaps between the pre-training tasks and the corresponding downstream applications. Approaches based on this paradigm have achieved great transcendent results in various applications. However, it still needs to be answered how to design a general-purpose framework based on the prompt learning paradigm for various information extraction tasks. In this article, we propose a novel composable prompt-based generative framework, which could be applied to a wide range of tasks in the field of information extraction. Specifically, we reformulate information extraction tasks into the form of filling slots in pre-designed type-specific prompts, which consist of one or multiple sub-prompts. A strategy of constructing composable prompts is proposed to enhance the generalization ability in data-scarce scenarios. Furthermore, to fit this framework, we transform relation extraction into the task of determining semantic consistency in prompts. The experimental results demonstrate that our approach surpasses compared baselines on real-world datasets in data-abundant and data-scarce scenarios. Further analysis of the proposed framework is presented, as well as numerical experiments conducted to investigate impact factors of performance on various tasks.
Keyword:
General-purpose generative framework
information extraction
natural language processing
prompt learning

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
887
被引数:
3.0K

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

err分享
err收藏
Amortized channel divergence for asymptotic quantum channel discrimination
err2020-06-18
err0
errOAAI
errMark M. Wilde; Mario Berta; Christoph Hirche; Eneet Kaur
err分享
err收藏
Dexamethasone intravitreal implant in diabetic macular oedema refractory to anti-vascular endothelial growth factors: the AUSSIEDEX study
err2023-08-04
err0
errOAAI
errPaul Mitchell; Jennifer Arnold; Samantha Fraser-Bell; Hyong Kwon Kang; Andrew A Chang; Jodi Tainton; Susan Simonyi
err分享
err收藏
Bile acids: analysis in biological fluids and tissues
err2010-01-01
err0
errOAAI
errWilliam J. Griffiths; Jan Sjövall
err分享
err收藏
Serum overexpression of miR-301a and miR-23a in patients with colorectal cancer
err2019-03-01
err0
errOAAI
errNasibeh Karimi; Mohammad Ali Hosseinpour Feizi; Reza Safaralizadeh; Shahryar Hashemzadeh; Behzad Baradaran; Behrooz Shokouhi; Shahram Teimourian
err分享
err收藏
Endothelin‐1 receptor blockade as new possible therapeutic approach in multiple myeloma
err2017-06-09
err0
errOAAI
errAnna Russignan; Cecilia Spina; Nicola Tamassia; Adriana Cassaro; Antonella Rigo; Anna Bagnato; Laura Rosanò; Angela Bonalumi; Michele Gottardi; Lucia Zanatta; Alice Giacomazzi; Maria Teresa Scupoli; Martina Tinelli; Ugo Salvadori; Federico Mosna; Alberto Zamò; Marco A. Cassatella; Fabrizio Vinante; Cristina Tecchio
err分享
err收藏
学者 查看更多内容