arrow
返回

Comprehensive Study on Zero-Shot Text Classification Using Category Mapping

delete2025-01-01
delete0
delete
OA
AI
K
Kai Zhang *
Q
Qiuxia Zhang
C
Chung-Che Wang
J
Jyh‐Shing Roger Jang
DOI:10.1109/ACCESS.2025.3538103delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing zero-shot text classification methods based on large pre-trained models with added prompts exhibit strong representational capacity and scalability but have relatively poor commercial applicability. Approaches that fine-tune smaller models using label mappings and existing datasets for zero-shot classification are simpler but suffer from weaker generalization capabilities. This paper employs three strategies to improve the accuracy and generalization of pre-trained models in zero-shot text classification tasks: 1) Utilizing a pre-trained model that transforms inputs into a standardized multiple-choice format. 2) Constructing a text classification training set using Wikipedia text data to fine-tune the pre-trained model; 3) Proposing a zero-shot category mapping method based on GloVe text similarity, using Wikipedia categories as substitutes for text labels. Without fine-tuning on the target labels, this method achieves performance comparable to the best models fine-tuned with target labels.
Keyword:
Vectors
Context modeling
Text categorization
Training
Encoding
Bidirectional control
Computational modeling
Data models
Predictive models
Decoding
Natural language processing
pre-trained language model
zero-shot text classification
classification
GloVe

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
National Taiwan University
学者数:
4.7W
论文数: 4.2W
被引数: 3.6W
引用论文

引用论文

err分享
err收藏
YAC transgene-mediated olfactory receptor gene choiceYAC转基因介导的嗅觉受体基因选择
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
err分享
err收藏
Understanding the Milieu Experiences of Patients on an Acute Inpatient Psychiatric Unit
err2010-08-01
err0
PREAI
errCatherine A. Thibeault; Kenneth Trudeau; Marguerite d’Entremont; Teresa Brown
err分享
err收藏
Interleukin-6 and cachexia inApcMin/+miceApcMin/ 小鼠的Interleukin-6和恶病质
err2008-02-01
err0
PREAI
errKristen A. Baltgalvis; Franklin G. Berger; Maria Marjorette O. Pena; J. Mark Davis; Stephanie J. Muga; James A. Carson
err分享
err收藏
Mechanisms and potential immune tradeoffs of accelerated coral growth induced by microfragmentation
err2022-03-29
err0
errOAAI
errLouis Schlecker; Christopher Page; Mikhail Matz; Rachel M. Wright
err分享
err收藏
Handedness and Mortality: A Follow-Up Study of Danish Twins Born between 1900 and 1910
err2000-09-01
err0
errOAAI
errOlga Basso; Jørn Olsen; Niels V. Holm; Axel Skytthe; James W. Vaupel; Kaare Christensen
err分享
err收藏
学者 查看更多内容