.png){kind=icon}
返回
Improving text classification via a soft dynamical label strategy
.png){kind=icon}
PRE
AI
DOI：10.1007/s13042-022-01770-w.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Labels play a central role in the text classification tasks. However, most studies has a lossy label encoding problem, in which the label will be represented by a meaningless and independent one-hot vector. This paper proposes a novel strategy to dynamically generate a soft pseudo label based on the prediction for each training. This history-based soft pseudo label will be taken as the target to optimize parameters by minimizing the distance between the target and the prediction. In addition, we augment the training data with Mix-up, a widely used method, to prevent overfitting on the small dataset. Extensive experimental results demonstrate that the proposed dynamical soft label strategy significantly improves the performance of several widely used deep learning classification models on binary and multi-class text classification tasks. Not only is our simple and efficient strategy much easier to implement and train, it is also exhibits substantial improvements (up to 2.54% relative improvement on FDCNews datasets with an LSTM encoder) over Label Confusion Learning (LCM)-a state-of-the-art label smoothing model-under the same experimental setting. The experimental result also demonstrate that Mix-up improves our method's performance on smaller datasets, but introduce excess noise in larger datasets, which diminishes the model's performance.
Keyword:
Label distribution learning
Text classification
Mix-up
期刊
IF:
2.7
论文数:
3.2K
被引数:
5.6K
机构
引用论文
.png){kind=icon}
Structural health monitoring of a historic masonry bell tower by radar interferometric measurements
PREAI
分享收藏Higher activity of PSI compared to PSII accounts for the beneficial effect of silicon on barley (Hordeum vulgare L.) plants challenged with salinity与PSII相比，PSI的活性更高，这说明硅对受到盐度挑战的大麦 (Hordeum vulgare L.) 植物的有益作用
OAAI
OAAI分享收藏分享收藏Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂
PREAI
分享收藏
分享收藏
查看更多内容