arrow
Return

Learning policy scheduling for text augmentation

delete2022-01-01
delete6
PRE
AI
S
Shuokai Li
X
Xiang Ao *
F
Feiyang Pan
何清 (Qing He)
DOI:10.1016/j.neunet.2021.09.028delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
When training deep learning models, data augmentation is an important technique to improve the performance and alleviate overfitting. In natural language processing (NLP), existing augmentation methods often use fixed strategies. However, it might be preferred to use different augmentation policies in different stage of training, and different datasets may require different augmentation policies. In this paper, we take dynamic policy scheduling into consideration. We design a search space over augmentation policies by integrating several common augmentation operations. Then, we adopt a population based training method to search the best augmentation schedule. We conduct extensive experiments on five text classification and two machine translation tasks. The results show that the optimized dynamic augmentation schedules achieve significant improvements against previous methods. (C) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Data augmentation
Text classification

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704