arrow
返回

Learning policy scheduling for text augmentation

delete2022-01-01
delete6
PRE
AI
S
Shuokai Li
X
Xiang Ao *
F
Feiyang Pan
何
何清 (Qing He)
DOI:10.1016/j.neunet.2021.09.028delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
When training deep learning models, data augmentation is an important technique to improve the performance and alleviate overfitting. In natural language processing (NLP), existing augmentation methods often use fixed strategies. However, it might be preferred to use different augmentation policies in different stage of training, and different datasets may require different augmentation policies. In this paper, we take dynamic policy scheduling into consideration. We design a search space over augmentation policies by integrating several common augmentation operations. Then, we adopt a population based training method to search the best augmentation schedule. We conduct extensive experiments on five text classification and two machine translation tasks. The results show that the optimized dynamic augmentation schedules achieve significant improvements against previous methods. (C) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Data augmentation
Text classification

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

“It's almost like they're trying to hide it”: How User-Provided Image Descriptions Have Failed to Make Twitter Accessible
err2019-05-13
err0
errOAAI
errCole Gleason; Patrick Carrington; Cameron Cassidy; Meredith Ringel Morris; Kris M. Kitani; Jeffrey P. Bigham
err分享
err收藏
Changes of the tropical glaciers throughout Peru between 2000 and 2016 – mass balance and area fluctuations
err2019-09-30
err0
errOAAI
errThorsten Seehaus; Philipp Malz; Christian Sommer; Stefan Lippl; Alejo Cochachin; Matthias Braun
err分享
err收藏
Treatment With Ganciclovir of Adenovirus Pneumonia in a Cardiac Transplant Patient
err1997-11-01
err0
PREAI
errJoan M Duggan; Janice Farrehi; Susan Duderstadt; Nancy J Turner; Robert Fekety
err分享
err收藏
没有更多内容