.png){kind=icon}
返回
Progressive Learning With Recurrent Neural Network for Sequence Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/TCSII.2023.3346046.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Progressive learning is a deep learning framework in which tasks are learned sequentially, with the capacity to leverage past knowledge from previously acquired tasks to aid in the learning and execution of new ones. It is a critical component for dealing with dynamic data, as the model is trained for a few labels and then re-used to categorize additional labels when fresh data becomes available over time. The model size is scaled for new learning while the model parameters used for previous learnings are preserved. The relevance of progressive learning is well accepted in convolutional and fully connected vanilla neural networks; however, it is primarily under-documented in a recurrent neural network for sequence classification problems. Furthermore, there is no defined strategy in the literature for tuning the recurrent layers to learn increasing tasks. We present a method for using a recurrent neural network for progressive learning. We utilize Ray Tune, a well-known hyper-parameter optimization toolbox, to standardize the methods of concurrent hyper-parameter tuning for the model that adapts with each progressive task. We demonstrate our method using two image datasets, MNIST and Devanagari.
Keyword:
Recurrent neural network
progressive learning
hyper-parameters
Ray Tune
MNIST
Devanagari
期刊
I
IF:
4.9
论文数:
8.8K
被引数:
2.5W
机构
暂无机构信息
引用论文
Oceanic Drivers and Empirical Prediction of Interannual Rainfall Variability in Late Summer Over Northeast China海洋驱动因素与东北亚地区晚夏年际降水变异的经验预测.png)
OAAI
IF0
OAAI分享收藏Exfoliation Corrosion of As-Extruded Mg–1Li–1Ca: the Influence of the Superficial Layer挤压态Mg–1Li–1Ca的剥落腐蚀：表层的影响
PREAI
分享收藏
分享收藏In situ forming and self-crosslinkable protein hydrogels for localized cancer therapy and topical wound healing原位形成和自交联蛋白水凝胶用于局部癌症治疗和局部伤口愈合
PREAI
分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏分享收藏
查看更多内容