.png){kind=icon}
返回
MINA: Multi-Input Network Augmentation for Enhancing Tiny Deep Learning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3319313.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Network Augmentation (NetAug) is a recent method used to improve the performance of tiny neural networks on large-scale datasets. This method provides additional supervision to tiny models from larger augmented models, mitigating the issue of underfitting. However, the capacity of the augmented models is not fully utilized, resulting in underutilization of resources. In order to fully utilize the capacity of a larger augmented model without exacerbating the underfitting of a tiny model, we propose a new method called Multi-Input Network Augmentation (MINA). MINA converts tiny neural networks into a multi-input configuration, allowing only the augmented model to receive more diverse inputs during training. Additionally, tiny neural network can be converted back into their original single-input configuration after training. Our extensive experiments on large-scale datasets demonstrate that MINA is effective in improving the performance of tiny neural networks. We also demonstrate that MINA is consistently effective in downstream tasks, such as fine-grained image classification tasks and object detection tasks.
Keyword:
Network augmentation
neural architecture
tiny deep learning
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
分享收藏
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏
查看更多内容