arrow
返回

ADCM: attention dropout convolutional module

delete2020-06-01
delete25
PRE
AI
刘
刘志刚 (Zhigang Liu) *
J
Juan Du
M
Mei Wang
S
Shuzhi Sam Ge
DOI:10.1016/j.neucom.2020.02.007delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Network architecture design plays an important role in boosting the performance of models in various applications. In this work, we design a general and lightweight module named the attention dropout convolutional module (ADCM). It consists of two submodules, channel attention dropout (CAD) and position attention dropout (PAD), and each submodule integrates both attention and dropout mechanisms. The attention mechanism emphasizes the meaningful information and suppresses unnecessary noise. The dropout-channel in the CAD submodule filters the channel based on its channel attention, while the dropout-region in the PAD submodule filters the region consisting of the spatially correlated features according to its position attention. The two dropout methods we designed allow the baseline network to learn more robust features and further boost its performance. Finally, we deploy the ADCM in consecutive layers of classical convolutional neural networks and evaluate its performance on multiple benchmark datasets. The experimental results demonstrate that the ADCM brings significant improvements to the performance of the baseline models at negligible computational cost and with less complexity. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Attention
Dropout-channel
Dropout-region
Network architecture
Convolutional module
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

N
northeast petroleum university
学者数:
5.0K
论文数: 2.7K
被引数: 3
N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Emotion-modulated attention improves expression recognition: A deep learning model
err2017-08-01
err60
errOAAI
errBarros, Pablo; Parisi, German I.; Weber, Cornelius; Wermter, Stefan
err分享
err收藏
NAIS: Neural Attentive Item Similarity Model for Recommendation
err2018-12-01
err425
errOAAI
errHe, Xiangnan; He, Zhankui; Song, Jingkuan; Liu, Zhenguang; Jiang, Yu-Gang; Chua, Tat-Seng
err分享
err收藏
没有更多内容