返回
SIAM: A parameter-free, Spatial Intersection Attention Module
DOI:10.1016/j.patcog.2024.110509.png)
摘要
En 中文
Attention mechanisms have been shown to play a crucial role in enhancing visual perception tasks. However, in most existing approaches, channel and spatial attention maps are estimated separately without considering the varying importance of each other. This results in a coarse attention weight for objects of interest from a holistic 3-D perspective. To address this issue, we propose a novel Parameter -free Spatial Intersection Attention Module (SIAM), which estimates 3D attention maps with spatial intersection using a parameter -free way. Specifically, SIAM first generates two independent mean queries from two spatial axes and views input as keys. Then, by computing a dot product between these mean queries and keys, SIAM generates two crossdimension (channel and spatial) attention maps from two spatial directions and combines them into 3-D attention maps. By doing so, the produced attention maps reason important areas with spatial intersection, which can capture location -aware information to facilitate difficult objects' location in the images. We evaluate our method in image classification, object detection, and object segmentation tasks. Extensive experimental results consistently demonstrate our approach is superior to its counterparts.
Keyword:
3-D attention module
Parameter-free
Convolutional neural networks
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍?
Keep an eye on faces: Robust face detection with heatmap-Assisted spatial attention and scale-Aware layer attention
PATTERN RECOGNITION
IF7.6
Recent Development of Dual-Dictionary Learning Approach in Medical Image Analysis and Reconstruction
Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时,热舒适性,感知的空气质量和认知表现
Indoor Air
IF0
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜

