arrow
返回

SIAM: A parameter-free, Spatial Intersection Attention Module

delete2024-09-01
delete1
PRE
AI
G
Gaoge Han
S
Shaoli Huang
F
Fang Zhao
唐
唐晶磊 (Jinglei Tang) *
DOI:10.1016/j.patcog.2024.110509delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Attention mechanisms have been shown to play a crucial role in enhancing visual perception tasks. However, in most existing approaches, channel and spatial attention maps are estimated separately without considering the varying importance of each other. This results in a coarse attention weight for objects of interest from a holistic 3-D perspective. To address this issue, we propose a novel Parameter -free Spatial Intersection Attention Module (SIAM), which estimates 3D attention maps with spatial intersection using a parameter -free way. Specifically, SIAM first generates two independent mean queries from two spatial axes and views input as keys. Then, by computing a dot product between these mean queries and keys, SIAM generates two crossdimension (channel and spatial) attention maps from two spatial directions and combines them into 3-D attention maps. By doing so, the produced attention maps reason important areas with spatial intersection, which can capture location -aware information to facilitate difficult objects' location in the images. We evaluate our method in image classification, object detection, and object segmentation tasks. Extensive experimental results consistently demonstrate our approach is superior to its counterparts.
Keyword:
3-D attention module
Parameter-free
Convolutional neural networks

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

T
Tencent
学者数:
1.1K
论文数: 898
被引数: 5
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
N
northwest a&f university - china
学者数:
3.6W
论文数: 2.1W
被引数: 34
学者 查看更多机构
引用论文

引用论文

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Keep an eye on faces: Robust face detection with heatmap-Assisted spatial attention and scale-Aware layer attention
err2023-08-01
err8
errOAAI
errJu, Lei; Kittler, Josef; Rana, Muhammad Awais; Yang, Wankou; Feng, Zhenhua
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容