arrow
Return

SIAM: A parameter-free, Spatial Intersection Attention Module

delete2024-09-01
delete1
PRE
AI
G
Gaoge Han
S
Shaoli Huang
F
Fang Zhao
唐
唐晶磊 (Jinglei Tang) *
DOI:10.1016/j.patcog.2024.110509delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Attention mechanisms have been shown to play a crucial role in enhancing visual perception tasks. However, in most existing approaches, channel and spatial attention maps are estimated separately without considering the varying importance of each other. This results in a coarse attention weight for objects of interest from a holistic 3-D perspective. To address this issue, we propose a novel Parameter -free Spatial Intersection Attention Module (SIAM), which estimates 3D attention maps with spatial intersection using a parameter -free way. Specifically, SIAM first generates two independent mean queries from two spatial axes and views input as keys. Then, by computing a dot product between these mean queries and keys, SIAM generates two crossdimension (channel and spatial) attention maps from two spatial directions and combines them into 3-D attention maps. By doing so, the produced attention maps reason important areas with spatial intersection, which can capture location -aware information to facilitate difficult objects' location in the images. We evaluate our method in image classification, object detection, and object segmentation tasks. Extensive experimental results consistently demonstrate our approach is superior to its counterparts.
Keywords:
3-D attention module
Parameter-free
Convolutional neural networks

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

T
Tencent
Scholars:
1.1K
Papers: 898
Citations: 5
N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
N
northwest a&f university - china
Scholars:
3.6W
Papers: 2.1W
Citations: 34
researcher View more organizations
Cited Papers

Cited Papers

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
errShare
errSave
errShare
errSave
Keep an eye on faces: Robust face detection with heatmap-Assisted spatial attention and scale-Aware layer attention
err2023-08-01
err8
errOAAI
errJu, Lei; Kittler, Josef; Rana, Muhammad Awais; Yang, Wankou; Feng, Zhenhua
errShare
errSave
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
researcher View more