.png){kind=icon}
返回
A feature aggregation network for multispectral pedestrian detection
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-023-04628-y.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pedestrian detection is an important task in many computer vision applications. Since multispectral pedestrian detection can alleviate the difficulties of insufficient illumination at night, it has been rapidly developed in recent years. However, the way for effective color-thermal image fusion still needs further research. In this paper, we propose a Feature Aggregation Module (FAM) that can adaptively capture the cross-channel and cross-dimension information interaction of the two modalities. In addition, we develop a Feature Aggregation Network (FANet) that embeds the proposed FAM module into a two-stream network adapted from the YOLOv5. FANet has the advantages that its size is small (15 MB) and it runs fast (8 ms per frame). Extensive experiments on the KAIST dataset show that the proposed method is effective for multispectral pedestrian detection, especially in the night-time condition, for which the Miss Rate is only 8.91%. Moreover, we show that the saliency map computed from the thermal image can be incorporated into FANet to further improve the detection accuracy. In order to verify the generalization ability of the FAM module, we have also conducted experiments on the person re-identification datasets, namely Market1501 and Duke. The performance of our FAM compares favorably against existing feature fusion mechanisms on the two datasets.
Keyword:
Multispectral pedestrian detection
Feature aggregation
Saliency map
Attention mechanism
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏Mechanical and corrosion behavior of Cu, Cr, Ni and Zn electroplating on corten A588 steel for scope for betterment in ambient construction applications在corten A588钢上电镀Cu，Cr，Ni和Zn的机械和腐蚀行为，以改善环境中的应用
OAAI
OAAI分享收藏Box-level segmentation supervised deep neural networks for accurate and real-time multispectral pedestrian detection用于精确和实时多光谱行人检测的盒级分割监督深度神经网络OAAI
OAAI分享收藏Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉，互穿网络中具有变构效应的晶态反应
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现.png)
Indoor AirOAAI
Indoor AirIF0
OAAI分享收藏
查看更多内容