.png){kind=icon}
返回
Mask-guided explicit feature modulation for multispectral pedestrian detection
.png){kind=icon}
PRE
AI
DOI：10.1016/j.compeleceng.2022.108385.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-task learning of object detection and box-level segmentation is commonly formulated as an implicit feature modulation method, which suffers lacking task interaction. In this paper, a novel explicit feature modulation solution with two different mask infusion methods is proposed. The first modulation method is semantic feature enhancement of backbone, which is achieved by a novel mask-guided mutual attention module (MMA). The proposed MMA module can explicitly guide the feature maps towards a more semantic informative direction for focalizing centrality of pedestrian, which can significantly improve the performance. The second modulation method is confidence score enhancement of detection head, which is benefited from our proposed mask-guided score fusion module (MSF). The proposed MSF module collects information from the classification, IOU, centerness feature map and the learned mask, which can discriminate false and true positives more effectively. It is qualitatively validated that the modulated feature maps in both backbone and detection head become more semantically meaningful and robust to scale and occlusion. Our method achieves a considerable gain over the state-of-the-arts on the KAIST, CVC14 and FLIR datasets. Besides, it runs at 22 FPS in default setting, making it favorable in many practical scenarios.
Keyword:
Multispectral pedestrian detection
Feature modulation
Mutual attention
Score fusion
期刊
C
IF:
4.9
论文数:
6.7K
被引数:
1.3W
机构
引用论文
分享收藏Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现.png)
Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏分享收藏分享收藏
查看更多内容