arrow
返回

Multi-scale semantic enhancement network for object detection

delete2023-05-03
delete3
delete
OA
AI
D
Dongen Guo *
Z
Zechen Wu
J
Jiangfan Feng
T
Tao Zou
DOI:10.1038/s41598-023-34277-7delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In the field of object detection, feature pyramid network (FPN) can effectively extract multi-scale information. However, the majority of FPN-based methods suffer from a semantic gap between features of various sizes before feature fusion, which can lead to feature maps with significant aliasing. In this paper, we present a novel multi-scale semantic enhancement feature pyramid network (MSE-FPN) which consists of three effective modules: semantic enhancement module, semantic injection module, and gated channel guidance module to alleviate these problems. Specifically, inspired by the strong ability of the self-attention mechanism to model context, we propose a semantic enhancement module to model global context to obtain the global semantic information before feature fusion. Then we propose the semantic injection module to divide and merge global semantic information into feature maps at various scales to narrow the semantic gap between features at different scales and efficiently utilize the semantic information of high-level features. Finally, to mitigate feature aliasing caused by feature fusion, the gated channel guidance module selectively outputs crucial features via a gating unit. By replacing FPN with MSE-FPN in Faster R-CNN, our models achieve 39.4 and 41.2 Average precision (AP) using ResNet50 and ResNet101 as the backbone network respectively. When using ResNet-101-64x4d as the backbone, MSE-FPN achieved up to 43.4 AP. Our results demonstrate that replacing FPN with MSE-FPN significantly enhances the detection performance of state-of-the-art FPN-based detectors.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Scientific Reports 封面图
Scientific Reports
IF:
3.9
论文数:
27.9W
被引数:
83.5W

机构

N
Nanyang Institute of Technology
学者数:
842
论文数: 573
被引数: 3
C
chongqing university of posts & telecommunications
学者数:
6.7K
论文数: 5.3K
被引数: 5
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
err分享
err收藏
Multi-modal sequence model with gated fully convolutional blocks for micro-video venue classification
err2019-12-17
err15
PREAI
errLiu, Wei; Huang, Xianglin; Cao, Gang; Zhang, Jianglong; Song, Gege; Yang, Lifang
err分享
err收藏
Clustering Image Search Results by Entity Disambiguation
err2014-01-01
err0
errOAAI
errKaiqi Zhao; Zhiyuan Cai; Qingyu Sui; Enxun Wei; Kenny Q. Zhu
err分享
err收藏
学者 查看更多内容