arrow
返回

HCE: Hierarchical Context Embedding for Region-Based Object Detection

delete2021-01-01
delete24
delete
OA
AI
Z
Zhao-Min Chen
X
Xin Jin
Z
Zhao, Bo-Rui
X
Xiaoqin Zhang *
G
Guo, Yanwen
DOI:10.1109/TIP.2021.3099733delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
State-of-the-art two-stage object detectors apply a classifier to a sparse set of object proposals, relying on region-wise features extracted by RoIPool or RoIAlign as inputs. The region-wise features, in spite of aligning well with the proposal locations, may still lack the crucial context information which is necessary for filtering out noisy background detections, as well as recognizing objects possessing no distinctive appearances. To address this issue, we present a simple but effective Hierarchical Context Embedding (HCE) framework, which can be applied as a plug-and-play component, to facilitate the classification ability of a series of region-based detectors by mining contextual cues. Specifically, to advance the recognition of context-dependent object categories, we propose an image-level categorical embedding module which leverages the holistic image-level context to learn object-level concepts. Then, novel RoI features are generated by exploiting hierarchically embedded context information beneath both whole images and interested regions, which are also complementary to conventional RoI features. Moreover, to make full use of our hierarchical contextual RoI features, we propose the early-and-late fusion strategies (i.e., feature fusion and confidence fusion), which can be combined to boost the classification accuracy of region-based detectors. Comprehensive experiments demonstrate that our HCE framework is flexible and generalizable, leading to significant and consistent improvements upon various region-based detectors, including FPN, Cascade R-CNN, Mask R-CNN and PA-FPN. With simple modification, our HCE framework can be conveniently adapted to fit the structure of one-stage detectors, and achieve improved performance for SSD, RetinaNet and EfficientDet.
Keyword:
Detectors
Feature extraction
Proposals
Object detection
Head
Training
Noise measurement
Object detection
context embedding
region-based CNNs

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
W
Wenzhou University
学者数:
8.8K
论文数: 6.5K
被引数: 1.5W
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
Selective Search for Object Recognition
err2013-04-02
err3.9K
PREAI
errUijlings, J. R. R.; van de Sande, K. E. A.; Gevers, T.; Smeulders, A. W. M.
err分享
err收藏
Signal Intensities in Preoperative MRI Do Not Reflect Proliferative Activity in Meningioma
err2016-08-01
err0
errOAAI
errStefan Schob; Clara Frydrychowicz; Matthias Gawlitza; Lionel Bure; Matthias Preuß; Karl-Titus Hoffmann; Alexey Surov
err分享
err收藏
学者 查看更多内容