arrow
Return

CODet: Component Object Detector Extracting Structural Features Based on Target Characteristics

delete2023-01-01
delete4
PRE
AI
Z
Zhu, Zicong
X
Xian Sun *
W
Wenhui Diao
K
Kaiqiang Chen
Q
Qibin He
G
Guangluan Xu
K
Kun Fu
DOI:10.1109/TGRS.2023.3281331delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning technology has promoted the object detection task in the remote sensing (RS) field to move toward better performance and more demanding requirements. Except for rigid body objects, component objects (COs) with more complex characteristics remain a detection challenge. Its partial rules and overall disorder characteristic limits the model learning ability to the structural features. And the internal noise and relatively sparse arrangement are not conducive to optimizing the model by the existing sample assignment strategies. We propose CODet to detect COs in RS scenes. It consists of a cross-hierarchy feature fusion module (CFM) and a noise-sparse sample assignment (NSA) strategy. CFM learns the potential representation and relative position relationship of components by fusing different level features. NSA redefines the optimization process of sample assignment. It aims to alleviate the problems of classification-localization misalignment (CLM) and the positive-negative sample imbalance (PNI) caused by the object's internal noise and sparse arrangement. The method is verified on the proposed COD dataset of six categories of COs, reaching an average mAP/mAP(50) of 54.3/86.0. To be closer to the task requirements of the practical RS scene, we also propose a RS large-scale images inference framework. It includes a dataset (APRoI, labeled with COs and rigid body objects), a large-scale image inference strategy, and a set of evaluation metrics. With CODet as the core, the framework can effectively reduce the inference time by three to four times on images with an average of more than 100 million pixels.
Keywords:
~Component object (CO)
convolutional neural networks (CNNs)
object detection
sample assignment
structure feature

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704