CrabNet: Fully Task-Specific Feature Learning for One-Stage Object Detection

doi:10.1109/TIP.2022.3162099

CrabNet: Fully Task-Specific Feature Learning for One-Stage Object Detection

2022-01-01

18

PRE

AI

张宏志 (Hongzhi Zhang) *

胡清华 (Qinghua Hu)

左

左旺孟 (Wangmeng Zuo)

DOI：10.1109/TIP.2022.3162099

原文链接

原文求助

摘要

En 中文

Object detection is usually solved by learning a deep architecture involving classification and localization tasks, where feature learning for these two tasks is shared using the same backbone model. Recent works have shown that suitable disentanglement of classification and localization tasks has the great potential to improve performance of object detection. Despite the promising performance, existing feature disentanglement methods usually suffer from two limitations. First, most of them only focus on the disentangled proposals or predication heads for classification and localization tasks after RPN. While little consideration has been given to that the features for these two different tasks actually are obtained by a shared backbone model before RPN. Second, they are suggested for two-stage objectors and are not applicable to one-stage methods. To overcome these limitations, this paper presents a novel fully task-specific feature learning method for one-stage object detection. Specifically, our method first learns disentangled features for classification and localization tasks using two separated backbone models, where auxiliary classification and localization heads are inserted at the end of the two backbone models for providing a fully task-specific features for classification and localization. Then, a feature interaction module is developed for aligning and fusing task-specific features, which are further used to produce the final detection result. Experiments on MS COCO show that our proposed method (dubbed CrabNet) can achieve clear improvement over counterparts with increasing limited inference time, while performing favorably against state-of-the-arts.

Keyword:

Location awareness

Task analysis

Feature extraction

Object detection

Representation learning

Detectors

Proposals

Object detection

convolutional network

feature disentanglement

feature interaction

CrabNet: Fully Task-Specific Feature Learning for One-Stage Object Detection

摘要

期刊

机构