arrow
Return

Efficient Few-Shot Object Detection via Knowledge Inheritance

delete2023-01-01
delete20
delete
OA
AI
Z
Ze Yang
C
Chi Zhang
R
Ruibo Li
Y
Yi Xu
G
Guosheng Lin *
DOI:10.1109/TIP.2022.3228162delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Few-shot object detection (FSOD), which aims at learning a generic detector that can adapt to unseen tasks with scarce training samples, has witnessed consistent improvement recently. However, most existing methods ignore the efficiency issues, e.g., high computational complexity and slow adaptation speed. Notably, efficiency has become an increasingly important evaluation metric for few-shot techniques due to an emerging trend toward embedded AI. To this end, we present an efficient pretrain-transfer framework (PTF) baseline with no computational increment, which achieves comparable results with previous state-of-the-art (SOTA) methods. Upon this baseline, we devise an initializer named knowledge inheritance (KI) to reliably initialize the novel weights for the box classifier, which effectively facilitates the knowledge transfer process and boosts the adaptation speed. Within the KI initializer, we propose an adaptive length re-scaling (ALR) strategy to alleviate the vector length inconsistency between the predicted novel weights and the pretrained base weights. Finally, our approach not only achieves the SOTA results across three public benchmarks, i.e., PASCAL VOC, COCO and LVIS, but also exhibits high efficiency with $1.8-100\times $ faster adaptation speed against the other methods on COCO/LVIS benchmark during few-shot transfer. To our best knowledge, this is the first work to consider the efficiency problem in FSOD. We hope to motivate a trend toward powerful yet efficient few-shot technique development.
Keywords:
Few-shot object detection
transfer learning
incremental learning
meta learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
Cited Papers

Cited Papers

Few-Shot Common-Object Reasoning Using Common-Centric Localization Network
err2021-01-01
err15
PREAI
errZhu, Linchao; Fan, Hehe; Luo, Yawei; Xu, Mingliang; Yang, Yi
errShare
errSave
Small Object Augmentation of Urban Scenes for Real-Time Semantic Segmentation
err2020-01-01
err51
PREAI
errYang, Zhengeng; Yu, Hongshan; Feng, Mingtao; Sun, Wei; Lin, Xuefei; Sun, Mingui; Mao, Zhi-Hong; Mian, Ajmal
errShare
errSave
Substrate-dependent shift of optimum pH in porcine pancreatic .alpha.-amylase-catalyzed reactions
err2002-05-01
err0
PREAI
errKazuhiko Ishikawa; Ikuo Matsui; Koichi Honda; Hiroshi Nakatani
errShare
errSave
Quantitative Evaluation of Collagen Crosslinks and Corresponding Tensile Mechanical Properties in Mouse Cervical Tissue during Normal Pregnancy
err2014-11-14
err0
errOAAI
errKyoko Yoshida; Hongfeng Jiang; MiJung Kim; Joy Vink; Serge Cremers; David Paik; Ronald Wapner; Mala Mahendroo; Kristin Myers
errShare
errSave
Dissociation of Striatal GTPase and Dopamine Release Responses to Muscarinic Cholinergic Agonists in F344 Rats: Influence of Age and Dietary Manipulation
err2002-11-23
err0
PREAI
errJeremiah F. Kelly; James A. Joseph; Natalia A. Denisova; Steven Erat; R. Preston Mason; George S. Roth
errShare
errSave
errShare
errSave
errShare
errSave
Isokinetic rehabilitation after surgery
err1982-05-01
err0
PREAI
errWilliam M. Sherman; David R. Pearson; Michael J. Plyley; David L. Costill; Alan J. Habansky; Donald A. Vogelgesang
errShare
errSave
researcher View more