arrow
Return

Multi-View correlation distillation for incremental object detection

delete2022-11-01
delete30
delete
OA
AI
D
Dongbao Yang
周宇 (Yu Zhou) *
A
Aoting Zhang
X
Xurui Sun
D
Dayan Wu
W
Weiping Wang
Q
Qixiang Ye
DOI:10.1016/j.patcog.2022.108863delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In real applications, new object classes often emerge after the detection model has been trained on a prepared dataset with fixed classes. Fine-tuning the old model with only new data will lead to a well-known phenomenon of catastrophic forgetting, which severely degrades the performance of modern object detectors. Due to the storage burden, data privacy and time consumption, sometimes it is impractical to train the model from scratch with all data of both old and new classes. In this paper, we propose a novel Multi-View Correlation Distillation (MVCD) based incremental object detection method, which explores the intra-feature correlations in the feature space of the object detector. To better transfer the knowledge learned from the old classes and maintain the ability to learn new classes, we select the sample-specific discriminative features from channel-wise, point-wise and instance-wise views. Meanwhile, the correlation distillation losses on the selective features are designed to regularize the learning of the incremental object detector. A new metric named Stability-Plasticity-mAP (SPmAP) is proposed to evaluate the incremental learning performance as a complementary metric to mAP, which integrates the metrics for the stability on old classes and the plasticity on new classes in incremental object detection. The extensive experiments conducted on VOC2007 and COCO demonstrate that MVCD achieves a better trade-off between stability and plasticity than state-of-the-art first-order distillation-based incremental object detection methods. (C) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Object detection
Incremental learning
Catastrophic forgetting
Knowledge distillation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

I
institute of information engineering, cas
Scholars:
474
Papers: 466
Citations: 0
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704