.png){kind=icon}
返回
Knowledge Amalgamation for Object Detection With Transformers
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2023.3263105.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Knowledge amalgamation (KA) is a novel deep model reusing task aiming to transfer knowledge from several well-trained teachers to a multi-talented and compact student. Currently, most of these approaches are tailored for convolutional neural networks (CNNs). However, there is a tendency that Transformers, with a completely different architecture, are starting to challenge the domination of CNNs in many computer vision tasks. Nevertheless, directly applying the previous KA methods to Transformers leads to severe performance degradation. In this work, we explore a more effective KA scheme for Transformer-based object detection models. Specifically, considering the architecture characteristics of Transformers, we propose to dissolve the KA into two aspects: sequence-level amalgamation (SA) and task-level amalgamation (TA). In particular, a hint is generated within the sequence-level amalgamation by concatenating teacher sequences instead of redundantly aggregating them to a fixed-size one as previous KA approaches. Besides, the student learns heterogeneous detection tasks through soft targets with efficiency in the task-level amalgamation. Extensive experiments on PASCAL VOC and COCO have unfolded that the sequence-level amalgamation significantly boosts the performance of students, while the previous methods impair the students. Moreover, the Transformer-based students excel in learning amalgamated knowledge, as they have mastered heterogeneous detection tasks rapidly and achieved superior or at least comparable performance to those of the teachers in their specializations.
Keyword:
Transformers
Task analysis
Object detection
Detectors
Training
Computer architecture
Feature extraction
Model reusing
knowledge amalgamation
knowledge distillation
object detection
vision transformers
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
.png){kind=icon}
PREAI
分享收藏Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
PREAI
分享收藏分享收藏分享收藏Psychometrics of the Child PTSD Symptom Scale for DSM-5 for Trauma-Exposed Children and Adolescents
OAAI
OAAI分享收藏Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection用于目标检测的学习旋转不变和Fisher判别卷积神经网络
PREAI
分享收藏
查看更多内容