arrow
Return

Two-stage knowledge transfer framework for image classification

delete2020-11-01
delete19
PRE
AI
J
Jianhang Zhou
S
Shaoning Zeng
B
Bob Zhang *
DOI:10.1016/j.patcog.2020.107529delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The two-stage strategy has been widely used in image classification. However, these methods barely take the classification criteria of the first stage into consideration in the second prediction stage. In this paper, we propose a novel Two-Stage Representation method (TSR), and convert it to a Single-Teacher Single-Student (STSS) problem in our two-stage knowledge transfer framework for image classification. Specifically, the first stage classifier is formulated as the teacher, which holds the 'gate value' to supervise the student classifier in the second stage. To transfer knowledge from the teacher classifier, we seek the nearest neighbours of the test sample to generate a set of candidate target classes in the first stage. Then, a student classifier learns from the samples belonging to these candidate classes in the second stage. Under the supervision of the teacher classifier, the teacher approves the student only if it obtains a higher score than the 'gate value'. In actuality, the proposed framework generates a stronger classifier by staging two weaker classifiers in a novel way. The experiments on several databases show that our proposed framework is effective, which outperforms multiple popular classification methods. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Image classification
Teacher-student model
Two-stage classification
Sparse representation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
University of Macau
Scholars:
1.1W
Papers: 1.3W
Citations: 2.0W
Cited Papers

Cited Papers

Efficient classification with sparsity augmented collaborative representation
err2017-05-01
err75
PREAI
errAkhtar, Naveed; Shafait, Faisal; Mian, Ajmal
errShare
errSave
A Two-Phase Weighted Collaborative Representation for 3D partial face recognition with single sample
err2016-04-01
err77
PREAI
errLei, Yinjie; Guo, Yulan; Hayat, Munawar; Bennamoun, Mohammed; Zhou, Xinzhi
errShare
errSave
Beyond sparsity: The role of L1-optimizer in pattern classification
err2012-03-01
err190
PREAI
errYang, Jian; Zhang, Lei; Xu, Yong; Yang, Jing-yu
errShare
errSave
Preparation of zinc oxide free, transparent rubber nanocomposites using a layered double hydroxide filler
err2011-01-01
err0
PREAI
errAmit Das; De-Yi Wang; Andreas Leuteritz; Kalaivani Subramaniam; H. Chris Greenwell; Udo Wagenknecht; Gert Heinrich
errShare
errSave
An Evolutionarily Based Type-2 Fuzzy-PID for Multi-Machine Power System Stabilization
err2023-05-29
err0
errOAAI
errYe Wang; Zhaiaibai Ma; Mostafa M. Salah; Ahmed Shaker
errShare
errSave
researcher View more