Semi-supervised transformable architecture search for feature distillation

Man Zhang

doi:10.1007/s10044-022-01122-y

Semi-supervised transformable architecture search for feature distillation

2022-11-01

0

PRE

AI

DOI：10.1007/s10044-022-01122-y

Original

Original request for help

Save

Abstract

En 中文

The designed method aims to perform image classification tasks efficiently and accurately. Different from the traditional CNN-based image classification methods, which are greatly affected by the number of labels and the depth of the network. Although the deep network can improve the accuracy of the model, the training process is usually time-consuming and laborious. We explained how to use only a few of labels, design a more flexible network architecture and combine feature distillation method to improve model efficiency while ensuring high accuracy. Specifically, we integrate different network structures into independent individuals to make the use of network structures more flexible. Based on knowledge distillation, we extract the channel features and establish a feature distillation connection from the teacher network to the student network. By comparing the experimental results with other related popular methods on commonly used data sets, the effectiveness of the method is proved. The code can be found at https://github.com/ZhangXinba/Semi_FD.

Keywords:

Semi-supervised

Feature distillation

Transformable architecture search

Joint loss

Semi-supervised transformable architecture search for feature distillation

Abstract

Journal

Organization