arrow
Return

Online knowledge distillation optimization based on Multi-Student model Multi-Task collaborative learning

delete2026-04-02
delete0
PRE
AI
S
Shibiao Xu
S
Shanshan Mo
Z
Zherui Zhang
C
Changwei Wang *
W
Wenhao Xu
H
Hetong Wang
R
Rongtao Xu *
L
Li Guo
DOI:10.1016/j.knosys.2026.115910delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• The MTCL framework is proposed to address representation homogeneity via collaborative learning. • Heterogeneous auxiliary tasks are introduced to construct complementary Geometric and Semantic Experts. • A Collaborative Processing Module (CPM) integrates diverse features without rigid alignment. • The method achieves a significant 11.19% accuracy gain on TinyImageNet using ResNet-34. • Cost-effectiveness analysis demonstrates a high return on investment (ROI) with standard budgets.
Keywords:
Multi-Task Learning
Collaborative Learning
Knowledge Distillation
Representation Homogeneity
Cost-Effectiveness

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

B
Beijing University of Posts and Telecommunications
Scholars:
2.6K
Papers: 1.2K
Citations: 4.2K
Q
Qilu University of Technology
Scholars:
1.1W
Papers: 8.9K
Citations: 16
researcher View more organizations
Cited Papers

Cited Papers

Trear: Transformer-Based RGB-D Egocentric Action Recognition
err2022-03-01
err53
errOAAI
errLi, Xiangyu; Hou, Yonghong; Wang, Pichao; Gao, Zhimin; Xu, Mingliang; Li, Wanqing
errShare
errSave
Switchable Online Knowledge Distillation
err2022-11-03
err0
PREAI
errBiao Qian; Yang Wang; Hongzhi Yin; Richang Hong; Meng Wang
errShare
errSave
Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
err2021-01-01
err103
errOAAI
errZhang, Pengyu; Zhao, Jie; Bo, Chunjuan; Wang, Dong; Lu, Huchuan; Yang, Xiaoyun
errShare
errSave
Online Ensemble Model Compression Using Knowledge Distillation
err2020-11-13
err0
PREAI
errDevesh Walawalkar; Zhiqiang Shen; Marios Savvides
errShare
errSave
FDBPL: Faster distillation-based prompt learning for region-aware vision-language models adaptation
err2025-12-01
err0
PREAI
errZhang,Zherui; Wu,Jiaxin; Wang,Changwei; Xu,Rongtao; Huang,Longzhao; Xu,Wenhao; Xu,Wenbo; Guo,Li; Xu,Shibiao
errShare
errSave
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
RGBT Tracking via Multi-Adapter Network with Hierarchical Divergence Loss
err2021-01-01
err90
errOAAI
errLu, Andong; Li, Chenglong; Yan, Yuqing; Tang, Jin; Luo, Bin
errShare
errSave
researcher View more