Online knowledge distillation optimization based on Multi-Student model Multi-Task collaborative learning

Shibiao Xu

doi:10.1016/j.knosys.2026.115910

2026-04-02

PRE

DOI：10.1016/j.knosys.2026.115910

原文链接

原文求助

摘要

En 中文

• 提出MTCL框架通过协作学习解决表示同质性问题。• 引入异构辅助任务构建互补的几何和语义专家。• 协作处理模块（CPM）在不严格对齐的情况下整合多样化特征。• 该方法在TinyImageNet上使用ResNet-34实现11.19%的显著准确率提升。• 成本效益分析表明标准预算下具有较高的投资回报率（ROI）。

Keyword:

Multi-Task Learning

Collaborative Learning

Knowledge Distillation

Representation Homogeneity

Cost-Effectiveness

期刊

Knowledge-Based Systems

IF:

7.6

论文数:

1.3W

被引数:

4.5W

机构

Beijing University of Posts and Telecommunications

学者数:

2.6K

论文数: 1.2K

被引数: 4.2K

Qilu University of Technology

学者数:

1.1W

论文数: 8.9K

被引数: 16

mohamed bin zayed university of artificial intelligence

学者数:

论文数: 38

被引数: 0

查看更多机构

引用论文

Trear: Transformer-Based RGB-D Egocentric Action Recognition Trear: 基于Transformer的rgb-d自我中心动作识别

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS

IF4.9

2022-03-01

OAAI

Li, Xiangyu; Hou, Yonghong; Wang, Pichao; Gao, Zhimin; Xu, Mingliang; Li, Wanqing

Switchable Online Knowledge Distillation

Lecture Notes in Computer Science

IF0

2022-11-03

PREAI

Biao Qian; Yang Wang; Hongzhi Yin; Richang Hong; Meng Wang

Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking

IEEE TRANSACTIONS ON IMAGE PROCESSING

IF13.7

2021-01-01

103

OAAI

Zhang, Pengyu; Zhao, Jie; Bo, Chunjuan; Wang, Dong; Lu, Huchuan; Yang, Xiaoyun

Online Ensemble Model Compression Using Knowledge Distillation

Lecture Notes in Computer Science

IF0

2020-11-13

PREAI

Devesh Walawalkar; Zhiqiang Shen; Marios Savvides

Single image super-resolution for whole slide image using convolutional neural networks and self-supervised color normalization 基于卷积神经网络和自监督颜色归一化的全切片图像单图像超分辨率

MEDICAL IMAGE ANALYSIS

IF11.8

2021-02-01

PREAI

Li, Bin; Keikhosravi, Adib; Loeffler, Agnes G.; Eliceiri, Kevin W.

FDBPL: Faster distillation-based prompt learning for region-aware vision-language models adaptation FDBPL：基于蒸馏的快速提示学习，用于区域感知视觉语言模型的适配

Expert Systems with Applications

IF0

2025-12-01

PREAI

Zhang,Zherui; Wu,Jiaxin; Wang,Changwei; Xu,Rongtao; Huang,Longzhao; Xu,Wenhao; Xu,Wenbo; Guo,Li; Xu,Shibiao

Self-Supervised Video Representation Learning Using Improved Instance-Wise Contrastive Learning and Deep Clustering

IEEE Transactions on Circuits and Systems for Video Technology

IF0

2022-10-01

PREAI

Yisheng Zhu; Hui Shuai; Guangcan Liu; Qingshan Liu

Histopathology image classification based on semantic correlation clustering domain adaptation 基于语义相关性聚类域适应的病理组织图像分类

ARTIFICIAL INTELLIGENCE IN MEDICINE

IF6.2

2025-05-01

PREAI

Zhang, Jinhua; Li, Yongming; Guo, Yurou; Li, Pufei; Chen, Rui

ImageNet Large Scale Visual Recognition Challenge ImageNet大规模视觉识别挑战

INTERNATIONAL JOURNAL OF COMPUTER VISION

IF9.3

2015-04-11

2.7W

PREAI

Russakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li

RGBT Tracking via Multi-Adapter Network with Hierarchical Divergence Loss

IEEE TRANSACTIONS ON IMAGE PROCESSING

IF13.7

2021-01-01

OAAI

Lu, Andong; Li, Chenglong; Yan, Yuqing; Tang, Jin; Luo, Bin

查看更多内容