arrow
返回

Altruistic Collaborative Learning

delete2024-02-01
delete0
PRE
AI
A
Abdourrahmane M. Atto *
DOI:10.1109/TNNLS.2022.3185961delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article proposes a new learning paradigm based on the concept of concordant gradients for ensemble learning strategies. In this paradigm, learners update their weights if and only if the gradients of their cost functions are mutually concordant in a sense given by paper. The objective of the proposed concordant optimization framework is robustness against uncertainties by postponing to a later epoch, the consideration of examples associated with discordant directions during a training phase. Concordance constrained collaboration is shown to be relevant, especially in intricate classification issues where exclusive class labeling involves information bias due to correlated disturbances affecting almost all training examples. The first learning paradigm applies on a gradient descent strategy based on allied agents, subjected to concordance checking before moving forward in training epochs. The second learning paradigm is related to multivariate dense neural matrix fusion, where the fusion operator is itself a learnable neural operator. In addition to these paradigms, this article proposes a new categorical probability transform to enrich the existing collection and propose an alternative scenario for integrating penalized SoftMax information. Finally, this article assesses the relevance of the above contributions with respect to several deep learning frameworks and a collaborative classification involving dependent classes.
Keyword:
Collaborative work
Training
Collaboration
Transforms
Neurons
Learning systems
Tensors
Allied neural networks
ally neural networks
collaborative learning
collective artificial intelligence (AI)
concordant gradient descent
federated learning

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.5K
被引数:
7.2W

机构

U
Universite Savoie Mont Blanc
学者数:
5.4K
论文数: 4.0K
被引数: 18
引用论文

引用论文

Hybrid Classifier Ensemble for Imbalanced Data
err2020-04-01
err87
PREAI
errYang, Kaixiang; Yu, Zhiwen; Wen, Xin; Cao, Wenming; Chen, C. L. Philip; Wong, Hau-San; You, Jane
err分享
err收藏
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
err分享
err收藏
学者 查看更多内容