.png){kind=icon}
返回
Self-Organizing Democratized Learning: Toward Large-Scale Distributed Learning Systems
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2022.3170872.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Emerging cross-device artificial intelligence (AI) applications require a transition from conventional centralized learning systems toward large-scale distributed AI systems that can collaboratively perform complex learning tasks. In this regard, democratized learning (Dem-AI) lays out a holistic philosophy with underlying principles for building large-scale distributed and democratized machine learning systems. The outlined principles are meant to study a generalization in distributed learning systems that go beyond existing mechanisms such as federated learning (FL). Moreover, such learning systems rely on hierarchical self-organization of well-connected distributed learning agents who have limited and highly personalized data and can evolve and regulate themselves based on the underlying duality of specialized and generalized processes. Inspired by Dem-AI philosophy, a novel distributed learning approach is proposed in this article. The approach consists of a self-organizing hierarchical structuring mechanism based on agglomerative clustering, hierarchical generalization, and corresponding learning mechanism. Subsequently, hierarchical generalized learning problems in recursive forms are formulated and shown to be approximately solved using the solutions of distributed personalized learning problems and hierarchical update mechanisms. To that end, a distributed learning algorithm, namely DemLearn, is proposed. Extensive experiments on benchmark MNIST, Fashion-MNIST, FE-MNIST, and CIFAR-10 datasets show that the proposed algorithm demonstrates better results in the generalization performance of learning models in agents compared to the conventional FL algorithms. The detailed analysis provides useful observations to further handle both the generalization and specialization performance of the learning models in Dem-AI systems.
Keyword:
Learning systems
Distance learning
Computer aided instruction
Task analysis
Computational modeling
Computer science
Philosophical considerations
Democratized learning
distributed artificial intelligences (AIs)
hierarchical learning
self-organization
期刊
IF:
8.9
论文数:
7.5K
被引数:
7.2W
机构
引用论文
Desempenho de crianças do ensino fundamental na solução de problemas aritméticos<A NAME="top"></A>问题的基本解决方案 OAAI
OAAI分享收藏
Bringing Values Back In: The Adequacy of the European Social Survey to Measure Values in 20 Countries带回价值观: 欧洲社会调查衡量20个国家价值观的充分性OAAI
OAAI分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用.png)
PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏
查看更多内容