.png){kind=icon}
返回
Exploring Neuromodulation for Dynamic Learning
.png){kind=icon}
OA
AI
DOI：10.3389/fnins.2020.00928.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A continual learning system requires the ability to dynamically adapt and generalize to new tasks with access to only a few samples. In the central nervous system, across species, it is observed that continual and dynamic behavior in learning is an active result of a mechanism known as neuromodulation. Therefore, in this work, neuromodulatory plasticity is embedded with dynamic learning architectures as a first step toward realizing power and area efficient few shot learning systems. An inbuilt modulatory unit regulates learning based on the context and internal state of the system. This renders the system an ability to self modify its weights. In one of the proposed architectures, ModNet, a modulatory layer is introduced in a random projection framework. ModNet's learning capabilities are enhanced by integrating attention along with compartmentalized plasticity mechanisms. Moreover, to explore modulatory mechanisms in conjunction with backpropagation in deeper networks, a modulatory trace learning rule is introduced. The proposed learning rule, uses a time dependent trace to modify the synaptic connections as a function of ongoing states and activations. The trace itself is updated via simple plasticity rules thus reducing the demand on resources. The proposed ModNet and learning rules demonstrate the ability to learn from few samples, train quickly, and perform few-shot image classification in a computationally efficient manner. The simple ModNet and the compartmentalized ModNet architecture learn benchmark image classification tasks in just 2 epochs. The network with modulatory trace achieves an average accuracy of 98.8%+/- 1.16 on the omniglot dataset for five-way one-shot image classification task while requiring 20x fewer trainable parameters in comparison to other state of the art models.
Keyword:
neuromodulation
ModNet
one-shot learning
dynamic learning
mushroom body output neurons (MBONs)
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.6W
被引数:
5.3W
机构
引用论文
Natural and Anthropogenic Emissions on a Global and Country-Related Scale and the Resulting Pollutant Concentrations in the Atmosphere全球及国家层面的自然与人为排放及其导致的大气污染物浓度
PREAI
分享收藏分享收藏分享收藏Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila.png)
ELIFE
OAAI
ELIFEIF0
OAAI分享收藏分享收藏
查看更多内容