返回
Machine learning without a processor: Emergent learning in a nonlinear analog network
DOI:10.1073/pnas.2319718121.png)
摘要
En 中文
Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic contrastive local learning networks (CLLNs) offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here, we introduce a nonlinear CLLN-an analog electronic network made of selfadjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR (exclusive or) and nonlinear regression, without a computer. We find our decentralized system reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.
Keyword:
emergent learning
machine learning | soft matter
active matter
neuromorphic computing
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
9.1
论文数:
10.8W
被引数:
73.5W
机构
引用论文
An Ising Hamiltonian solver based on coupled stochastic phase-transition nano-oscillators
NATURE ELECTRONICS
IF40.9
Using binary-stiffness beams within mechanical neural-network metamaterials to learn在机械神经网络超材料中使用二元刚度梁来学习
Environmental Influences on the Abundance and Sexual Composition of White Sharks Carcharodon carcharias in Gansbaai, South Africa
PLoS ONE
IF0

