arrow
返回

Machine learning without a processor: Emergent learning in a nonlinear analog network

delete2024-07-02
delete3
delete
OA
AI
S
Sam Dillavou *
B
Benjamin D. Beyer
M
Menachem Stern
A
Andrea J. Liu
M
Marc Z. Miskin
D
D. J. Durian
DOI:10.1073/pnas.2319718121delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic contrastive local learning networks (CLLNs) offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here, we introduce a nonlinear CLLN-an analog electronic network made of selfadjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR (exclusive or) and nonlinear regression, without a computer. We find our decentralized system reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.
Keyword:
emergent learning
machine learning | soft matter
active matter
neuromorphic computing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

U
university of pennsylvania
学者数:
9.2W
论文数: 7.8W
被引数: 153
引用论文

引用论文

An Ising Hamiltonian solver based on coupled stochastic phase-transition nano-oscillators
err2021-07-26
err89
errOAAI
errDutta, S.; Khanna, A.; Assoa, A. S.; Paik, H.; Schlom, D. G.; Toroczkai, Z.; Raychowdhury, A.; Datta, S.
err分享
err收藏
err分享
err收藏
err分享
err收藏
Directed aging, memory, and nature's greed
err2019-12-06
err55
errOAAI
errPashine, Nidhi; Hexner, Daniel; Liu, Andrea J.; Nagel, Sidney R.
err分享
err收藏
Homeostatic proliferation of naïve CD8+ T cells depends on CD62L/L‐selectin‐mediated homing to peripheral LN
err2009-10-30
err0
errOAAI
errKerstin Schuster; Jules Gadiot; Reinhard Andreesen; Andreas Mackensen; Thomas F. Gajewski; Christian Blank
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Training an Ising machine with equilibrium propagation
err2024-04-30
err5
errOAAI
errLaydevant, Jeremie; Markovic, Danijela; Grollier, Julie
err分享
err收藏
学者 查看更多内容