arrow
返回

Kernel approximation using analogue in-memory computing

delete2024-12-13
delete0
PRE
AI
J
Julian Büchel
G
Giacomo Camposampiero
A
Athanasios Vasilopoulos
C
Corey Lammie
M
Manuel Le Gallo
A
Abbas Rahimi
A
Abu Sebastian *
DOI:10.1038/s42256-024-00943-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Kernel functions are vital ingredients of several machine learning (ML) algorithms but often incur substantial memory and computational costs. We introduce an approach to kernel approximation in ML algorithms suitable for mixed-signal analogue in-memory computing (AIMC) architectures. Analogue in-memory kernel approximation addresses the performance bottlenecks of conventional kernel-based methods by executing most operations in approximate kernel methods directly in memory. The IBM HERMES project chip, a state-of-the-art phase-change memory-based AIMC chip, is utilized for the hardware demonstration of kernel approximation. Experimental results show that our method maintains high accuracy, with less than a 1% drop in kernel-based ridge classification benchmarks and within 1% accuracy on the long-range arena benchmark for kernelized attention in transformer neural networks. Compared to traditional digital accelerators, our approach is estimated to deliver superior energy efficiency and lower power consumption. These findings highlight the potential of heterogeneous AIMC architectures to enhance the efficiency and scalability of ML applications.
Keyword:
EFFICIENT
PERFORMANCE
MEMRISTOR

期刊

Nature Machine Intelligence 封面图
Nature Machine Intelligence
IF:
23.9
论文数:
1.3K
被引数:
1.5W

机构

暂无机构信息
引用论文

引用论文

A Planar Decanuclear Cobalt(II) Phosphonate
err2014-04-22
err0
PREAI
errDipankar Sahoo; Ramesh K. Metre; Wolfgang Kroener; Klaus Gieb; Paul Müller; Vadapalli Chandrasekhar
err分享
err收藏
Modelling reactive solute transport from groundwater to soil surface under evaporation
err2009-12-17
err0
PREAI
errK. Nakagawa; T. Hosokawa; S.‐I. Wada; K. Momii; K. Jinno; R. Berndtsson
err分享
err收藏
Petrography and geochemistry of clastic rocks within the Inthanon zone, northern Thailand: Implications for Paleo-Tethys subduction and convergence
err2012-11-01
err0
PREAI
errHidetoshi Hara; Miyuki Kunii; Ken-ichiro Hisada; Katsumi Ueno; Yoshihito Kamata; Weerapan Srichan; Punya Charusiri; Thasinee Charoentitirat; Megumi Watarai; Yoshiko Adachi; Toshiyuki Kurihara
err分享
err收藏
err分享
err收藏
Homeostatic proliferation of naïve CD8+ T cells depends on CD62L/L‐selectin‐mediated homing to peripheral LN
err2009-10-30
err0
errOAAI
errKerstin Schuster; Jules Gadiot; Reinhard Andreesen; Andreas Mackensen; Thomas F. Gajewski; Christian Blank
err分享
err收藏
Comparison of GC–MS and FTIR methods for quantifying naphthenic acids in water samples
err2008-11-01
err0
PREAI
errAngela C. Scott; Rozlyn F. Young; Phillip M. Fedorak
err分享
err收藏
学者 查看更多内容