arrow
返回

MEMORY-EFFICIENT SPEECH RECOGNITION ON SMART DEVICES

delete2021-06-06
delete6
delete
OA
AI
G
Ganesh Venkatesh *
A
Alagappan Valliappan
J
Jay Mahadeokar
Y
Yuan Shangguan
C
Christian Fuegen
M
Michael L. Seltzer
V
Vikas Chandra
DOI:10.1109/ICASSP39728.2021.9414502delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Recurrent transducer models have emerged as a promising solution for speech recognition on the current and next generation smart devices. The transducer models provide competitive accuracy within a reasonable memory footprint alleviating the memory capacity constraints in these devices. However, these models access parameters from off-chip memory for every input time step which adversely effects device battery life and limits their usability on low-power devices. We address transducer model's memory access concerns by optimizing their model architecture and designing novel recurrent cell designs. We demonstrate that i) model's energy cost is dominated by accessing model weights from off-chip memory, ii) transducer model architecture is pivotal in determining the number of accesses to off-chip memory and just model size is not a good proxy, iii) our transducer model optimizations and novel recurrent cell reduces off-chip memory accesses by 4.5x and model size by 2x with minimal accuracy impact.
Keyword:
RNN-T
ASR
Recurrent Transducer
Automatic Speech Recognition
On-device Inference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE International Conference on Acoustics, Speech and Signal Processing
IF:
0
论文数:
7
被引数:
0

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Evolutionary Conservation of Orthoretroviral Long Terminal Repeats (LTRs) and ab initio Detection of Single LTRs in Genomic Data
err2009-04-13
err0
errOAAI
errFarid Benachenhou; Patric Jern; Merja Oja; Göran Sperber; Vidar Blikstad; Panu Somervuo; Samuel Kaski; Jonas Blomberg
err分享
err收藏
C-Type Virus Released from Cultured Human Rhabdomyosarcoma Cells
err1972-01-01
err0
PREAI
errR. M. McALLISTER; M. NICOLSON; M. B. GARDNER; R. W. RONGEY; S. RASHEED; P. S. SARMA; R. J. HUEBNER; M. HATANAKA; S. OROSZLAN; R. V. GILDEN; A. KABIGTING; L. VERNON
err分享
err收藏
err分享
err收藏
LSTM: A Search Space OdysseyLSTM: 搜索空间奥德赛
err2017-10-01
err3.7K
errOAAI
errGreff, Klaus; Srivastava, Rupesh K.; Koutnik, Jan; Steunebrink, Bas R.; Schmidhuber, Juergen
err分享
err收藏
没有更多内容