arrow
返回

Autoregressive Predictive Coding: A Comprehensive Study

delete2022-10-01
delete1
PRE
AI
G
Gene-Ping Yang
Y
Yu-An Chung
J
James Glass
H
Hao Tang *
DOI:10.1109/JSTSP.2022.3203608delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We review autoregressive predictive coding (APC), an approach to learn speech representation by predicting a future frame given the past frames. We present three different views of interpreting APC, and provide a historical account to the approach. To study the speech representation learned by APC, we use common speech tasks, such as automatic speech recognition and speaker verification, to demonstrate the utility of the learned representation. In addition, we design a suite of fine-grained tasks, including frame classification, segment classification, fundamental frequency tracking, and duration prediction, to probe the phonetic and prosodic content of the representation. The three views of the APC objective welcome various generalizations and algorithms to learn speech representations. Probing on the suite of fine-grained tasks suggests that APC makes a wide range of high-level speech information accessible in its learned representation.
Keyword:
Task analysis
Data models
Predictive models
Predictive coding
Probabilistic logic
Entropy
Training
Automatic speech recognition
predictive coding
representation learning
self-supervised learning
speaker verification

期刊

IEEE Journal of Selected Topics in Signal Processing 封面图
IEEE Journal of Selected Topics in Signal Processing
IF:
13.7
论文数:
1.9K
被引数:
1.1W

机构

U
University of Edinburgh
学者数:
5.2W
论文数: 4.6W
被引数: 71
引用论文

引用论文

Ribosomes in platelets protect the messenger
err2017-04-27
err0
errOAAI
errJesse W. Rowley; Andrew S. Weyrich
err分享
err收藏
Voxceleb: Large-scale speaker verification in the wild
err2020-03-01
err414
errOAAI
errNagrani, Arsha; Chung, Joon Son; Xie, Weidi; Zisserman, Andrew
err分享
err收藏
YAC transgene-mediated olfactory receptor gene choiceYAC转基因介导的嗅觉受体基因选择
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
err分享
err收藏
err分享
err收藏
学者 查看更多内容