arrow
Return

Autoregressive Predictive Coding: A Comprehensive Study

delete2022-10-01
delete1
PRE
AI
G
Gene-Ping Yang
Y
Yu-An Chung
J
James Glass
H
Hao Tang *
DOI:10.1109/JSTSP.2022.3203608delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We review autoregressive predictive coding (APC), an approach to learn speech representation by predicting a future frame given the past frames. We present three different views of interpreting APC, and provide a historical account to the approach. To study the speech representation learned by APC, we use common speech tasks, such as automatic speech recognition and speaker verification, to demonstrate the utility of the learned representation. In addition, we design a suite of fine-grained tasks, including frame classification, segment classification, fundamental frequency tracking, and duration prediction, to probe the phonetic and prosodic content of the representation. The three views of the APC objective welcome various generalizations and algorithms to learn speech representations. Probing on the suite of fine-grained tasks suggests that APC makes a wide range of high-level speech information accessible in its learned representation.
Keywords:
Task analysis
Data models
Predictive models
Predictive coding
Probabilistic logic
Entropy
Training
Automatic speech recognition
predictive coding
representation learning
self-supervised learning
speaker verification

Journal

IEEE Journal of Selected Topics in Signal Processing cover
IEEE Journal of Selected Topics in Signal Processing
IF:
13.7
Papers:
1.9K
Citations:
1.1W

Organization

U
University of Edinburgh
Scholars:
5.2W
Papers: 4.6W
Citations: 71
Cited Papers

Cited Papers

Ribosomes in platelets protect the messenger
err2017-04-27
err0
errOAAI
errJesse W. Rowley; Andrew S. Weyrich
errShare
errSave
Voxceleb: Large-scale speaker verification in the wild
err2020-03-01
err414
errOAAI
errNagrani, Arsha; Chung, Joon Son; Xie, Weidi; Zisserman, Andrew
errShare
errSave
YAC transgene-mediated olfactory receptor gene choice
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
errShare
errSave
errShare
errSave
researcher View more