Return
Autoregressive Predictive Coding: A Comprehensive Study
DOI:10.1109/JSTSP.2022.3203608.png)
Abstract
En 中文
We review autoregressive predictive coding (APC), an approach to learn speech representation by predicting a future frame given the past frames. We present three different views of interpreting APC, and provide a historical account to the approach. To study the speech representation learned by APC, we use common speech tasks, such as automatic speech recognition and speaker verification, to demonstrate the utility of the learned representation. In addition, we design a suite of fine-grained tasks, including frame classification, segment classification, fundamental frequency tracking, and duration prediction, to probe the phonetic and prosodic content of the representation. The three views of the APC objective welcome various generalizations and algorithms to learn speech representations. Probing on the suite of fine-grained tasks suggests that APC makes a wide range of high-level speech information accessible in its learned representation.
Keywords:
Task analysis
Data models
Predictive models
Predictive coding
Probabilistic logic
Entropy
Training
Automatic speech recognition
predictive coding
representation learning
self-supervised learning
speaker verification
Journal
IF:
13.7
Papers:
1.9K
Citations:
1.1W

