.png){kind=icon}
返回
Audio Embedding-Aware Dialogue Policy Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2022.3225658.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Following the success of Natural Language Processing (NLP) transformers pretrained via self-supervised learning, similar models have been proposed recently for speech processing such as Wav2Vec2, HuBERT and UniSpeech-SAT. An interesting yet unexplored area of application of these models is Spoken Dialogue Systems, where the users' audio signals are typically just mapped to word-level features derived from an Automatic Speech Recogniser (ASR), and then processed using NLP techniques to generate system responses. This paper reports a comprehensive comparison of dialogue policies trained using ASR-based transcriptions and extended with the aforementioned audio processing transformers in the DSTC2 task. Whilst our dialogue policies are trained with supervised and policy-based deep reinforcement learning, they are assessed using both automatic task completion metrics and a human evaluation. Our results reveal that using audio embeddings is more beneficial than detrimental in most of our trained dialogue policies, and that the benefits are stronger for supervised learning than reinforcement learning.
Keyword:
Audio embeddings
deep reinforcement learning
spoken dialogue systems
transformer neural networks
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
分享收藏分享收藏Multi-environment trials data analysis: An efficient biplot analysis approach多环境试验数据分析：一种高效的图示分析（biplot）方法.png)
OAAI
IF0
OAAI分享收藏
查看更多内容