.png){kind=icon}
返回
Deep Reinforcement Learning for Sequence-to-Sequence Models
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2019.2929141.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent times, sequence-to-sequence (seq2seq) models have gained a lot of popularity and provide state-of-the-art performance in a wide variety of tasks, such as machine translation, headline generation, text summarization, speech-to-text conversion, and image caption generation. The underlying framework for all these models is usually a deep neural network comprising an encoder and a decoder. Although simple encoder-decoder models produce competitive results, many researchers have proposed additional improvements over these seq2seq models, e.g., using an attention-based model over the input, pointer-generation models, and self-attention models. However, such seq2seq models suffer from two common problems: 1) exposure bias and 2) inconsistency between train/test measurement. Recently, a completely novel point of view has emerged in addressing these two problems in seq2seq models, leveraging methods from reinforcement learning (RL). In this survey, we consider seq2seq problems from the RL point of view and provide a formulation combining the power of RL methods in decision-making with seq2seq models that enable remembering long-term memories. We present some of the most recent frameworks that combine the concepts from RL and deep neural networks. Our work aims to provide insights into some of the problems that inherently arise with current approaches and how we can address them with better RL models. We also provide the source code for implementing most of the RL models discussed in this paper to support the complex task of abstractive text summarization and provide some targeted experiments for these RL models, both in terms of performance and training time.
Keyword:
Actor-critic (AC) methods
deep learning
policy gradients (PGs)
Q-learning
reinforcement learning (RL)
sequence-to-sequence (seq2seq) learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
暂无机构信息
引用论文
Analyzing IEEE 802.11n standard: outdoor performanace.png)
2012 Second International Conference on Digital Information Processing and Communications (ICDIPC)
2012 Second International Conference on Digital Information Processing and Communications (ICDIPC)IF0
PREAI
分享收藏Genotype-Phenotype Associations in Patients With Type-1, Type-2, and Atypical NF1 Microdeletions
OAAI
OAAI分享收藏
查看更多内容