.png){kind=icon}
返回
Video Captioning by Adversarial LSTM
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2018.2855422.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper, we propose a novel approach to video captioning based on adversarial learning and long shortterm memory (LSTM). With this solution concept, we aim at compensating for the deficiencies of LSTM-based video captioning methods that generally show potential to effectively handle temporal nature of video data when generating captions but also typically suffer from exponential error accumulation. Specifically, we adopt a standard generative adversarial network (GAN) architecture, characterized by an interplay of two competing processes: a generator that generates textual sentences given the visual content of a video and a discriminator that controls the accuracy of the generated sentences. The discriminator acts as an adversary toward the generator, and with its controlling mechanism, it helps the generator to become more accurate. For the generator module, we take an existing video captioning concept using LSTM network. For the discriminator, we propose a novel realization specifically tuned for the video captioning problem and taking both the sentences and video features as input. This leads to our proposed LSTM-GAN system architecture, for which we show experimentally to significantly outperform the existing methods on standard public datasets.
Keyword:
Video captioning
adversarial training
LSTM
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
暂无机构信息
引用论文
.png){kind=icon}
Optimized Graph Learning Using Partial Tags and Multiple Features for Image and Video Annotation
PREAI
分享收藏分享收藏The role of a critical left fronto-temporal network with its right-hemispheric homologue in syntactic learning based on word category information基于单词类别信息的关键左前-时间网络及其右半球同源物在句法学习中的作用
PREAI
分享收藏
查看更多内容