arrow
返回

Dual-CNN: A Convolutional language decoder for paragraph image captioning

delete2020-07-01
delete32
PRE
AI
R
Ruifan Li *
H
Haoyu Liang
Y
Yihui Shi
F
Fangxiang Feng
X
Xiaojie Wang
DOI:10.1016/j.neucom.2020.02.041delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The task of paragraph image captioning aims to generate a coherent paragraph describing a given image. However, due to their limited ability to capture long-term dependency, recurrent neural network or long-short term memory based decoders could hardly generate satisfactory textual descriptions with a long paragraph. In addition, the training inefficiency in the sequential decoders is significantly observed. Motivated by the advantage of convolutional neural network (i.e., CNN), in this paper, we propose a Dual-CNN decoder with long-term memory ability and parallel computation, which can produce a semantically coherent paragraph for an image. Our Dual-CNN model is evaluated on the Stanford image-paragraph dataset. Extensive experiments demonstrate that our Dual-CNN achieves comparable results compared with state-of-the-art models. Furthermore, the diversity and coherence of generated paragraphs are analyzed to show the superiority of our approach. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Deep learning
Language and vision
Convolutional neural networks
Image captioning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
引用论文

引用论文

3G structure for image caption generation
err2019-02-01
err29
errOAAI
errYuan, Aihong; Li, Xuelong; Lu, Xiaoqiang
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
Growth Factors in the Intestinal Tract
err2018-01-01
err0
PREAI
errMichael A. Schumacher; Soula Danopoulos; Denise Al Alam; Mark R. Frey
err分享
err收藏
VD-SAN: Visual-Densely Semantic Attention Network for Image Caption Generation
err2019-02-01
err46
PREAI
errHe, Xinwei; Yang, Yang; Shi, Baoguang; Bai, Xiang
err分享
err收藏
Image captioning with triple-attention and stack parallel LSTM
err2018-11-01
err52
PREAI
errZhu, Xinxin; Li, Lixiang; Liu, Jing; Li, Ziyi; Peng, Haipeng; Niu, Xinxin
err分享
err收藏
The melting curve of iron at extreme pressures: Implications for planetary cores
err2011-09-01
err0
errOAAI
errG. Morard; J. Bouchet; D. Valencia; S. Mazevet; F. Guyot
err分享
err收藏
err分享
err收藏
没有更多内容