arrow
返回

A survey on deep neural network-based image captioning

delete2018-06-09
delete59
PRE
AI
X
Xiaoxiao Liu
Q
Qingyang Xu *
王宁 封面图
王宁 (Ning Wang) *
DOI:10.1007/s00371-018-1566-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Image captioning is a hot topic of image understanding, and it is composed of two natural parts (look and language expression) which correspond to the two most important fields of artificial intelligence (machine vision and natural language processing). With the development of deep neural networks and better labeling database, the image captioning techniques have developed quickly. In this survey, the image captioning approaches and improvements based on deep neural network are introduced, including the characteristics of the specific techniques. The early image captioning approach based on deep neural network is the retrieval-based method. The retrieval method makes use of a searching technique to find an appropriate image description. The template-based method separates the image captioning process into object detection and sentence generation. Recently, end-to-end learning-based image captioning method has been verified effective at image captioning. The end-to-end learning techniques can generate more flexible and fluent sentence. In this survey, the image captioning methods are reviewed in detail. Furthermore, some remaining challenges are discussed.
Keyword:
Image captioning
Image understanding
Object detection
Language model
Attention mechanism
Dense captioning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
D
Dalian Maritime University
学者数:
1.2W
论文数: 7.9K
被引数: 6.3K
引用论文

引用论文

A high temperature variety of BiOF一种高温品种的BiOF
err1983-09-01
err0
PREAI
errSamir Matar; Jean-Maurice Reau; Louis Rabardel; Gérard Demazeau; Paul Hagenmuller
err分享
err收藏
Selective Search for Object Recognition
err2013-04-02
err3.9K
PREAI
errUijlings, J. R. R.; van de Sande, K. E. A.; Gevers, T.; Smeulders, A. W. M.
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
err2017-02-06
err3.1K
errOAAI
errKrishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei
err分享
err收藏
Adamts18 deletion results in distinct developmental defects and provides a model for congenital disorders of lens, lung, and female reproductive tract development
err2016-11-15
err0
errOAAI
errDalya Ataca; Marian Caikovski; Alessandra Piersigilli; Alexandre Moulin; Charaf Benarafa; Sarah E. Earp; Yakir Guri; Corinne Kostic; Yvan Arsenijevic; Raija Soininen; Suneel S. Apte; Cathrin Brisken
err分享
err收藏
Prognostic role of FUT8 expression in relation to p53 status in stage II and III colorectal cancer
err2018-07-05
err0
errOAAI
errMasaru Noda; Hirokazu Okayama; Yasuhide Kofunato; Shun Chida; Katsuharu Saito; Takeshi Tada; Mai Ashizawa; Takahiro Nakajima; Keita Aoto; Tomohiro Kikuchi; Wataru Sakamoto; Hisahito Endo; Shotaro Fujita; Motonobu Saito; Tomoyuki Momma; Shinji Ohki; Koji Kono
err分享
err收藏
学者 查看更多内容