返回
A survey on deep neural network-based image captioning
DOI:10.1007/s00371-018-1566-y.png)
摘要
En 中文
Image captioning is a hot topic of image understanding, and it is composed of two natural parts (look and language expression) which correspond to the two most important fields of artificial intelligence (machine vision and natural language processing). With the development of deep neural networks and better labeling database, the image captioning techniques have developed quickly. In this survey, the image captioning approaches and improvements based on deep neural network are introduced, including the characteristics of the specific techniques. The early image captioning approach based on deep neural network is the retrieval-based method. The retrieval method makes use of a searching technique to find an appropriate image description. The template-based method separates the image captioning process into object detection and sentence generation. Recently, end-to-end learning-based image captioning method has been verified effective at image captioning. The end-to-end learning techniques can generate more flexible and fluent sentence. In this survey, the image captioning methods are reviewed in detail. Furthermore, some remaining challenges are discussed.
Keyword:
Image captioning
Image understanding
Object detection
Language model
Attention mechanism
Dense captioning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
4.6K
被引数:
6.5K
机构
引用论文
X-ray investigation of the coordination and complex formation of lanthanoid ions in aqueous perchlorate and selenate solutions高氯酸盐和硒酸水溶液中镧系离子的配位和络合物形成的x射线研究
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations视觉基因组: 使用众包密集图像注释连接语言和视觉
Comparative study of layer by layer assembled multilayer films based on graphene oxide and reduced graphene oxide on flexible polyurethane foam: flame retardant and smoke suppression properties
RSC Advances
IF0
Adamts18 deletion results in distinct developmental defects and provides a model for congenital disorders of lens, lung, and female reproductive tract development
Biology Open
IF0

