arrow
返回

Stimulus-driven and concept-driven analysis for image caption generation

delete2020-07-01
delete168
PRE
AI
S
Songtao Ding
S
Shiru Qu
Y
Yuling Xi
万少华 封面图
万少华 (Shaohua Wan) *
DOI:10.1016/j.neucom.2019.04.095delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, image captioning has achieved great progress in computer vision and artificial intelligence. However, language models still failed to achieve the desired results in high-level visual tasks. Generating accurate image captions for a complex scene that contains multiple targets is a challenge. To solve these problems, we introduce the theory of attention in psychology to image caption generation. We propose two types of attention mechanisms: The stimulus-driven and the concept-driven. Our attention model relies on a combination of convolutional neural network (CNN) over images and long-short term memory (LSTM) network over sentences. Comparison of experimental results illustrates that our proposed method achieves good performance on the MSCOCO test server. (C) 2019 Elsevier B.V. All rights reserved.
Keyword:
Image captioning
Stimulus-driven
Concept-driven
Attention mechanism
LSTM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

Z
zhongnan university of economics & law
学者数:
2.0K
论文数: 2.2K
被引数: 3
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

A lymphomagenic role for HIV beyond immune suppression?
err2016-03-17
err0
errOAAI
errRiccardo Dolcetti; Annunziata Gloghini; Arnaldo Caruso; Antonino Carbone
err分享
err收藏
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Growth Factors in the Intestinal Tract
err2018-01-01
err0
PREAI
errMichael A. Schumacher; Soula Danopoulos; Denise Al Alam; Mark R. Frey
err分享
err收藏
Learning Color Names for Real-World Applications
err2009-07-01
err568
errOAAI
errvan de Weijer, Joost; Schmid, Cordelia; Verbeek, Jakob; Larlus, Diane
err分享
err收藏
学者 查看更多内容