.png){kind=icon}
返回
A local representation-enhanced recurrent convolutional network for image captioning
.png){kind=icon}
PRE
AI
DOI：10.1007/s13735-022-00231-y.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Image captioning is a challenging task that aims to generate a natural description for an image. The word prediction is dependent on local linguistic contexts and fine-grained visual information and is also guided by previous linguistic tokens. However, current captioning works do not fully utilize local visual and linguistic information, generating coarse or incorrect descriptions. Also, captioning decoders have less recently focused on convolutional neural network (CNN), which has the advantage in extracting features. To solve these problems, we propose a local representation-enhanced recurrent convolutional network (Lore-RCN). Specifically, we propose a visual convolutional network to obtain enhanced local linguistic context, which incorporates selected local visual information and models short-term neighboring. Furthermore, we propose a linguistic convolutional network to obtain enhanced linguistic representation, which models long- and short-term correlations explicitly to leverage guiding information from previous linguistic tokens. Experiments conducted on COCO and Flickr30k datasets have verified the superiority of our proposed recurrent CNN-based model.
Keyword:
Recurrent convolutional network
Local representation
Image captioning
Attention mechanism
期刊
IF:
2.9
论文数:
281
被引数:
866
机构
引用论文
.png){kind=icon}
Exploring diverse and fine-grained caption for video by incorporating convolutional architecture into LSTM-based model通过将卷积架构融入基于LSTM的模型来探索视频的多样化和细粒度字幕
PREAI
分享收藏分享收藏
查看更多内容