.png){kind=icon}
返回
Parallel encoder-decoder framework for image captioning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2023.111056.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent progress in deep learning has led to successful utilization of encoder-decoder frameworks inspired by machine translation in image captioning models. The stacking of layers in encoders and decoders has made it possible to use several modules in encoders and decoders. However, just one type of module in encoder or decoder has been used in stacked models. In this research, we propose a parallel encoder-decoder framework that aims to take advantage of multiple of types modules in encoders and decoders, simultaneously. This framework contains augmented parallel blocks, which include stacking modules or non-stacked ones. Then, the results of the blocks are integrated to extract higher-level semantic concepts. This general idea is not limited to image captioning and can be customized for many applications that utilize encoder-decoder frameworks. We evaluated our proposed method on the MS-COCO dataset and achieved state-of-the-art results. We got 149.92 for CIDEr-D metric outperforming state-of-the-art image captioning models.
Keyword:
Parallelization
Encoder-decoder framework
Image captioning
Natural language processing
期刊
K
IF:
7.6
论文数:
1.2W
被引数:
4.5W
机构
引用论文
Li6P6O18: X-ray powder structure determination of lithium cyclohexaphosphateLi6P6O18: 环磷酸锂的x射线粉末结构测定
.png){kind=icon}
PREAI
分享收藏
分享收藏
分享收藏
查看更多内容