arrow
返回

An encoder-decoder based framework for hindi image caption generation

delete2021-07-09
delete12
PRE
AI
A
Alok Singh *
T
Thoudam Doren Singh
S
Sivaji Bandyopadhyay
DOI:10.1007/s11042-021-11106-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent times, research activity on image caption generation has attracted several researchers. The present work attempt to address the problem of Hindi image caption generation using Hindi Visual genome dataset. Hindi is the official and most spoken language in India. In a linguistically diverse country like India, it is essential to provide a means that can help the people to understand the visual entities in their native languages. In this paper, an encoder-decoder based architecture is proposed where Convolutional Neural Network (CNN) is employed for encoding visual features of an image and stacked Long Short-Term Memory (sLSTM) in combination with both uni-directional LSTM and bi-directional LSTM for generating the captions in Hindi. For encoding the visual feature representation of an image, VGG19 based pre-trained model is used and sLSTM architecture is employed for caption generation at the decoder side. The model is tested over Hindi visual genome dataset to validate the proposed approach's performance and cross-verification is carried out for English captions with Flickr dataset. The experimental results of the proposed approach manifest that the model is qualitatively and quantitatively better than state-of-the-art approaches for Hindi caption generation.
Keyword:
CNN
VGG16
VGG19
Stacked LSTM
Hindi image caption generation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

N
national institute of technology (nit system)
学者数:
4.0W
论文数: 3.7W
被引数: 31
引用论文

引用论文

Comparative analysis of occlusion methods for artificial sphincters人工括约肌闭塞方法的比较分析
err2020-04-07
err0
PREAI
errLeonardo Marziale; Gioia Lucarini; Tommaso Mazzocchi; Leonardo Ricotti; Arianna Menciassi
err分享
err收藏
The Jackson Hole initiatives for a twenty‐first century American health care system
err2006-09-18
err0
PREAI
errPaul M. Ellwood; Alain C. Enthoven; Lynn Etheredge
err分享
err收藏
Effects of Continuous Noise on Avian Hearing and Vocal Development
err1973-05-01
err0
errOAAI
errPeter Marler; Masakazu Konishi; Ann Lutjen; Mary Sue Waser
err分享
err收藏
A Comprehensive Survey of Deep Learning for Image Captioning用于图像字幕的深度学习综述
err2019-02-04
err421
errOAAI
errHossain, Md Zakir; Sohel, Ferdous; Shiratuddin, Mohd Fairuz; Laga, Hamid
err分享
err收藏
Observed and modeled surface Lagrangian transport between coastal regions in the Adriatic Sea with implications for marine protected areas
err2016-04-01
err0
PREAI
errDaniel F. Carlson; Annalisa Griffa; Enrico Zambianchi; Giuseppe Suaria; Lorenzo Corgnati; Marcello G. Magaldi; Pierre-Marie Poulain; Aniello Russo; Lucio Bellomo; Carlo Mantovani; Paolo Celentano; Anne Molcard; Mireno Borghini
err分享
err收藏
学者 查看更多内容