.png){kind=icon}
返回
Automated Image Captioning Using Sparrow Search Algorithm With Improved Deep Learning Model
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3317276.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Image captioning is a deep learning technique that intends to create and generate textual descriptions or captions for images. It integrates computer vision and natural language processing (NLP) to comprehend the visual content of an image and generate human-like descriptions. Deep learning (DL) based image captioning models can be trained on large-scale datasets, allowing them to generalize various types of images and generate captions that apply to a wide range of visual scenarios. By combining computer vision and natural language processing, DL-enabled image captioning models can understand both visual and textual information, which enables them to generate captions that not only describe the visual content but also incorporate contextual and semantic information. This study develops an Automated Image Captioning using Sparrow Search Algorithm with Improved Deep Learning (AIC-SSAIDL) technique. The major intention of the AIC-SSAIDL technique lies in the automated generation of textual captions for the input images. To accomplish this, the AIC-SSAIDL technique utilizes the MobileNetv2 model to generate feature descriptors of the input images and its hyperparameter tuning process takes place using SSA. For the image captioning process, the AIC-SSAIDL technique utilizes an attention mechanism with long short-term memory (AM-LSTM) network. Finally, the hyperparameter selection of the AM-LSTM model is performed by the fruit fly optimization (FFO) algorithm. A wide range of experiments has been conducted on benchmark data to depict the better performance of the AIC-SSAIDL method. The comprehensive result analysis highlighted the enhanced captioning results of the AIC-SSAIDL method with maximum CIDEr of 46.12, 61.89, and 137.45 on Flickr8k, Flickr30k, and MSCOCO datasets, respectively.
Keyword:
Convolutional neural networks
Visualization
Feature extraction
Convolution
Deep learning
Natural language processing
Computational modeling
Image capture
Search methods
Image captioning
deep learning
natural language processing
sparrow search algorithm
computer vision
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Investigation of fast processes in condensed matter by time-resolved x-ray diffraction通过时间分辨X射线衍射研究凝聚态物质中的快速过程
PREAI
分享收藏Estudiantes con discapacidad en una universidad chilena: desafíos de la inclusión智利大学中的残疾学生：包容的挑战
OAAI
OAAI分享收藏Modelling an expert GIS system based on knowledge to evaluate oil spill environmental sensitivity
PREAI
分享收藏Deep Learning Approaches Based on Transformer Architectures for Image Captioning Tasks基于Transformer架构的图像字幕任务深度学习方法.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Image captioning model using attention and object features to mimic human image understandingJOURNAL OF BIG DATAOAAI
JOURNAL OF BIG DATAIF6.4
OAAI分享收藏
查看更多内容