arrow
返回

Lighting Search Algorithm With Convolutional Neural Network-Based Image Captioning System for Natural Language Processing

delete2023-01-01
delete1
delete
OA
AI
R
Rana Alnashwan
S
Samia Allaoua Chelloug
N
Nabil Sharaf Almalki
I
Imène Issaouı
A
Abdelwahed Motwakel *
A
Ahmed El Sayed
DOI:10.1109/ACCESS.2023.3342703delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, deep learning models have become more prominent due to their tremendous performance for real-time tasks like face recognition, object detection, natural language processing (NLP), instance segmentation, image classification, gesture recognition, and video classification. Image captioning is one of the critical tasks in NLP and computer vision (CV). It completes conversion from image to text; specifically, the model produces description text automatically based on the input images. In this aspect, this article develops a Lighting Search Algorithm (LSA) with a Hybrid Convolutional Neural Network Image Captioning System (LSAHCNN-ICS) for NLP. This introduced LSAHCNN-ICS system develops an end-to-end model which employs convolutional neural network (CNN) based ShuffleNet as an encoder and HCNN as a decoder. At the encoding part, the ShuffleNet model derives feature descriptors of the image. Besides, in the decoding part, the description of text can be generated using the proposed hybrid convolutional neural network (HCNN) model. To achieve improved captioning results, the LSA is applied as a hyperparameter tuning strategy, representing the innovation of the study. The simulation analysis of the presented LSAHCNN-ICS technique is performed on a benchmark database, and the obtained results demonstrated the enhanced outcomes of the LSAHCNN-ICS algorithm over other recent methods with maximum Consensus-based Image Description Evaluation (CIDEr Code) of 43.60, 59.54, and 135.14 on Flickr8k, Flickr30k, and MSCOCO datasets correspondingly.
Keyword:
Feature extraction
Convolutional neural networks
Visualization
Decoding
Natural language processing
Tuning
Deep convolutional neural network
natural language processing
image captioning
machine learning
hyperparameter tuning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
King Saud University
学者数:
3.4W
论文数: 3.8W
被引数: 815
P
Princess Nourah bint Abdulrahman University
学者数:
8.3K
论文数: 9.6K
被引数: 10
E
egyptian knowledge bank (ekb)
学者数:
11.6W
论文数: 9.3W
被引数: 84
Q
Qassim University
学者数:
5.7K
论文数: 5.5K
被引数: 5.0K
P
Prince Sattam Bin Abdulaziz University
学者数:
6.9K
论文数: 8.9K
被引数: 9.9K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Investigation of fast processes in condensed matter by time-resolved x-ray diffraction通过时间分辨X射线衍射研究凝聚态物质中的快速过程
err2009-03-19
err0
PREAI
errI. Uschmann; T. Kämpfer; F. Zamponi; A. Lübcke; U. Zastrau; R. Loetzsch; S. Höfer; A. Morak; E. Förster
err分享
err收藏
Interfacial reaction in bimetallic Sn/Cu thin films
err1980-07-01
err0
PREAI
errK. Fujiwara; M. Ohtani; T. Isu; S. Nango; R. Kawanaka; K. Shimizu
err分享
err收藏
Estudiantes con discapacidad en una universidad chilena: desafíos de la inclusión智利大学中的残疾学生:包容的挑战
err2015-10-08
err0
errOAAI
errGabriela Paulina Villafañe Hormazábal; Angélica Aurora Corrales Huenul; Valentina Javiera Soto Hernández
err分享
err收藏
Enhance understanding and reasoning ability for image captioning
err2022-05-12
err15
PREAI
errWei, Jiahui; Li, Zhixin; Zhu, Jianwei; Ma, Huifang
err分享
err收藏
学者 查看更多内容