arrow
Return

Q-Learning-Based Routing Optimization Algorithm for Underwater Sensor Networks

delete2024-11-15
delete1
PRE
AI
J
Jia Gao
J
Jingjing Wang *
J
Jianlei Gu
W
Wei Shi
DOI:10.1109/JIOT.2024.3398797delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Underwater wireless sensor network (UWSN) plays a vital role in the field of ocean development and exploration. Designing a routing protocol for UWSN is a great challenge due to the characteristics of short lifetime and high delay. This article proposes a Q-learning-based routing optimization algorithm for UWSN. Two reward functions are designed based on the average residual energy of network, integrating factors, such as energy information, transmission delay, and link success rate to better balance transmission quality and lifetime. In addition, a holding time mechanism for packet forwarding is developed according to the priority of nodes. The simulation results show that compared to the DBR and QLFR algorithms, this algorithm can effectively reduce transmission delay and prolong network lifetime.
Keywords:
Routing
Q-learning
Internet of Things
Energy consumption
Routing protocols
Relays
Heuristic algorithms
reinforcement learning (RL)
routing selection
underwater wireless sensor network (UWSN)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

No organization information available
Cited Papers

Cited Papers

A cooperative security monitoring mechanism aided by optimal multiple slave cluster heads for UASNs
err2023-05-01
err3
PREAI
errChen, Yougan; Wang, Wei; Sun, Xiang; Tao, Yi; Liu, Zhenwen; Xu, Xiaomei
errShare
errSave
errShare
errSave
Energy-Efficient Guiding-Network-Based Routing for Underwater Wireless Sensor Networks
err2022-11-01
err22
PREAI
errLiu, Zhixin; Jin, Xiaocao; Yang, Yi; Ma, Kai; Guan, Xinping
errShare
errSave
Increasing the Lifetime of Underwater Acoustic Sensor Networks: Difference Convex Approach
err2020-09-01
err12
PREAI
errMohammadi, Zahra; Soleimanpour-Moghadam, Mohadeseh; Askarizadeh, Mohammad; Talebi, Siamak
errShare
errSave
errShare
errSave
CARMA: Channel-Aware Reinforcement Learning-Based Multi-Path Adaptive Routing for Underwater Wireless Sensor Networks
err2019-11-01
err82
PREAI
errDi Valerio, Valerio; Lo Presti, Francesco; Petrioli, Chiara; Picari, Luigi; Spaccini, Daniele; Basagni, Stefano
errShare
errSave
researcher View more