arrow
Return

Optimized Task Offloading in Multi-Domain IoT Networks Using Distributed Deep Reinforcement Learning in Edge Computing Environments

delete2025-01-01
delete0
delete
OA
AI
O
Ojonukpe S. Egwuche *
J
Japie Greeff
A
Absalom E. Ezugwu
DOI:10.1109/ACCESS.2025.3535870delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the Internet of Things (IoT) networks, sensors, gateways, and services interoperate at different levels to provide services to the end users. IoT networks are deployed in different domains for specific tasks that can be monitored from remote locations. The increase in the number of IoT-connected devices and their notable limited computational power calls for resource-efficient and in-between layers of task processing on the network. In this study, we utilized deep reinforcement learning to intelligently model the offloading policies as Markov Decision Process (MDP) for IoT devices in a distributed manner by considering IoT devices as agents that make offloading decisions taking into account the environmental dynamics. To attain optimal policy in the learning process that caters to high dimensionality, deep Q-network was employed to model the agents' interaction in a dynamic and environment-sensitive manner. The architecture allows local decision-making by IoT edge nodes for tasks offloading to edge servers based on connectivity, resource availability, and proximity. Extensive simulation under different learning rates, batch sizes, and memory sizes shows that the proposed scheme with the utilization of a CNN approximator generates optimal policy and higher convergence performance with lower latency than the conventional Q-learning model and several other existing algorithms.
Keywords:
Internet of Things
Edge computing
Cloud computing
Heuristic algorithms
Deep reinforcement learning
Computer architecture
Computational modeling
Servers
Resource management
Scalability
edge computing
tasks offloading
multi-domain networks

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
north west university - south africa
Scholars:
5.5K
Papers: 4.9K
Citations: 5
Cited Papers

Cited Papers

err1999-01-01
err0
PREAI
errJerry Goodstein; Robert Lyman Potter
errShare
errSave
Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT
err2021-06-15
err125
PREAI
errZhu, Xiaoyu; Luo, Yueyi; Liu, Anfeng; Bhuiyan, Md Zakirul Alam; Zhang, Shaobo
errShare
errSave
errShare
errSave
SnapShot: Dendritic Cells
errCell
IF0
err2011-08-01
err0
errOAAI
errJuliana Idoyaga; Ralph M. Steinman
errShare
errSave
Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
err2020-01-01
err215
errOAAI
errAlfakih, Taha; Hassan, Mohammad Mehedi; Gumaei, Abdu; Savaglio, Claudio; Fortino, Giancarlo
errShare
errSave
Deep Reinforcement Learning: A Brief Survey
err2017-11-01
err2.4K
errOAAI
errArulkumaran, Kai; Deisenroth, Marc Peter; Brundage, Miles; Bharath, Anil Anthony
errShare
errSave
Optical Anisotropy in Ramie Fibers
err1985-03-01
err0
PREAI
errT.Z.N. Sokkar; M.M. Shahin
errShare
errSave
researcher View more