arrow
Return

An Efficient Computing Offloading for Network Resources in IoT Big Data Using Deep Reinforcement Learning

delete2026-02-01
delete0
PRE
AI
M
Mohammad Hjouj Btoush
S
Sajid Mehmood
M
Mohammed A. Al Ghamdi
R
Rashid Amin *
M
Muhammad D. Zakaria
DOI:10.1002/spe.70057delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Background The fast growth of Internet of Things (IoT) ecosystems has created huge amounts of heterogeneous big data, imposing significant load on latency of network, energy usage of devices, and computation resources. The conventional cloud-centric architecture cannot support the high responsiveness needed by the current IoT applications owing to the high transmission latency and resource coordination inefficiency.Objective To overcome such constraints, this paper suggests a smart task offloading system that relies on a Deep Reinforcement Learning (DRL) system, which is implemented on an Advantage Actor-Critic (A2C) framework.Methods The offloading issue is modelled as a Markov Decision Process (MDP) and state variables that describe the characteristics of the tasks and the device battery, the channel and server usage. The A2C agent learns dynamically the best policies of splitting computation among device and edge layers, fog and cloud layers and jointly optimizes the latency, energy usage, and resource utilization. The system is tested with the help of a realistic simulation environment, including heterogeneous IoT devices, mobility, and stochastic wireless conditions.Results Experimental outcomes show that the proposed framework can reduce the average latency by up to 76 percent, and the energy consumption of the device level by 74 percent in comparison with the baseline strategies, such as, local execution, greedy offloading and DQN-based learning. The framework also enhances task completion rates on time constraints and the workload allocation across computing layers, which highly increase scalability, a robust system, and overall Quality of Service (QoS) in the large-scale deployment of IoT application.Conclusion The findings indicate the promise of the use of actor-critic DRL to assist the next-generation IoT applications across different fields including smart cities, healthcare monitoring, and industrial automation.
Keywords:
big data
deep reinforcement learning (DRL)
edge computing
energy efficiency
Internet of Things (IoT)
latency reduction
network resource optimization
task offloading

Journal

S
SOFTWARE-PRACTICE & EXPERIENCE
IF:
2.7
Papers:
48
Citations:
0

Organization

U
university of engineering & technology taxila
Scholars:
93
Papers: 57
Citations: 0
F
fahad bin sultan university
Scholars:
89
Papers: 120
Citations: 3
Umm al-Qura University cover
Umm al-Qura University
Scholars:
1.2K
Papers: 770
Citations: 6.8K
U
universiti sultan zainal abidin
Scholars:
395
Papers: 277
Citations: 9
researcher View more organizations
Cited Papers

Cited Papers

A QoS-Aware Technique for Computation Offloading in IoT-Edge Platforms Using a Convolutional Neural Network and Markov Decision Process
err2023-01-01
err31
PREAI
errHeidari, Arash; Jamali, Mohammad Ali Jabraeil; Navimipour, Nima Jafari; Akbarpour, Shahin
errShare
errSave
A comprehensive survey on reinforcement-learning-based computation offloading techniques in Edge Computing Systems
err2023-07-01
err24
errOAAI
errHortelano, Diego; de Miguel, Ignacio; Duran Barroso, Ramon J.; Carlos Aguado, Juan; Merayo, Noemi; Ruiz, Lidia; Asensio, Adrian; Masip-Bruin, Xavi; Fernandez, Patricia; Abril, Evaristo J.
errShare
errSave
errShare
errSave
Machine Learning in Real-Time Internet of Things (IoT) Systems: A Survey
err2022-06-01
err32
PREAI
errBian, Jiang; Al Arafat, Abdullah; Xiong, Haoyi; Li, Jing; Li, Li; Chen, Hongyang; Wang, Jun; Dou, Dejing; Guo, Zhishan
errShare
errSave
A Mixed-Integer Bi-Level Model for Joint Optimal Edge Resource Pricing and Provisioning
err2025-07-31
err0
PREAI
errDuong Thuy Anh Nguyen; Tarannum Nisha; Ni Trieu; Duong Tung Nguyen
errShare
errSave
Distributed computing in multi-agent systems: a survey of decentralized machine learning approaches
err2024-11-19
err2
PREAI
errAhmed, Ijaz; Syed, Miswar Akhtar; Maaruf, Muhammad; Khalid, Muhammad
errShare
errSave
researcher View more