返回
Dynamic Task Allocation for Robotic Edge System Resilience Using Deep Reinforcement Learning
DOI:10.1109/TSMC.2023.3327959.png)
摘要
En 中文
Incorporating edge and cloud computing with robotics provides extended options for robots to perform real-time sensing and actuation operations in various cyber-physical systems (CPSs), including smart farms. Such systems are prone to uncertain failures triggered by mechanical disruptions. Consequently, the overall system performance degrades, primarily when location-specific tasks are already assigned to a faulty robot and require immediate recovery. Using edge and cloud computing resources is not always feasible due to communication and latency constraints. Therefore, this article exclusively focuses on harnessing the mobility of robots to support the computation tasks affected by uncertain failures of previously assigned robots and ensure faster resiliency management by relocating active robots near task sources. The proposed mobility-as-a-resilience-service (MaaRS) is formulated using a Markov decision process (MDP). Later, an edge server proximal to the robots is trained using deep reinforcement learning (DRL) to assign tasks among the robots. Specifically, a multiple deep $Q$ -network (MDQN)-based dynamic task allocation mechanism is proposed to converge to a solution exploring reward uncertainties with the best exploitation. Numerical evaluation using Python and TensorFlow validates the effectiveness of the proposed approach compared to other benchmarks.
Keyword:
Deep reinforcement learning (DRL)
edge computing
multirobot system
smart farming
task allocation
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
A Reinforcement Learning-Based Resource Allocation Scheme for Cloud Robotics一种基于强化学习的云机器人资源分配方案
IEEE ACCESS
IF3.6
Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach移动边缘计算的智能资源分配: 一种深度强化学习方法
QoS-Aware Cooperative Computation Offloading for Robot Swarms in Cloud Robotics云机器人中基于QoS感知的机器人群协同计算卸载
The Extended Cloud: Review and Analysis of Mobile Edge Computing and Fog From a Security and Resilience Perspective扩展云: 从安全和弹性角度回顾和分析移动边缘计算和雾
Energy-efficient optimal task offloading in cloud networked multi-robot systems云网络化多机器人系统节能优化任务卸载
COMPUTER NETWORKS
IF4.6

