.png){kind=icon}
返回
A Deep Reinforcement Learning-Based Dynamic Computational Offloading Method for Cloud Robotics
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3073902.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Robots come with a variety of computing capabilities, and running computationally-intense applications on robots is sometimes challenging on account of limited onboard computing, storage, and power capabilities. Meanwhile, cloud computing provides on-demand computing capabilities, and thus combining robots with cloud computing can overcome the resource constraints robots face. The key to effectively offloading tasks is an application solution that does not underutilize the robot's own computational capabilities and makes decisions based on crucial cost parameters such as latency and CPU availability. In this paper, we formulate the application offloading problem as a Markovian decision process and propose a deep reinforcement learning-based deep Q-network (DQN) approach. The state-space is formulated with the assumption that input data size directly impacts application execution time. The proposed algorithm is designed as a continuous task problem with discrete action space; i.e., we apply a choice of action at each time step and use the corresponding outcome to train the DQN to acquire the maximum rewards possible. To validate the proposed algorithm, we designed and implemented a robot navigation testbed. The results demonstrated that for the given state-space values, the proposed algorithm learned to take appropriate actions to reduce application latency and also learned a policy that takes actions based on input data size. Finally, we compared the proposed DQN algorithm with a long short-term memory (LSTM) algorithm in terms of accuracy. When trained and validated on the same dataset, the proposed DQN algorithm obtained at least 9 percentage points greater accuracy than the LSTM algorithm.
Keyword:
Robots
Heuristic algorithms
Cloud computing
Robot sensing systems
Task analysis
Reinforcement learning
Mobile handsets
Cloud robotics
deep reinforcement learning
deep Q-networks (DQN)
AWS
neural networks
application offloading
robot navigation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Does it take older adults longer than younger adults to perceptually segregate a speech target from a background masker?在感知上将语音目标与背景掩蔽器隔离开来是否需要老年人比年轻人更长的时间？
PREAI
分享收藏分享收藏A Reinforcement Learning-Based Resource Allocation Scheme for Cloud Robotics一种基于强化学习的云机器人资源分配方案.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏A Survey of Multi-Access Edge Computing in 5G and Beyond: Fundamentals, Technology Integration, and State-of-the-ArtIEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Intelligent task prediction and computation offloading based on mobile-edge cloud computing基于移动边缘云计算的智能任务预测与计算卸载
PREAI
分享收藏
查看更多内容