arrow
返回

Deep Reinforcement Learning Acceleration for Real-Time Edge Computing Mixed Integer Programming Problems

delete2022-01-01
delete4
delete
OA
AI
G
Gerasimos Gerogiannis
M
Michael Birbas *
A
Aimilios Leftheriotis
E
Eleftherios Mylonas
N
Nikolaos Tzanis
A
Alexios Birbas
DOI:10.1109/ACCESS.2022.3147674delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this work, we present the design and implementation of an ultra-low latency Deep Reinforcement Learning (DRL) FPGA based accelerator for addressing hard real-time Mixed Integer Programming problems. The accelerator exhibits ultra-low latency performance for both training and inference operations, enabled by training-inference parallelism, pipelined training, on-chip weights and replay memory, multi-level replication-based parallelism and DRL algorithmic modifications such as distribution of training over time. The design principles can be extended to support hardware acceleration for other relevant DRL algorithms (embedding the experience replay technique) with hard real time constraints. We evaluate the accuracy of the accelerator in a task offloading and resource allocation problem stemming from a Mobile Edge Computing (MEC/5G) scenario. The design has been implemented on a Xilinx Zynq Ultrascale+ MPSoC ZCU104 evaluation kit using High Level Synthesis. The accelerator achieves near optimal performance and exhibits a 10-fold decrease in training-inference execution latency when compared to a high-end CPU-based implementation.
Keyword:
Training
Inference algorithms
Real-time systems
Artificial neural networks
Task analysis
Resource management
Field programmable gate arrays
Accelerator
deep reinforcement learning
edge computing
FPGA
high level synthesis
mixed integer programming
5G

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Patras
学者数:
1.2W
论文数: 9.6K
被引数: 8.4K
引用论文

引用论文

Long-term Quality of Life After Intensive Care Unit Admission (a Single-Center Observational Study)
err2021-04-29
err0
errOAAI
errC. Leggieri; L. Dezza; B. Oltolini; R. Lembo; B. Noto; S. M. Villa; A. Belletti; G. Lombardi; A. Battaini; E. Pedrini; C. F. Zuccato; A. Zangrillo
err分享
err收藏
Optimal treatment for women with a persisting pregnancy of unknown location, a randomized controlled trial: The ACT-or-NOT trial
err2018-10-01
err0
errOAAI
errKurt T. Barnhart; Mary D. Sammel; Mary Stephenson; Jared Robins; Karl R. Hansen; Wahid A. Youssef; Nanette Santoro; Esther Eisenberg; Heping Zhang
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
Analysis on smart material suitable for autogenous microelectronic application
err2019-08-30
err0
PREAI
errR Sitharthan; Manimaran Ponnusamy; Madurakavi Karthikeyan; D Shanmuga Sundar
err分享
err收藏
Ketenderivate, XIII. Stabile p‐Chinodimethane, I: Synthesen und Eigenschaften
err2006-01-21
err0
PREAI
errRudolf Gompper; Hans‐Ulrich Wagner; Eberhard Kutter
err分享
err收藏
学者 查看更多内容