arrow
返回

Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning

delete2024-09-01
delete1
delete
OA
AI
J
Jing Tan *
R
Ramin Khalili
H
Holger Karl
DOI:10.1109/TITS.2024.3378007delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Intelligent Transportation System (ITS) environment is known to be dynamic and distributed, where participants (vehicle users, operators, etc.) have multiple, changing and possibly conflicting objectives. Although Reinforcement Learning (RL) algorithms are commonly applied to optimize ITS applications such as resource management and offloading, most RL algorithms focus on single objectives. In many situations, converting a multi-objective problem into a single-objective one is impossible, intractable or insufficient, making such RL algorithms inapplicable. We propose a multi-objective, multi-agent reinforcement learning (MARL) algorithm with high learning efficiency and low computational requirements, which automatically triggers adaptive few-shot learning in a dynamic, distributed and noisy environment with sparse and delayed reward. We test our algorithm in an ITS environment with edge cloud computing. Empirical results show that the algorithm is quick to adapt to new environments and performs better in all individual and system metrics compared to the state-of-the-art benchmark. Our algorithm also addresses various practical concerns with its modularized and asynchronous online training method. In addition to the cloud simulation, we test our algorithm on a single-board computer and show that it can make inference in 6 milliseconds.
Keyword:
Heuristic algorithms
Computational modeling
Vehicle dynamics
Resource management
Optimization
Inference algorithms
Complexity theory
V2X
distributed systems
reinforcement learning
multi-objective

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

U
University of Potsdam
学者数:
7.8K
论文数: 7.1K
被引数: 1.4W
引用论文

引用论文

err分享
err收藏
Fourier transform spectrum of the torsional band of hydrazine
err1986-05-01
err0
PREAI
errNobukimi Ohashi; Walter J. Lafferty; W.Bruce Olson
err分享
err收藏
Dynamic Pricing for Intelligent Transportation System in the 6G Unlicensed Band
err2022-07-01
err14
PREAI
errBajracharya, Rojeena; Shrestha, Rakesh; Hassan, Syed Ali; Konstantin, Kostromitin; Jung, Haejoon
err分享
err收藏
err分享
err收藏
Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution
err2021-04-01
err262
PREAI
errNing, Zhaolong; Zhang, Kaiyuan; Wang, Xiaojie; Guo, Lei; Hu, Xiping; Huang, Jun; Hu, Bin; Kwok, Ricky Y. K.
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
学者 查看更多内容