.png){kind=icon}
返回
Privacy-Aware Multiagent Deep Reinforcement Learning for Task Offloading in VANET
.png){kind=icon}
PRE
AI
DOI：10.1109/TITS.2022.3202196.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Offloading task to roadside units (RSUs) provides a promising solution for enhancing the real-time data processing capacity and reducing energy consumption of vehicles in the vehicular ad-hoc network (VANET). Recently, multi-agent deep reinforcement learning (MADRL)-based offloading approaches have been widely used for task offloading in VANET. However, existing MADRL-based approaches suffer from offloading preference inference (OPI) attack, which utilizes the vulnerability in the policy learning process of MADRL to mislead vehicles to offload tasks to malicious RSUs. In this paper, we first formulate a joint optimization of offloading action and transmitting power with the objective of minimizing the system cost, including local and edge costs, under the privacy requirement of protecting offloading preference during offloading policy learning process in VANET. Despite the non-convexity and centralized of this joint optimization problem, we propose a privacy-aware MADRL (PA-MADRL) approach to solve it, which can allow the offload decision of each vehicle to reach the Nash Equilibrium (NE) without leaking offloading preference. The key to resisting the OPI attack is to protect the offloading preference by 1)elaborately constructing the noise based on (beta, Phi)-differential privacy mechanism and 2) adding it to the action selection and policy updating process of vanilla MADRL. We conduct a detailed theoretical analysis of the convergence and privacy guarantee of the proposed PA-MADRL, and extensive simulations are conducted to demonstrate the effectiveness, privacy-protecting capacity, and cost-efficiency of PA-MADRL approach.
Keyword:
Vehicular ad-hoc network
task offloading
multi-agent deep reinforcement learning
offloading preference inference attack
期刊
IF:
8.4
论文数:
9.7K
被引数:
6.3W
机构
引用论文
.png){kind=icon}
分享收藏Load Balance Guaranteed Vehicle-to-Vehicle Computation Offloading for Min-Max Fairness in VANETs
PREAI
分享收藏Self-Learning Based Computation Offloading for Internet of Vehicles: Model and Algorithm基于自学习的车联网计算卸载模型与算法
PREAI
分享收藏Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids
OAAI
OAAI分享收藏
查看更多内容