arrow
返回

Adaptive Dynamic Programming for Multi-Driver Order Dispatching at Large-Scale

delete2024-04-01
delete2
PRE
AI
K
Kai Jiang
曹越 封面图
曹越 (Yue Cao) *
H
Huan Zhou
X
Xiangyu Wu
Z
Zhao Zhang
刘智 封面图
刘智 (Zhi Liu)
DOI:10.1109/TCCN.2023.3327578delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Order dispatching, which involves assigning orders to demand-matched vehicles, is an underlying issue for ride-sharing services. Previous works on order dispatching are often quasi-static and myopic 1, thus performing unsatisfactorily in the ride-sharing setting. To address these challenges, recent studies attempt to augment large-scale decision optimization from a data-driven perspective. Among them, Adaptive Dynamic Programming (ADP) has exhibited its particular potential for sequential decision-making with a long-term objective under uncertainty. In this paper, we investigate order dispatching with consideration of vehicle repositioning by exploiting ADP. We first formulate the optimization problem as a Markov Decision Process (MDP), where the dispatching decision is determined by a series of agents (the decision-making entity) under the time sequence model. Then, based on the generated available trips by a graph theory-based method, an ADP-based Multi-driver Order Dispatching method (AMOD) is proposed. In particular, AMOD reconstructs the Bellman update process around the post-decision states to avoid approximating the embedded expectations explicitly. As for non-linear function approximation, it converts the value function into a linear combination by a quadratic decomposition, and estimates the decomposed value function with neural network-based parameter approximation. In addition, vehicle repositioning is performed along with each batch dispatching to balance ride supply across geographic dimensions. Extensive simulations are conducted based on real-world data. Especially, AMOD can achieve 34.6% improvement at maximum and 15.9% on average compared with other baselines, when the capacity constraint is 10.
Keyword:
Dispatching
Vehicle dynamics
Decision making
Optimization
Adaptation models
Uncertainty
Real-time systems
Order dispatching
adaptive dynamic programming
graph theory
Markov decision process

期刊

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
论文数:
1.6K
被引数:
5.5K

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
T
Temple University
学者数:
1.1W
论文数: 8.8K
被引数: 1.9W
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
学者 查看更多机构
引用论文

引用论文

Prise en charge du risque hémostatique au cours des actes de radiologie interventionnelle
err2011-07-01
err0
PREAI
errJ. Potet; G. Weber-Donat; A. Thome; L. Valbousquet; E. Peroux; J. Konopacki; J. Baccialone; C.-A. Teriitehau
err分享
err收藏
err分享
err收藏
On Randomness and Structure in Euclidean TSP Instances: A Study With Heuristic Methods
err2021-01-01
err3
errOAAI
errCrisan, Gloria Cerasela; Nechita, Elena; Simian, Dana
err分享
err收藏
学者 查看更多内容