arrow
Return

On Sequential Fault-Intolerant Process Planning

delete2026-01-01
delete0
PRE
AI
A
Andrzej Kaczmarczyk *
D
Davin Choo
N
Niclas Boehmer
M
Milind Tambe
H
Haifeng Xu
DOI:10.1007/978-3-032-08067-7_14delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose and study a planning problem called Sequential Fault-Intolerant Process Planning (SFIPP). SFIPP captures a reward structure common in many sequential multi-stage decision problems where the planning is deemed successful only if all stages succeed. Such reward structures differ from classic additive reward ones and arise in important applications such as security, drug/material discovery, and quality-critical product design. We design provably tight online algorithms for settings in which one needs to pick between different actions with unknown success chances at each stage. We do so both for the foundational case in which the behavior of actions is deterministic and for the case of probabilistic action outcomes. In the latter, we effectively balance exploration for learning and exploitation for planning by applying multi-armed bandit algorithms. We further specialize our algorithms exploiting additional information about the structure of the SFIPP instance and empirically demonstrate that they outperform our general algorithm.
Keywords:
Sequential decision making
Planning under uncertainty

Journal

G
GAME THEORY AND AI FOR SECURITY, GAMESEC 2025, PT II
IF:
0
Papers:
16
Citations:
0

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
U
university of potsdam
Scholars:
804
Papers: 424
Citations: 2
U
university of chicago
Scholars:
4.4W
Papers: 3.7W
Citations: 80
researcher View more organizations