Dynamic Decision Making With Individualized Variable Selection

doi:10.1080/01621459.2025.2555060

Dynamic Decision Making With Individualized Variable Selection

2026-08-19

0

PRE

AI

Donald M. Lloyd‐Jones

DOI：10.1080/01621459.2025.2555060

Original

Original request for help

Save

Abstract

En 中文

Physicians today have access to a variety of tests for diagnosing and prognosticating medical conditions. Ideally, they would apply a high-quality prediction model using all relevant features to facilitate appropriate decision-making (e.g., treatment selection; risk assessment). However, some of these features incur additional costs and are not readily available to patients and physicians. In practice, predictors are typically gathered sequentially, that is, physicians continually evaluate information dynamically until sufficient information is acquired to make a reasonable confidence decision. More importantly, the prospective information to collect may differ for each patient and depend on the predictor values already known. In this article, we design a novel adaptive prediction rule to determine the optimal order of acquiring features in predicting a clinical outcome of interest. The objective is to maximize prediction accuracy while minimizing the cost associated with measuring features for individual subjects. To achieve this, we employ reinforcement learning, where the agent decides the best action at each step: either making a final clinical decision or continuing to collect new predictors based on the current state of knowledge. Extensive simulation studies have been conducted to evaluate the efficacy of the proposed strategy. Additionally, real examples are presented to illustrate the practical utility. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Keywords:

Individualized variable selection

Precision medicine

Q-learning

Reinforcement learning

Dynamic Decision Making With Individualized Variable Selection

Abstract

Journal

Organization

Cited Papers