arrow
Return

Beyond VisionMask: Explaining Reinforcement Learning Via Contrastive-State Masking

delete2026-08-19
delete0
PRE
AI
R
Rui Zuo
S
Simon Khan
Z
Zifan Wang
G
Garrett E. Katz
Q
Qinru Qiu
DOI:10.1109/mis.2026.3683960delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing explainable reinforcement learning (RL) approaches often fail to capture the contrastive nature of human reasoning—answering “why this action instead of that one?”. To address this challenge, we present Continuous VisionMask (cVM), a contrastive learning framework that explains RL agents in continuous state and action spaces. cVM extends our prior work, VisionMask, which was restricted to vision-based discrete settings, by introducing a quantized representation of continuous state and a set of contrastive learning objectives. This generalization enables cVM to provide faithful, robust, and sparse attributions highlighting which aspects of the sensed input are most important for the agent’s decision making, and to do so across a broader range of real-world RL scenarios. We evaluate cVM in multiple continuous-control environments and compare it against existing explainability baselines. Our results demonstrate that cVM produces more faithful and stable explanations, thereby enhancing transparency and interpretability in continuous RL systems.
Keywords:
Deep reinforcement learning
Reinforcement learning
Laser radar
Contrastive learning
Machine intelligence
Artificial intelligence
Computer vision
Training data
Quality assessment
Agent-based modeling

Journal

IEEE Intelligent Systems cover
IEEE Intelligent Systems
IF:
6.1
Papers:
1.6K
Citations:
4.5K

Organization

S
syracuse university
Scholars:
1.0K
Papers: 476
Citations: 0
U
U.S. Air Force Research Laboratory
Scholars:
13
Papers: 4
Citations: 0