Return
Beyond VisionMask: Explaining Reinforcement Learning Via Contrastive-State Masking
DOI:10.1109/mis.2026.3683960.png)
Abstract
En 中文
Existing explainable reinforcement learning (RL) approaches often fail to capture the contrastive nature of human reasoning—answering “why this action instead of that one?”. To address this challenge, we present Continuous VisionMask (cVM), a contrastive learning framework that explains RL agents in continuous state and action spaces. cVM extends our prior work, VisionMask, which was restricted to vision-based discrete settings, by introducing a quantized representation of continuous state and a set of contrastive learning objectives. This generalization enables cVM to provide faithful, robust, and sparse attributions highlighting which aspects of the sensed input are most important for the agent’s decision making, and to do so across a broader range of real-world RL scenarios. We evaluate cVM in multiple continuous-control environments and compare it against existing explainability baselines. Our results demonstrate that cVM produces more faithful and stable explanations, thereby enhancing transparency and interpretability in continuous RL systems.
Keywords:
Deep reinforcement learning
Reinforcement learning
Laser radar
Contrastive learning
Machine intelligence
Artificial intelligence
Computer vision
Training data
Quality assessment
Agent-based modeling
Journal
IF:
6.1
Papers:
1.6K
Citations:
4.5K

