Return
Increasing visual uncertainty modulates multisensory decision-making
DOI:10.1016/j.cortex.2025.11.005.png)
Abstract
En 中文
The brain integrates and transforms information from multiple senses to make optimal decisions, a process that is critical for navigating complex environments with perceptual uncertainty. Despite a growing consensus that individuals adapt flexibly to uncertain sensory input, whether increasing visual uncertainty influences the decision process itself or other, non-decision sensory processes during multisensory decision-making are unclear. Here, an audiovisual categorization task was used to examine the responses of human participants (N = 30) to visual and audiovisual stimuli under low-, medium-, and high-uncertainty conditions. Modeling the behavioral data using a drift‒diffusion model indicated that increased visual uncertainty in the audiovisual context decreased the evidence accumulation rate but had no effect on non-decision processes. Electrophysiological recordings confirmed and expanded upon these results: increased visual uncertainty in the audiovisual context reduced the amplitude during the late decision-making stage (300–380 ms) but had no effect on the amplitude during the early sensory encoding stage (140–220 ms). More importantly, electroencephalography (EEG) analyses revealed that audiovisual integration in the early sensory encoding stage occurred robustly across all visual uncertainty conditions, whereas audiovisual integration in the late stage occurred only under medium and high visual uncertainty conditions. This study demonstrated that increased visual uncertainty modulates the decision process itself rather than early sensory encoding during multisensory decision-making. Moreover, multisensory integration strategies dynamically adapt to increasing visual uncertainty by engaging different mechanisms to maintain effective decision-making.
Keywords:
multisensory decision-making
visual uncertainty
audiovisual integration
event-related potential
drift‒diffusion model
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

