arrow
Return

Brain-Eye Collaborative Camouflaged Target Detection

delete2025-07-02
delete0
PRE
AI
L
L. Ma *
W
Weichen Dai
Z
Ziyue Yang *
C
Chenyi Hong
J
Jianan Han
J
Jianting Cao
W
Wanzeng Kong *
DOI:10.1080/10447318.2025.2513031delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Brain-computer interface (BCI) based on rapid serial visual presentation (RSVP) are widely applied in target detection but suffer from low decoding accuracy. While some methods integrate eye movements to improve localization, they often underutilize EEG’s coarse spatial cues, limiting overall detection effectiveness. We propose a brain-eye collaborative method for camouflaged target detection that integrates EEG and eye movement signals in a coarse-to-fine framework. In the coarse stage, target presence and its image quadrant are determined using brain-eye fusion and contrastive learning on bimodal features. This leverages complementary spatiotemporal information from both modalities to generate a coarse localization region. In the fine stage, eye movement data further refines the target location within this region by identifying high-interest areas. This collaborative approach significantly improves both recognition and localization performance in complex visual search tasks. Our method achieves an F1 score of 83.16% and a balanced accuracy of 85.38%, outperforming existing state-of-the-art methods.
Keywords:
Brain–computer interface (BCI)
camouflaged target detection
rapid serial visual presentation (RSVP)
contrast learning
multimodal interaction

Journal

I
International Journal of Human-Computer Interaction
IF:
4.9
Papers:
4.3K
Citations:
1.2W

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.5K
Citations: 7.5K
Saitama Institute of Technology cover
Saitama Institute of Technology
Scholars:
8
Papers: 8
Citations: 98