arrow
返回

Closing the loop in cortically-coupled computer vision: a brain-computer interface for searching image databases

delete2011-05-12
delete76
PRE
AI
E
Eric A. Pohlmeyer *
王娟 封面图
王娟 (Jun Wang)
D
David C. Jangraw
娄斌 封面图
娄斌 (Bin Lou)
S
Shih‐Fu Chang
P
Paul Sajda
DOI:10.1088/1741-2560/8/3/036025delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We describe a closed-loop brain-computer interface that re-ranks an image database by iterating between user generated 'interest' scores and computer vision generated visual similarity measures. The interest scores are based on decoding the electroencephalographic (EEG) correlates of target detection, attentional shifts and self-monitoring processes, which result from the user paying attention to target images interspersed in rapid serial visual presentation (RSVP) sequences. The highest scored images are passed to a semi-supervised computer vision system that reorganizes the image database accordingly, using a graph-based representation that captures visual similarity between images. The system can either query the user for more information, by adaptively resampling the database to create additional RSVP sequences, or it can converge to a 'done' state. The done state includes a final ranking of the image database and also a 'guess' of the user's chosen category of interest. We find that the closed-loop system's re-rankings can substantially expedite database searches for target image categories chosen by the subjects. Furthermore, better reorganizations are achieved than by relying on EEG interest rankings alone, or if the system were simply run in an open loop format without adaptive resampling.
Keyword:
FUNCTIONAL ELECTRICAL-STIMULATION
P300
STIMULUS
CLASSIFICATION
WHEELCHAIR
ALGORITHMS
COMPONENT
SIGNAL
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Neural Engineering 封面图
Journal of Neural Engineering
IF:
3.8
论文数:
4.0K
被引数:
1.4W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
引用论文

引用论文

Image potential near a dielectric–plasma‐like medium interface
err2006-02-07
err0
PREAI
errA. A. Kornyshev; A. I. Rubinshtein; M. A. Vorotyntsev
err分享
err收藏
fMRI brain-computer interfaces
err2008-01-01
err71
PREAI
errSitaram, Ranganatha; Weiskopf, Nikolaus; Caria, Andrea; Veit, Ralf; Erb, Michael; Birbaumer, Niels
err分享
err收藏
A postfabrication technique for identification of prosthetic devices
err1995-04-01
err0
PREAI
errFrederick A. Berry; G. Irving Logan; Roger Plata; Robert Riegel
err分享
err收藏
err分享
err收藏
学者 查看更多内容