arrow
返回

Brain-Computer Interface Integrated With Augmented Reality for Human-Robot Interaction

delete2023-12-01
delete20
PRE
AI
B
Bin Fang
W
Wenlong Ding
孙富春 封面图
孙富春 (Fuchun Sun) *
J
Jianhua Shan *
X
Xiaojia Wang
王
王赪胤 (Chengyin Wang)
X
Xinyu Zhang
DOI:10.1109/TCDS.2022.3194603delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Brain-computer interface (BCI) has been gradually used in human-robot interaction systems. Steady-state visual evoked potential (SSVEP) as a paradigm of electroencephalography (EEG) has attracted more attention in the BCI system research due to its stability and efficiency. However, an independent monitor is needed in the traditional SSVEP-BCI system to display stimulus targets, and the stimulus targets map fixedly to some preset commands. These limit the development of the SSVEP-BCI application system in complex and changeable scenarios. In this study, the SSVEP-BCI system integrated with augmented reality (AR) is proposed. Furthermore, a stimulation interface is made by merging the visual information of the objects with stimulus targets, which can update the mapping relationship between stimulus targets and objects automatically to adapt to the change of the objects in the workspace. During the online experiment of the AR-based SSVEP-BCI cue-guided task with the robotic arm, the success rate of grasping is 87.50 +/- 3.10% with the SSVEP-EEG data recognition time of 0.5 s based on FB-tCNN. The proposed AR-based SSVEP-BCI system enables the users to select intention targets more ecologically and can grasp more kinds of different objects with a limited number of stimulus targets, resulting in the potential to be used in complex and changeable scenarios.
Keyword:
Augmented reality (AR)
brain-computer interface (BCI) system
FB-tCNN
human-robot interaction
steady-state visual evoked potential (SSVEP)
stimulation interface
visual information

期刊

IEEE Transactions on Cognitive and Developmental Systems 封面图
IEEE Transactions on Cognitive and Developmental Systems
IF:
4.9
论文数:
1.1K
被引数:
3.5K

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
A
anhui university of technology
学者数:
9.6K
论文数: 5.6K
被引数: 9
C
Clemson University
学者数:
1.3W
论文数: 1.1W
被引数: 1.4W
学者 查看更多机构
引用论文

引用论文

Restoring thrusting in the East Greenland Caledonides
err2000-11-01
err0
PREAI
errA.K. Higgins; A.G. Leslie
err分享
err收藏
Study on Intervention Mechanism of Yiqi Huayu Jiedu Decoction on ARDS Based on Network Pharmacology
err2020-08-11
err0
errOAAI
errXu Liang; Changyong Luo; Yan Li; Xin Li; Qian Wang; Shujing Zhang; Qingqiao Sun; Yuanhong Ma; Caihua Xiong; Yanpeng Zeng
err分享
err收藏
SSVEP Stimulus Layout Effect on Accuracy of Brain-Computer Interfaces in Augmented Reality Glasses
err2020-01-01
err38
errOAAI
errZhao, Xincan; Liu, Chenyang; Xu, Zongxin; Zhang, Lipeng; Zhang, Rui
err分享
err收藏
Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain-computer interfacing
err2013-04-18
err97
errOAAI
errManyakov, Nikolay V.; Chumerin, Nikolay; Robben, Arne; Combaz, Adrien; van Vliet, Marijn; Van Hulle, Marc M.
err分享
err收藏
err分享
err收藏
学者 查看更多内容