arrow
返回

Data augmentation for Convolutional LSTM based brain computer interface system

delete2022-06-01
delete4
delete
OA
AI
Z
Zhe Sun *
J
Jordi Solé‐Casals *
A
Andrzej Cichocki
A
Anh Huy Phan
Q
Qibin Zhao
H
Hui‐Hai Zhao
S
Shangkun Deng
R
Ruggero Micheletto *
DOI:10.1016/j.asoc.2022.108811delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Electroencephalogram (EEG) is a noninvasive method to detect spatio-temporal electric signals in human brain, actively used in the recent development of Brain Computer Interfaces (BCI). EEG's patterns are affected by the task, but also other variable factors influence the subject focus on the task and result in noisy EEG signals difficult to decipher. To surpass these limitations methods based on artificial neural networks (ANNs) are used, they are inherently robust to noise and do not require models. However, they learn from examples and require lots of training data-sets. This will increase costs, need research time and subjects effort. To reduce the number of experiments necessary for network training, we devised a methodology to provide artificial data from a limited number of training data-sets. This was done by applying Empirical Mode Decomposition (EMD) on the EEG frames and intermixing their Intrinsic Mode Function (IMFs). We experimented on motor imagery (MI) tests where participants were asked to imagine movement of the left (or right) arm while under EEG recording. The EEG data were firstly transformed using the Morlet wavelet and then fed to an originally designed Convolutional Neural Network (CNN) with long short term memory blocks (LSTM-RNN). The introduction of artificial frames improved performances when compared with standard algorithms. The artificial frames become advantageous even when the number of available real frames was only of 7 or 8. In a test with two subjects (200 recordings for each subject), we reached an accuracy better than 88% for both subjects. Improvements due to the artificial data were especially noticeable for the under-performing subject, whose EEG had lower accuracy. Imagination recognition accuracy was about 89% with 360 training frames, in which 300 were artificially created starting from 60 real ones. We believe this methodology of synthesizing artificial data may contribute to the development of novel and more efficient ways to train neural networks for brain computer interfaces.(C) 2022 Elsevier B.V. All rights reserved.
Keyword:
Convolutional LSTM neural network
Data augmentation
Brain computer interface
Empirical Mode Decomposition
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

A
alibaba group
学者数:
1.1K
论文数: 789
被引数: 0
Y
Yokohama City University
学者数:
8.1K
论文数: 6.3K
被引数: 6.3K
S
skolkovo institute of science & technology
学者数:
3.3K
论文数: 2.3K
被引数: 1
C
china three gorges university
学者数:
1.1W
论文数: 6.1K
被引数: 114
R
riken
学者数:
2.2W
论文数: 1.9W
被引数: 24
学者 查看更多机构
引用论文

引用论文

Deep Learning With Convolutional Neural Networks for EEG Decoding and Visualization
err2017-08-07
err2.0K
errOAAI
errSchirrmeister, Robin Tibor; Springenberg, Jost Tobias; Fiederer, Lukas Dominique Josef; Glasstetter, Martin; Eggensperger, Katharina; Tangermann, Michael; Hutter, Frank; Burgard, Wolfram; Ball, Tonio
err分享
err收藏
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfacesEEGNet: 用于基于EEG的脑机接口的紧凑型卷积神经网络
err2018-07-27
err2.0K
errOAAI
errLawhern, Vernon J.; Solon, Amelia J.; Waytowich, Nicholas R.; Gordon, Stephen M.; Hung, Chou P.; Lance, Brent J.
err分享
err收藏
A Novel Deep Learning Approach With Data Augmentation to Classify Motor Imagery Signals
err2019-01-01
err165
errOAAI
errZhang, Zhiwen; Duan, Feng; Sole-Casals, Jordi; Dinares-Ferran, Josep; Cichocki, Andrzej; Yang, Zhenglu; Sun, Zhe
err分享
err收藏
学者 查看更多内容