arrow
Return

MOABB: trustworthy algorithm benchmarking for BCIs

delete2018-09-25
delete116
delete
OA
AI
V
Vinay Jayaram *
B
Barachant, Alexandre
DOI:10.1088/1741-2552/aadea0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Objective. Brain-computer interface (BCI) algorithm development has long been hampered by two major issues: small sample sets and a lack of reproducibility. We offer a solution to both of these problems via a software suite that streamlines both the issues of finding and preprocessing data in a reliable manner, as well as that of using a consistent interface for machine learning methods. Approach. By building on recent advances in software for signal analysis implemented in the MNE toolkit, and the unified framework for machine learning offered by the scikit-learn project, we offer a system that can improve BCI algorithm development. This system is fully open-source under the BSD licence and available at https://github.com/NeuroTechX/moabb. Main results. We analyze a set of state-of-the-art decoding algorithms across 12 open access datasets, including over 250 subjects. Our results show that even for the best methods, there are datasets which do not show significant improvements, and further that many previously validated methods do not generalize well outside the datasets they were tested on. Significance. Our analysis confirms that BCI algorithms validated on single datasets are not representative, highlighting the need for more robust validation in the machine learning for BCIs community.
Keywords:
brain-computer interfacing
EEG
machine learning
BCI
spatial filtering
CSP
software
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Neural Engineering cover
Journal of Neural Engineering
IF:
3.8
Papers:
4.0K
Citations:
1.4W

Organization

M
Max Planck Society
Scholars:
8.2W
Papers: 7.7W
Citations: 3.3W
Cited Papers

Cited Papers

Transfer Learning in Brain-Computer Interfaces
err2016-02-01
err330
errOAAI
errJayaram, Vinay; Alamgir, Morteza; Altun, Yasemin; Schoelkopf, Bernhard; Grosse-Wentrup, Moritz
errShare
errSave
Interactions of Lemon, Sucrose and Citric Acid in Enhancing Citrus, Sweet and Sour Flavors
err2017-10-09
err0
errOAAI
errMaria G Veldhuizen; Ashik Siddique; Sage Rosenthal; Lawrence E Marks
errShare
errSave
BCILAB: a platform for brain-computer interface development
err2013-08-28
err291
errOAAI
errKothe, Christian Andreas; Makeig, Scott
errShare
errSave
MEG and EEG data analysis with MNE-Python
err2013-01-01
err2.0K
errOAAI
errGramfort, Alexandre; Luessi, Martin; Larson, Eric; Engemann, Denis A.; Strohmeier, Daniel; Brodbeck, Christian; Goj, Roman; Jas, Mainak; Brooks, Teon; Parkkonen, Lauri; Haemaelaeinen, Matti
errShare
errSave
errShare
errSave
Dysregulation of Presynaptic Calcium and Synaptic Plasticity in a Mouse Model of 22q11 Deletion Syndrome
err2010-11-24
err0
errOAAI
errLaurie R. Earls; Ildar T. Bayazitov; Robert G. Fricke; Raymond B. Berry; Elizabeth Illingworth; Guy Mittleman; Stanislav S. Zakharenko
errShare
errSave
researcher View more