arrow
Return

Closed-loop EEG study on visual recognition during driving

delete2021-02-26
delete5
delete
OA
AI
R
Ruslan Aydarkhanov *
M
Marija Ušćumlić
R
Ricardo Chavarriaga
L
Lucian Gheorghe
J
José del R. Millán
DOI:10.1088/1741-2552/abdfb2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Objective. In contrast to the classical visual brain-computer interface (BCI) paradigms, which adhere to a rigid trial structure and restricted user behavior, electroencephalogram (EEG)-based visual recognition decoding during our daily activities remains challenging. The objective of this study is to explore the feasibility of decoding the EEG signature of visual recognition in experimental conditions promoting our natural ocular behavior when interacting with our dynamic environment. Approach. In our experiment, subjects visually search for a target object among suddenly appearing objects in the environment while driving a car-simulator. Given that subjects exhibit an unconstrained overt visual behavior, we based our study on eye fixation-related potentials (EFRPs). We report on gaze behavior and single-trial EFRP decoding performance (fixations on visually similar target vs. non-target objects). In addition, we demonstrate the application of our approach in a closed-loop BCI setup. Main results. To identify the target out of four symbol types along a road segment, the BCI system integrated decoding probabilities of multiple EFRP and achieved the average online accuracy of 0.37 +/- 0.06 (12 subjects), statistically significantly above the chance level. Using the acquired data, we performed a comparative study of classification algorithms (discriminating target vs. non-target) and feature spaces in a simulated online scenario. The EEG approaches yielded similar moderate performances of at most 0.6 AUC, yet statistically significantly above the chance level. In addition, the gaze duration (dwell time) appears to be an additional informative feature in this context. Significance. These results show that visual recognition of sudden events can be decoded during active driving. Therefore, this study lays a foundation for assistive and recommender systems based on the driver's brain signals.
Keywords:
brain– computer interfaces
electroencephalography
eye tracking
driving
visual recognition

Journal

Journal of Neural Engineering cover
Journal of Neural Engineering
IF:
3.8
Papers:
4.0K
Citations:
1.4W

Organization

E
Ecole Polytechnique Federale de Lausanne
Scholars:
1.7W
Papers: 1.3W
Citations: 25
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
Z
Zurich University of Applied Sciences
Scholars:
2.2K
Papers: 1.6K
Citations: 2
researcher View more organizations
Cited Papers

Cited Papers

Electrophysiology-based detection of emergency braking intention in real-world driving
err2014-08-11
err102
errOAAI
errHaufe, Stefan; Kim, Jeong-Woo; Kim, Il-Hwa; Sonnleitner, Andreas; Schrauf, Michael; Curio, Gabriel; Blankertz, Benjamin
errShare
errSave
Towards Independence: A BCI Telepresence Robot for People With SevereMotor Disabilities
err2015-06-01
err145
errOAAI
errLeeb, Robert; Tonin, Luca; Rohm, Martin; Desideri, Lorenzo; Carlson, Tom; Millan, Jose del R.
errShare
errSave
Decoding Neural Correlates of Cognitive States to Enhance Driving Experience
err2018-08-01
err20
errOAAI
errChavarriaga, Ricardo; Uscumlic, Marija; Zhang, Huaijian; Khaliliardali, Zahra; Aydarkhanov, Ruslan; Saeedi, Sareh; Gheorghe, Lucian; Millan, Jose del R.
errShare
errSave
A fully automated correction method of EOG artifacts in EEG recordings
err2007-01-01
err447
PREAI
errSchloegl, A.; Keinrath, C.; Zimmermann, D.; Scherer, R.; Leeb, R.; Pfurtscheller, G.
errShare
errSave
researcher View more