arrow
Return

A robust operators' cognitive workload recognition method based on masked autoencoder

delete2024-10-01
delete2
PRE
AI
X
Xiaoqing Yu
C
Chun‐Hsien Chen *
DOI:10.1016/j.knosys.2024.112370delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Identifying the cognitive workload of operators is crucial in complex human-automation collaboration systems. An excessive workload can lead to fatigue or accidents, while an insufficient workload may diminish situational awareness and efficiency. However, existing supervised learning-based methods for workload recognition are ineffective when dealing with imperfect input data, such as missing or noisy data, which is not practical in real applications. This study introduces a robust Electroencephalogram (EEG)-enabled cognitive workload recognition model using self-supervised learning. The proposed method, DMAEEG, combines the training strategies of denoising autoencoders and masked autoencoders, demonstrating strong robustness against noisy and incomplete data. More specifically, we adopt the temporal convolutional network and multi-head self- attention mechanisms as the backbone, effectively capturing both the temporal and spatial features from EEG. Extensive experiments are conducted to verify the effectiveness and robustness of the proposed method on an open dataset and a self-collected dataset. The results indicate that DMAEEG performs superior to other state-of-the-art across various evaluation metrics. Moreover, DMAEEG maintains high accuracy in workload inference even when EEG signals are corrupted with a high masking ratio or strong noises. This signifies its superiority in capturing robust intrinsic patterns from imperfect EEG data. The proposed method significantly contributes to decoding EEG signals for workload recognition in real-world applications, thereby enhancing the safety and reliability of human-automation interactions.
Keywords:
Cognitive workload
EEG
Masked autoencoder
Robustness
Self-supervised learning

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
Cited Papers

Cited Papers

Hepatitis B virus reactivation or reinfection associated with HIV-1 infection
errAIDS
IF0
err1988-12-01
err0
PREAI
errJames Waite; Richard J.C. Gilson; Ian V.D. Weller; Charles J.N. Lacey; Milton H. Hambling; Anna Hawkins; Moya Briggs; Richard S. Tedder
errShare
errSave
Physical Activity Change during COVID-19 Confinement
err2020-09-21
err0
errOAAI
errArkaitz Castañeda-Babarro; Ane Arbillaga-Etxarri; Borja Gutiérrez-Santamaría; Aitor Coca
errShare
errSave
Ectopic Calcification as Discernible Manifestation in Neonates with Pseudohypoparathyroidism Type 1a
err2009-08-03
err0
errOAAI
errMasanori Adachi; Koji Muroya; Yumi Asakura; Yoichi Kondoh; Jun Ishihara; Tomonobu Hasegawa
errShare
errSave
The middle cerebral artery blood velocity response to acute normobaric hypoxia occurs independently of changes in ventilation in humans
err2021-02-11
err0
errOAAI
errSultan E. AlSalahi; Rehan T. Junejo; Chris Bradley; George M. Balanos; Christoph Siebenmann; James P. Fisher
errShare
errSave
errShare
errSave
Cognitive Workload Recognition Using EEG Signals and Machine Learning: A Review
err2022-09-01
err83
PREAI
errZhou, Yueying; Huang, Shuo; Xu, Ziming; Wang, Pengpai; Wu, Xia; Zhang, Daoqiang
errShare
errSave
researcher View more