Multimodal Vigilance Estimation Using Deep Learning

doi:10.1109/TCYB.2020.3022647

Multimodal Vigilance Estimation Using Deep Learning

2022-05-01

29

PRE

AI

DOI：10.1109/TCYB.2020.3022647

Original

Original request for help

Save

Abstract

En 中文

The phenomenon of increasing accidents caused by reduced vigilance does exist. In the future, the high accuracy of vigilance estimation will play a significant role in public transportation safety. We propose a multimodal regression network that consists of multichannel deep autoencoders with subnetwork neurons (MCDAE(sn)). After we define two thresholds of 0.35 and 0.70 from the percentage of eye closure, the output values are in the continuous range of 0-0.35, 0.36-0.70, and 0.71-1 representing the awake state, the tired state, and the drowsy state, respectively. To verify the efficiency of our strategy, we first applied the proposed approach to a single modality. Then, for the multimodality, since the complementary information between forehead electrooculography and electroencephalography features, we found the performance of the proposed approach using features fusion significantly improved, demonstrating the effectiveness and efficiency of our method.

Keywords:

Deep learning

dimension reduction

electroencephalography (EEG)

electrooculography (EOG)

multimodal vigilance estimation

Multimodal Vigilance Estimation Using Deep Learning

Abstract

AI Summary

Journal

Organization