.png){kind=icon}
返回
Temporal Relation Modeling and Multimodal Adversarial Alignment Network for Pilot Workload Evaluation
.png){kind=icon}
OA
AI
DOI：10.1109/JTEHM.2025.3542408.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pilots face complex working environments during flight missions, which can easily lead to excessive workload and affect flight safety. Physiological signals are commonly used to evaluate a pilot's workload because they are objective and can directly reflect physiological mental states. However, existing methods have shortcomings in temporal modeling, making it challenging to fully capture the dynamic characteristics of physiological signals over time. Moreover, fusing features of data from different modalities is also difficult.To address these problems, we proposed a temporal relation modeling and multimodal adversarial alignment network (TRM-MAAN) for pilot workload evaluation. Specifically, a Transformer-based temporal relationship modeling module was used to learn complex temporal relationships for better feature extraction. In addition, an adversarial alignment-based multi-modal fusion module was applied to capture and integrate multi-modal information, reducing distribution shifts between different modalities. The performance of the proposed TRM-MAAN method was evaluated via experiments of classifying three workload states using electroencephalogram (EEG) and electromyography (EMG) recordings of eight healthy pilots.Experimental results showed that the classification accuracy and F1 score of the proposed method were significantly better than the baseline model across different subjects, with an average recognition accuracy of 91.90 +/- 1.72% and an F1 score of 91.86 +/- 1.75% .This work provides essential technical support for improving the accuracy and robustness of pilot workload evaluation and introduces a promising way for enhancing flight safety, offering broad application prospects. Clinical and Translational Impact Statement: The proposed scheme provides a promising solution for workload evaluation based on electrophysiological signals, with potential applications in aiding the clinical monitoring of fatigue, mental status, cognitive psychology, and other disorders.
Keyword:
Feature extraction
Electroencephalography
Brain modeling
Electromyography
Psychology
Safety
Biomedical monitoring
Transformers
Physiology
Accuracy
Pilot workload evaluation
transformer
adversarial alignment
electroencephalogram
electromyography
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
4.4
论文数:
580
被引数:
1.7K
机构
引用论文
Hypercomplex Multimodal Emotion Recognition from EEG and Peripheral Physiological Signals.png)
2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)
OAAI
2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)IF0
OAAI分享收藏Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) network递归神经网络 (RNN) 和长短期记忆 (LSTM) 网络的基本原理OAAI
OAAI分享收藏The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload
PREAI
分享收藏Continuous EEG Decoding of Pilots' Mental States Using Multiple Feature Block-Based Convolutional Neural NetworkIEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical ResearchNASA-TLX (任务负荷指数) 的发展: 经验和理论研究的结果
PREAI
分享收藏分享收藏
查看更多内容