arrow
返回

Wearable-based human flow experience recognition enhanced by transfer learning methods using emotion data

delete2023-11-01
delete7
delete
OA
AI
M
Muhammad Tausif Irshad *
F
Frédéric Li
M
Muhammad Adeel Nisar
X
Xinyu Huang
M
M. Buß
L
Leonie Kloep
C
Corinna Peifer
B
Barbara Kożusznik
A
Anita Pollak
A
Adrian Pyszka
O
Olaf Flak
M
Marcin Grzegorzek
DOI:10.1016/j.compbiomed.2023.107489delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Background: Flow experience is a specific positive and affective state that occurs when humans are completely absorbed in an activity and forget everything else. This state can lead to high performance, well-being, and productivity at work. Few studies have been conducted to determine the human flow experience using physiological wearable sensor devices. Other studies rely on self-reported data. Methods: In this article, we use physiological data collected from 25 subjects with multimodal sensing devices, in particular the Empatica E4 wristband, the Emotiv Epoc X electroencephalography (EEG) headset, and the Biosignalplux RespiBAN - in arithmetic and reading tasks to automatically discriminate between flow and non -flow states using feature engineering and deep feature learning approaches. The most meaningful wearable device for flow detection is determined by comparing the performances of each device. We also investigate the connection between emotions and flow by testing transfer learning techniques involving an emotion recognition-related task on the source domain. Results: The EEG sensor modalities yielded the best performances with an accuracy of 64.97%, and a macro Averaged F1 (AF1) score of 64.95%. An accuracy of 73.63% and an AF1 score of 72.70% were obtained after fusing all sensor modalities from all devices. Additionally, our proposed transfer learning approach using emotional arousal classification on the DEAP dataset led to an increase in performances with an accuracy of 75.10% and an AF1 score of 74.92%. Conclusion: The results of this study suggest that effective discrimination between flow and non-flow states is possible with multimodal sensor data. The success of transfer learning using the DEAP emotion dataset as a source domain indicates that emotions and flow are connected, and emotion recognition can be used as a latent task to enhance the performance of flow recognition.
Keyword:
Flow
Human flow experience
Wearable sensors
Multimodal sensing
Physiological responses
Machine learning
Deep learning
Transfer learning
Artificial neural network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Computers in Biology and Medicine 封面图
Computers in Biology and Medicine
IF:
6.3
论文数:
8.3K
被引数:
3.3W

机构

U
University of Silesia in Katowice
学者数:
4.0K
论文数: 4.2K
被引数: 3.5K
U
University of Economics in Katowice
学者数:
349
论文数: 312
被引数: 283
J
Jan Kochanowski University
学者数:
1.6K
论文数: 1.5K
被引数: 962
U
university of punjab
学者数:
6.2K
论文数: 5.0K
被引数: 7
U
University of Lubeck
学者数:
7.7K
论文数: 5.3K
被引数: 1.5W
学者 查看更多机构
引用论文

引用论文

Thieves of Flow: How Unfinished Tasks at Work are Related to Flow Experience and Wellbeing
err2019-07-08
err33
PREAI
errPeifer, Corinna; Syrek, Christine; Ostwald, Vivian; Schuh, Eva; Antoni, Conny H.
err分享
err收藏
err分享
err收藏
Psychophysiology of Flow During Piano Playing
errEMOTION
IF3.6
err2010-06-01
err249
PREAI
errde Manzano, Orjan; Theorell, Tores; Harmat, Laszlo; Ullen, Fredrik
err分享
err收藏
Test-retest reliability of cognitive EEG
err2000-03-01
err147
PREAI
errMcEvoy, LK; Smith, ME; Gevins, A
err分享
err收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容