arrow
Return

Cognitive Load-Based Affective Workload Allocation for Multihuman Multirobot Teams

delete2025-02-01
delete0
delete
OA
AI
W
Wonse Jo
R
Ruiqi Wang
B
Baijian Yang
D
Dan Foti
M
Mo Rastgaar
B
Byung‐Cheol Min *
DOI:10.1109/THMS.2024.3509223delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The interaction and collaboration between humans and multiple robots represent a novel field of research known as human multirobot systems. Adequately designed systems within this field allow teams composed of both humans and robots to work together effectively on tasks, such as monitoring, exploration, and search and rescue operations. This article presents a deep reinforcement learning-based affective workload allocation controller specifically for multihuman multirobot teams. The proposed controller can dynamically reallocate workloads based on the performance of the operators during collaborative missions with multirobot systems. The operators' performances are evaluated through the scores of a self-reported questionnaire (i.e., subjective measurement) and the results of a deep learning-based cognitive workload prediction algorithm that uses physiological and behavioral data (i.e., objective measurement). To evaluate the effectiveness of the proposed controller, we conduct an exploratory user experiment with various allocation strategies. The user experiment uses a multihuman multirobot CCTV monitoring task as an example and carry out comprehensive real-world experiments with 32 human subjects for both quantitative measurement and qualitative analysis. Our results demonstrate the performance and effectiveness of the proposed controller and highlight the importance of incorporating both subjective and objective measurements of the operators' cognitive workload as well as seeking consent for workload transitions, to enhance the performance of multihuman multirobot teams.
Keywords:
Affective computing
cognitive load
human-robot interaction (HRI)
multihuman multirobot (MH-MR) teams
multirobot systems (MRSs)
workload allocation

Journal

IEEE Transactions on Human-Machine Systems cover
IEEE Transactions on Human-Machine Systems
IF:
4.4
Papers:
1.1K
Citations:
3.5K

Organization

Purdue University System cover
Purdue University System
Scholars:
3.9W
Papers: 3.6W
Citations: 66
P
Purdue University
Scholars:
2.6W
Papers: 2.1W
Citations: 147