1
Return

An intuitive robot manipulation interface based on mixed reality and multi-point mapping for assembly applications☆

delete2026-05-23
delete0
PRE
AI
J
Jilong Bai *
W
Weiping He
T
Tianyu Liu
B
Bokai Zheng
H
Haoran Zhang
X
Xiaotian Zhang
M
Mark Billinghurst
DOI:10.1016/j.displa.2026.103441delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In Industry 5.0, high-precision human-robot collaborative assembly requires intuitive interfaces that minimize cognitive load. However, traditional 6-DoF control interfaces are hindered by kinematic coupling, as the control coordinate system (CCS) is rigidly fixed to the robot's end-effector (EEF), forcing operators to perform complex compensatory movements. To address this, we propose the Multi-Point Mapping Interface (MPMI), a Mixed Reality (MR) strategy that dynamically decouples the CCS from the EEF, allowing operators to align control with task-relevant geometric features. A single-factor within-subjects user study (N = 18) was conducted to validate the system against a traditional Single-Point Mapping Interface (SPMI). Experimental results demonstrate that MPMI significantly reduced task completion time by 14.6% (p = 0.022) and improved input efficiency, as indicated by a 15.0% reduction in cumulative operator input pose change (p < 0.001). Furthermore, subjective assessments confirmed a significant decrease in NASA-TLX cognitive load (p = 0.011) and superior usability of the system. These findings empirically validate the principle of dynamic control origin decoupling as a critical methodology for enhancing efficiency in complex robotic assembly, providing a foundation for future cognitive-optimized HRC systems.
Keywords:
Human-robot interaction
Robotic manipulation
Mixed reality
Assembly applications

Journal

Displays cover
Displays
IF:
3.4
Papers:
2.1K
Citations:
3.2K

Organization

N
northwestern polytechnical university
Scholars:
1.0W
Papers: 3.8K
Citations: 0
A
adelaide university
Scholars:
3.5K
Papers: 1.6K
Citations: 1
Cited Papers

Cited Papers

Citing Papers

Citing Papers