arrow
Return

Body-Coupled-Driven Object-Oriented Natural Interactive Interface

delete2025-08-21
delete0
PRE
AI
J
Jianlong Hong
Y
Yukun Xiao
Y
Yuqi Chen
S
Shengshun Duan
S
Shengxin Xiang
X
Xiao Wei
H
Huiyun Zhang
L
Lei Liu
夏军红 (Jun Xia)
L
Lei Wei
Q
Qiongfeng Shi *
C
Chengkuo Lee *
J
Jun Wu *
DOI:10.1002/adma.202507067delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The metaverse progressively demands heightened sophistication in human-multi-machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human-multi-machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body-coupled electromagnetic coupling. Its bi-modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer-scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy-grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non-contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object-oriented human-machine interaction (HMI) framework is developed to enable single-interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross-domain augmented reality applications.
Keywords:
3D spatial sensing
body-coupled electromagnetic coupling
human-machine interaction
tactile sensing
trajectory reconstruction

Journal

Advanced Materials cover
Advanced Materials
IF:
26.8
Papers:
3.4W
Citations:
46.0W

Organization

S
Southeast University
Scholars:
1.8W
Papers: 7.8K
Citations: 480
N
National University of Singapore
Scholars:
7.4W
Papers: 6.4W
Citations: 11.4W