Return
Body-Coupled-Driven Object-Oriented Natural Interactive Interface
DOI:10.1002/adma.202507067.png)
Abstract
En 中文
The metaverse progressively demands heightened sophistication in human-multi-machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human-multi-machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body-coupled electromagnetic coupling. Its bi-modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer-scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy-grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non-contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object-oriented human-machine interaction (HMI) framework is developed to enable single-interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross-domain augmented reality applications.
Keywords:
3D spatial sensing
body-coupled electromagnetic coupling
human-machine interaction
tactile sensing
trajectory reconstruction
Journal
IF:
26.8
Papers:
3.4W
Citations:
46.0W

