arrow
Return

Body-Coupled-Driven Object-Oriented Natural Interactive Interface

delete2025-08-21
delete0
PRE
AI
J
Jianlong Hong
Y
Yukun Xiao
Y
Yuqi Chen
S
Shengshun Duan
S
Shengxin Xiang
X
Xiao Wei
H
Huiyun Zhang
L
Lei Liu
夏
夏军红 (Jun Xia)
L
Lei Wei
石琼锋 cover
石琼锋 (Qiongfeng Shi) *
C
Chengkuo Lee *
J
Jun Wu *
DOI:10.1002/adma.202507067delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The metaverse progressively demands heightened sophistication in human-multi-machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human-multi-machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body-coupled electromagnetic coupling. Its bi-modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer-scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy-grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non-contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object-oriented human-machine interaction (HMI) framework is developed to enable single-interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross-domain augmented reality applications.
Keywords:
3D spatial sensing
body-coupled electromagnetic coupling
human-machine interaction
tactile sensing
trajectory reconstruction

Journal

Advanced Materials cover
Advanced Materials
IF:
26.8
Papers:
3.4W
Citations:
46.0W

Organization

S
Southeast University
Scholars:
2.1W
Papers: 8.6K
Citations: 480
N
National University of Singapore
Scholars:
7.6W
Papers: 6.5W
Citations: 11.4W
Cited Papers

Cited Papers

Soft Sensors and Actuators for Wearable Human–Machine Interfaces
err2024-02-05
err0
PREAI
errJonghwa Park; Youngoh Lee; Seungse Cho; Ayoung Choe; Jeonghee Yeom; Yun Goo Ro; Jinyoung Kim; Dong-hee Kang; Seungjae Lee; Hyunhyub Ko
errShare
errSave
Neuromorphic sensorimotor loop embodied by monolithically integrated, low-voltage, soft e-skin
err2023-05-19
err0
PREAI
errWeichen Wang; Yuanwen Jiang; Donglai Zhong; Zhitao Zhang; Snehashis Choudhury; Jian-Cheng Lai; Huaxin Gong; Simiao Niu; Xuzhou Yan; Yu Zheng; Chien-Chung Shih; Rui Ning; Qing Lin; Deling Li; Yun-Hi Kim; Jingwan Kim; Yi-Xuan Wang; Chuanzhen Zhao; Chengyi Xu; Xiaozhou Ji; Yuya Nishio; Hao Lyu; Jeffrey B.-H. Tok; Zhenan Bao
errShare
errSave
Gradiently Foaming Ultrasoft Hydrogel with Stop Holes for Highly Deformable, Crack-Resistant and Sensitive Conformal Human-Machine Interfaces
err2024-03-08
err12
PREAI
errHui, Zengyu; Zhang, Zhao; Wang, Yurong; Zhang, Runrun; Liu, Xin; Jiang, Mingjie; Ju, Feng; Hou, Wenteng; Xia, Zhongming; Wang, Deya; Wang, Pengfei; Pei, Yangyang; Yan, Ren; Zhang, Yan; Chen, Qiang; Huang, Wei; Sun, Gengzhi
errShare
errSave
Transparent Self-Healing Anti-Freezing Ionogel for Monolayered Triboelectric Nanogenerator and Electromagnetic Energy-Based Touch Panel
err2023-12-13
err20
PREAI
errXia, Yifan; Zhu, Yan; Zhi, Xinrong; Guo, Wenyu; Yang, Biao; Zhang, Siyu; Li, Mingyuan; Wang, Xin; Pan, Caofeng
errShare
errSave
Multi-receptor skin with highly sensitive tele-perception somatosensory
err2024-09-13
err1
errOAAI
errDu, Yan; Shen, Penghui; Liu, Houfang; Zhang, Yuyang; Jia, Luyao; Pu, Xiong; Yang, Feiyao; Ren, Tianling; Chu, Daping; Wang, Zhonglin; Wei, Di
errShare
errSave
All-organic transparent plant e-skin for noninvasive phenotyping
err2024-02-16
err14
errOAAI
errYang, Yanqin; He, Tianyiyi; Ravindran, Pratibha; Wen, Feng; Krishnamurthy, Pannaga; Wang, Luwei; Zhang, Zixuan; Kumar, Prakash P.; Chae, Eunyoung; Lee, Chengkuo
errShare
errSave
Extremely durable electrical impedance tomography-based soft and ultrathin wearable e-skin for three-dimensional tactile interfaces
err2024-09-20
err1
errOAAI
errKim, Kyubeen; Hong, Jung-Hoon; Bae, Kyubin; Lee, Kyounghun; Lee, Doohyun J.; Park, Junsu; Zhang, Haozhe; Sang, Mingyu; Ju, Jeong Eun; Cho, Young Uk; Kang, Kyowon; Park, Wonkeun; Jung, Suah; Lee, Jung Woo; Xu, Baoxing; Kim, Jongbaeg; Yu, Ki Jun
errShare
errSave
Body-coupled power transmission and energy harvesting
err2021-06-10
err63
PREAI
errLi, Jiamin; Dong, Yilong; Park, Jeong Hoan; Yoo, Jerald
errShare
errSave
errShare
errSave
researcher View more