arrow
Return

A touch-based multimodal and cryptographic bio-human-machine interface

delete2022-04-04
delete15
delete
OA
AI
S
Shuyu Lin
J
Jialun Zhu
W
Wenzhuo Yu
B
Bo Wang
K
Kiarash A. Sabet
Y
Yichao Zhao
X
Xuanbing Cheng
H
Hannaneh Hojaiji
H
Haisong Lin
J
Jiawei Tan
C
Carlos Milla
R
Ronald W. Davis *
S
Sam Emaminejad *
DOI:10.1073/pnas.2201937119delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The awareness of individuals' biological status is critical for creating interactive and adaptive environments that can actively assist the users to achieve optimal outcomes. Accordingly, specialized human-machine interfaces-equipped with bioperception and interpretation capabilities-are required. To this end, we devised a multimodal cryptographic bio-human-machine interface (CB-HMI), which seamlessly translates the user's touch-based entries into encrypted biochemical, biophysical, and biometric indices. As its central component, the CB-HMI features thin hydrogel-coated chemical sensors and inference algorithms to noninvasively and inconspicuously acquire biochemical indices such as circulating molecules that partition onto the skin (here, ethanol and acetaminophen). Additionally, the CB-HMI hosts physical sensors and associated algorithms to simultaneously acquire the user's heart rate, blood oxygen level, and fingerprint minutiae pattern. Supported by human subject studies, we demonstrated the CB-HMI's capability in terms of acquiring physiologically relevant readouts of target bioindices, as well as user-identifying and biometrically encrypting/decrypting these indices in situ (leveraging the fingerprint feature). By upgrading the common surrounding objects with the CB-HMI, we created interactive solutions for driving safety and medication use. Specifi- cally, we demonstrated a vehicle-activation system and a medication-dispensing system, where the integrated CB-HMI uniquely enabled user bioauthentication (on the basis of the user's biological state and identity) prior to rendering the intended services. Harnessing the levels of bioperception achieved by the CB-HMI and other intelligent HMIs, we can equip our surroundings with a comprehensive and deep awareness of individuals' psychophysiological state and needs.
Keywords:
human-machine interface
hydrogel
electrochemical sensors
noninvasive biomonitoring
healthcare security

Journal

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
Papers:
10.8W
Citations:
73.5W

Organization

U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

errShare
errSave
Skin-integrated wireless haptic interfaces for virtual and augmented reality
errNATURE
IF48.5
err2019-11-20
err737
PREAI
errYu, Xinge; Xie, Zhaoqian; Yu, Yang; Lee, Jungyup; Vazquez-Guardado, Abraham; Luan, Haiwen; Ruben, Jasper; Ning, Xin; Akhtar, Aadeel; Li, Dengfeng; Ji, Bowen; Liu, Yiming; Sun, Rujie; Cao, Jingyue; Huo, Qingze; Zhong, Yishan; Lee, ChanMi; Kim, SeungYeop; Gutruf, Philipp; Zhang, Changxing; Xue, Yeguang; Guo, Qinglei; Chempakasseril, Aditya; Tian, Peilin; Lu, Wei; Jeong, JiYoon; Yu, YongJoon; Cornman, Jesse; Tan, CheeSim; Kirn, BongHoon; Lee, KunHyuk; Feng, Xue; Huang, Yonggang; Rogers, John A.
errShare
errSave
A programmable epidermal microfluidic valving system for wearable biofluid management and contextual biomarker analysis
err2020-09-02
err102
errOAAI
errLin, Haisong; Tan, Jiawei; Zhu, Jialun; Lin, Shuyu; Zhao, Yichao; Yu, Wenzhuo; Hojaiji, Hannaneh; Wang, Bo; Yang, Siyang; Cheng, Xuanbing; Wang, Zhaoqing; Tang, Eric; Yeung, Christopher; Emaminejad, Sam
errShare
errSave
errShare
errSave
Autonomous sweat extraction and analysis applied to cystic fibrosis and glucose monitoring using a fully integrated wearable platform
err2017-04-17
err656
errOAAI
errEmaminejad, Sam; Gao, Wei; Wu, Eric; Davies, Zoe A.; Nyein, Hnin Yin Yin; Challa, Samyuktha; Ryan, Sean P.; Fahad, Hossain M.; Chen, Kevin; Shahpar, Ziba; Talebi, Salmonn; Milla, Carlos; Javey, Ali; Davis, Ronald W.
errShare
errSave
A wearable patch for continuous analysis of thermoregulatory sweat at rest
err2021-03-23
err230
errOAAI
errNyein, Hnin Yin Yin; Bariya, Mallika; Tran, Brandon; Ahn, Christine Heera; Brown, Brenden Janatpour; Ji, Wenbo; Davis, Noelle; Javey, Ali
errShare
errSave
researcher View more