arrow
Return

Machine Learning-Enabled Tactile Sensor Design for Dynamic Touch Decoding

delete2023-09-22
delete43
delete
OA
AI
Y
Yuyao Lu
D
Depeng Kong
G
Geng Yang *
R
Ruohan Wang
G
Gaoyang Pang
H
Huayu Luo
H
Huayong Yang
K
Kaichen Xu *
DOI:10.1002/advs.202303949delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Skin-like flexible sensors play vital roles in healthcare and human-machine interactions. However, general goals focus on pursuing intrinsic static and dynamic performance of skin-like sensors themselves accompanied with diverse trial-and-error attempts. Such a forward strategy almost isolates the design of sensors from resulting applications. Here, a machine learning (ML)-guided design of flexible tactile sensor system is reported, enabling a high classification accuracy (& AP;99.58%) of tactile perception in six dynamic touch modalities. Different from the intuition-driven sensor design, such ML-guided performance optimization is realized by introducing a support vector machine-based ML algorithm along with specific statistical criteria for fabrication parameters selection to excavate features deeply concealed in raw sensing data. This inverse design merges the statistical learning criteria into the design phase of sensing hardware, bridging the gap between the device structures and algorithms. Using the optimized tactile sensor, the high-quality recognizable signals in handwriting applications are obtained. Besides, with the additional data processing, a robot hand assembled with the sensor is able to complete real-time touch-decoding of an 11-digit braille phone number with high accuracy. A data-driven strategy of a flexible triboelectric nanogenerator-based tactile sensor and machine learning co-designed system is proposed to optimize the classification accuracy of output signals from six contact modalities. Via extracting the subtle signals from the raw data by machine learning algorithms, this system is able to dynamically decode an 11-digit multi-point braille numbers.image
Keywords:
human-machine interactions
laser-induced graphene
machine learning
tactile sensor
touch decoding

Journal

Advanced Science cover
Advanced Science
IF:
14.1
Papers:
1.8W
Citations:
11.5W

Organization

Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Multimodal Plant Healthcare Flexible Sensor System
err2020-07-28
err171
PREAI
errLu, Yuyao; Xu, Kaichen; Zhang, Lishu; Deguchi, Minako; Shishido, Hiroaki; Arie, Takayuki; Pan, Ruihua; Hayashi, Akitoshi; Shen, Lei; Akita, Seiji; Takei, Kuniharu
errShare
errSave
Bioinspired flexible piezoresistive sensor for high-sensitivity detection of broad pressure range
err2022-12-28
err40
PREAI
errWang, Meng; Zhang, Hao; Wu, Han; Ma, Suqian; Ren, Lei; Liang, Yunhong; Liu, Chunbao; Han, Zhiwu
errShare
errSave
Machine learning and computation-enabled intelligent sensor design
err2021-06-28
err121
errOAAI
errBallard, Zachary; Brown, Calvin; Madni, Asad M.; Ozcan, Aydogan
errShare
errSave
Recent Progress in Flexible Tactile Sensors for Human-Interactive Systems: From Sensors to Advanced Applications
err2021-04-22
err396
PREAI
errPyo, Soonjae; Lee, Jaeyong; Bae, Kyubin; Sim, Sangjun; Kim, Jongbaeg
errShare
errSave
Ultra-Sensitive, Deformable, and Transparent Triboelectric Tactile Sensor Based on Micro-Pyramid Patterned Ionic Hydrogel for Interactive Human-Machine Interfaces
err2022-01-31
err201
errOAAI
errTao, Kai; Chen, Zhensheng; Yu, Jiahao; Zeng, Haozhe; Wu, Jin; Wu, Zixuan; Jia, Qingyan; Li, Peng; Fu, Yongqing; Chang, Honglong; Yuan, Weizheng
errShare
errSave
Thermo-Haptic Materials and Devices for Wearable Virtual and Augmented Reality
err2020-11-23
err51
PREAI
errLee, Jinwoo; Kim, Dongkwan; Sul, Heayoun; Ko, Seung Hwan
errShare
errSave
A wearable electrochemical biosensor for the monitoring of metabolites and nutrients
err2022-08-15
err384
errOAAI
errWang, Minqiang; Yang, Yiran; Min, Jihong; Song, Yu; Tu, Jiaobing; Mukasa, Daniel; Ye, Cui; Xu, Changhao; Heflin, Nicole; McCune, Jeannine S.; Hsiai, Tzung K.; Li, Zhaoping; Gao, Wei
errShare
errSave
Gesture recognition using a bioinspired learning architecture that integrates visual data with somatosensory data from stretchable sensors
err2020-06-08
err379
PREAI
errWang, Ming; Yan, Zheng; Wang, Ting; Cai, Pingqiang; Gao, Siyu; Zeng, Yi; Wan, Changjin; Wang, Hong; Pan, Liang; Yu, Jiancan; Pan, Shaowu; He, Ke; Lu, Jie; Chen, Xiaodong
errShare
errSave
Highly Precise Multifunctional Thermal Management-Based Flexible Sensing Sheets
err2019-11-20
err67
PREAI
errXu, Kaichen; Lu, Yuyao; Yamaguchi, Takafumi; Arie, Takayuki; Akita, Seiji; Takei, Kuniharu
errShare
errSave
Electron-Induced Perpendicular Graphene Sheets Embedded Porous Carbon Film for Flexible Touch Sensors
err2020-06-25
err52
errOAAI
errChen, Sicheng; Wang, Yunfei; Yang, Lei; Karouta, Fouad; Sun, Kun
errShare
errSave
researcher View more