arrow
Return

Physics-directed Data Augmentation for Deep Model Transfer to Specific Sensor

delete2022-12-08
delete0
PRE
AI
W
Wenjie Luo *
Z
Zhenyu Yan
Q
Qun Song
R
Rui Tan
DOI:10.1145/3549076delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Runtime domain shifts from the training phase caused by sensor characteristic variation incur performance drops of the deep learning-based sensing systems. To address this problem, existing transfer learning techniques require substantial target-domain data and incur high post-deployment overhead. Differently, we propose to exploit the first principle governing the domain shift to reduce the demand for target-domain data. Specifically, our proposed approach called PhyAug uses the first principle fitted with few labeled or unlabeled data pairs collected by the source sensor and the target sensor to transform the existing source-domain training data into the augmented target-domain data for calibrating the deep neural networks. In two audio sensing case studies of keyword spotting and automatic speech recognition, PhyAug recovers the recognition accuracy losses due to microphones' characteristic variations by 37% to 72% with 5-second unlabeled data collected from the target microphones. In a case study of acoustics-based room recognition, PhyAug recovers the recognition accuracy loss caused by smartphone microphone variation by 33% to 80%. In the last case study of fisheye image recognition, PhyAug reduces the image recognition error due to the camera-induced distortions by 72%.
Keywords:
Smart sensors
neural networks
data augmentation
domain adaptation

Journal

ACM Transactions on Sensor Networks cover
ACM Transactions on Sensor Networks
IF:
4.7
Papers:
1.0K
Citations:
2.0K

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
C
Chinese University of Hong Kong
Scholars:
3.4W
Papers: 3.2W
Citations: 5.6W
Cited Papers

Cited Papers

A functional polymorphism in the catechol‐O‐methyltransferase gene is associated with osteoarthritis‐related pain
err2009-01-29
err0
PREAI
errJoyce B. J. van Meurs; Andre G. Uitterlinden; Lisette Stolk; Hanneke J. M. Kerkhof; Albert Hofman; Huibert A. P. Pols; Sita M. A. Bierma‐Zeinstra
errShare
errSave
Association of Apolipoprotein E (ApoE) Polymorphism with Alzheimer';s Disease in Chinese Population
err2016-06-02
err0
PREAI
errLingling Zheng; Jianzhong Duan; Xiaoling Duan; Weitao Zhou; Chunjiang Chen; Yanhua Li; Jie Chen; Weihui Zhou; Yan-Jiang Wang; Tingyu Li; Weihong Song
errShare
errSave
A Survey on Transfer Learning
err2010-10-01
err1.4W
PREAI
errPan, Sinno Jialin; Yang, Qiang
errShare
errSave
researcher View more