arrow
Return

SensorFormer: Efficient Many-to-Many Sensor Calibration With Learnable Input Subsampling

delete2022-10-15
delete7
PRE
AI
Y
Yun Cheng *
O
Olga Saukh
L
Lothar Thiele
DOI:10.1109/JIOT.2022.3177948delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Accurate calibration of low-cost environmental sensors is a prerequisite for their successful use in many monitoring applications. State-of-the-art calibration methods vary from simple linear regression to sophisticated deep models based on LSTMs and GRUs. The latter take past measurements to improve calibration accuracy. In this article, we argue that both recent past and close future measurements help to achieve accurate calibration, whereas accuracy improvements beyond the past come with a delay introduced by the occurrence of the future. We propose a generalized many-to-many calibration scheme called SensorFormer based on the successful Transformer model which takes both past and future raw measurements into account. We show that the proposed approach: 1) outperforms other methods by improving calibration accuracy by 16.5%-20.4% on public data sets and own field data and 2) can efficiently run on low-power microcontrollers with very limited computational and storage capabilities. The latter is achieved by a novel optimization technique based on learnable input subsampling taking advantage of the properties of typical sensor data. We manage to reduce the model size by 20%-33% and minimize the overall floating point operations per second (FLOPs) by 65% while maintaining superior accuracy than state-of-the-art methods.
Keywords:
Calibration
Time measurement
Transformers
Internet of Things
Computational modeling
Pollution measurement
Gain measurement
Air quality
efficient transformer model
sensor calibration

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
Cited Papers

Cited Papers

Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
err2021-04-05
err1.1K
errOAAI
errRives, Alexander; Meier, Joshua; Sercu, Tom; Goyal, Siddharth; Lin, Zeming; Liu, Jason; Guo, Demi; Ott, Myle; Zitnick, C. Lawrence; Ma, Jerry; Fergus, Rob
errShare
errSave
Low-Cost Outdoor Air Quality Monitoring and Sensor Calibration: A Survey and Critical Analysis
err2021-05-29
err105
errOAAI
errConcas, Francesco; Mineraud, Julien; Lagerspetz, Eemil; Varjonen, Samu; Liu, Xiaoli; Puolamaki, Kai; Nurmi, Petteri; Tarkoma, Sasu
errShare
errSave
Phase 1 Study of Safety, Tolerability, and Pharmacokinetics of PTC299, an Inhibitor of Stress‐Regulated Protein Translation
err2016-02-02
err0
errOAAI
errMarla Weetall; Thomas Davis; Gary Elfring; Valerie Northcutt; Liangxian Cao; Young‐Choon Moon; Peter Riebling; Mandar Dali; Samit Hirawat; John Babiak; Joseph Colacino; Neil Almstead; Robert Spiegel; Stuart W. Peltz
errShare
errSave
Effect of mutations in the SARS-CoV-2 spike protein on protein stability, cleavage, and cell-cell fusion function
err
IF0
err2021-01-25
err0
errOAAI
errChelsea T. Barrett; Hadley E. Neal; Kearstin Edmonds; Carole L. Moncman; Rachel Thompson; Jean M. Branttie; Kerri Beth Boggs; Cheng-Yu Wu; Daisy W. Leung; Rebecca E. Dutch
errShare
errSave
Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoT
err2022-06-15
err231
errOAAI
errChen, Zekai; Chen, Dingshuo; Zhang, Xiao; Yuan, Zixuan; Cheng, Xiuzhen
errShare
errSave
Evaluation of Medicine Abuse Trends in Community Pharmacies: The Medicine Abuse Observatory (MAO) in a Region of Southern Europe
err2021-07-23
err0
errOAAI
errMaria Perelló; Karla Rio-Aige; Rafel Guayta-Escolies; Pilar Gascón; Pilar Rius; Anna M. Jambrina; Guillermo Bagaria; Mercè Armelles; Francisco José Pérez-Cano; Manel Rabanal
errShare
errSave
Corrigendum: The prospective outcome of the Monkeypox outbreak in 2022 and characterization of monkeypox disease immunobiology
err2023-09-18
err0
errOAAI
errMuhammad Suhaib Qudus; Xianghua Cui; Mingfu Tian; Uzair Afaq; Muhammad Sajid; Sonia Qureshi; Siyu Liu; June Ma; Guolei Wang; Muhammad Faraz; Haleema Sadia; Kailang Wu; Chengliang Zhu
errShare
errSave
researcher View more