arrow
Return

Using Smartwatches to Detect Face Touching

delete2021-09-30
delete7
delete
OA
AI
柏晨 (Chen Bai) *
Y
Yu-Peng Chen
A
Adam Wolach
L
Lisa Anthony
M
Mamoun Mardini
DOI:10.3390/s21196528delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Frequent spontaneous facial self-touches, predominantly during outbreaks, have the theoretical potential to be a mechanism of contracting and transmitting diseases. Despite the recent advent of vaccines, behavioral approaches remain an integral part of reducing the spread of COVID-19 and other respiratory illnesses. The aim of this study was to utilize the functionality and the spread of smartwatches to develop a smartwatch application to identify motion signatures that are mapped accurately to face touching. Participants (n = 10, five women, aged 20-83) performed 10 physical activities classified into face touching (FT) and non-face touching (NFT) categories in a standardized laboratory setting. We developed a smartwatch application on Samsung Galaxy Watch to collect raw accelerometer data from participants. Data features were extracted from consecutive non-overlapping windows varying from 2 to 16 s. We examined the performance of state-of-the-art machine learning methods on face-touching movement recognition (FT vs. NFT) and individual activity recognition (IAR): logistic regression, support vector machine, decision trees, and random forest. While all machine learning models were accurate in recognizing FT categories, logistic regression achieved the best performance across all metrics (accuracy: 0.93 & PLUSMN; 0.08, recall: 0.89 & PLUSMN; 0.16, precision: 0.93 & PLUSMN; 0.08, F1-score: 0.90 & PLUSMN; 0.11, AUC: 0.95 & PLUSMN; 0.07) at the window size of 5 s. IAR models resulted in lower performance, where the random forest classifier achieved the best performance across all metrics (accuracy: 0.70 & PLUSMN; 0.14, recall: 0.70 & PLUSMN; 0.14, precision: 0.70 & PLUSMN; 0.16, F1-score: 0.67 & PLUSMN; 0.15) at the window size of 9 s. In conclusion, wearable devices, powered by machine learning, are effective in detecting facial touches. This is highly significant during respiratory infection outbreaks as it has the potential to limit face touching as a transmission vector.
Keywords:
smartwatch
accelerometer
face touching
machine learning
COVID-19
respiratory illnesses
wearables
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

U
University of Florida
Scholars:
4.0W
Papers: 3.1W
Citations: 6.6W
State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130