返回
Real-Time Encrypted Emotion Recognition Using Homomorphic Encryption
DOI:10.1145/3770633.png)
摘要
En 中文
Emotion recognition has been an actively researched topic in the field of HCI. However, multimodal datasets used for emotion recognition often contain sensitive personal information, such as physiological signals, facial images, and behavioral patterns, raising significant privacy concerns. In particular, the privacy issues become crucial in workplace settings because of the risks such as surveillance and unauthorized data usage caused by the misuse of collected datasets. To address this issue, we propose an Encrypted Emotion Recognition (EER) framework that performs real-time inference on encrypted data using the CKKS homomorphic encryption (HE) scheme. We evaluated the proposed framework using publicly available WESAD and Hide-and-seek datasets, demonstrating successful stress/emotion recognition under encryption. The results demonstrated that encrypted inference achieved similar accuracy to plaintext inference, with accuracy of 0.966 (plaintext) vs. 0.967 (ciphertext) on the WESAD dataset, and 0.868 for both cases on the Hide-and-Seek dataset. Encrypted inference was performed on a GPU, with average inference times of 333 milliseconds for the general model and 455 milliseconds for the personalized model. Furthermore, we validated the feasibility of semi-supervised learning and model personalization in encrypted environments, enhancing the framework's real-world applicability. Our findings suggest that the EER framework provides a scalable, privacy-preserving solution for emotion recognition in domains such as healthcare and workplace settings, where securing sensitive data is of critical importance.
Keyword:
Data privacy
Emotion recognition
Cloud privacy
Privacy-preserving machine learning
Homomorphic encryption
期刊
机构
引用论文
SARS: A Personalized Federated Learning Framework Towards Fairness and Robustness against Backdoor Attacks传染性非典型肺炎: 面向公平性和抗后门攻击的鲁棒性的个性化联邦学习框架
PARROT: Interactive Privacy-Aware Internet of Things Application Design ToolPARROT: 交互式隐私感知物联网应用设计工具
Are Those Steps Worth Your Privacy? Fitness-Tracker Users' Perceptions of Privacy and Utility这些步骤值得您的隐私吗?健身追踪器用户对隐私和效用的看法

