.png){kind=icon}
返回
TinyML-Enabled Intelligent Question-Answer Services in IoT Edge Consumer Devices
.png){kind=icon}
PRE
AI
DOI：10.1109/TCE.2024.3417890.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Presently, the prevalence of large language models has driven the rapid popularization of question-and-answer applications. However, the training and deployment of large language models involve high-resource computing, posing a challenge for many small or edge devices in the Internet of Things (IoT). Therefore, in the context of IoT edge consumer electronic devices, deploying question-and-answer models based on TinyML becomes more meaningful. In this paper, we propose a tiny deep learning-based Question-Answer scheme to realize end-to-end dialog service by Machine Reading Comprehension. In order to obtain semantic representation, we design and apply a pre-training model to generate the semantic embedding representation of questions and answers and propose a pre-training fine-tuning method based on the twin model. In addition, we also introduce a compression method based on embedded representation and design a forward compression network and a cyclic compression network based on an encoder. The experimental results show that our method is more accurate than state-of-the-art schemes.
Keyword:
Semantics
Biological system modeling
Internet of Things
Task analysis
Adaptation models
Accuracy
Question answering (information retrieval)
TinyML
IoT edge consumer devices
intelligent question-answer service
期刊
IF:
10.9
论文数:
5.3K
被引数:
6.8K
机构
引用论文
.png){kind=icon}
分享收藏
Multitask Learning of Deep Neural Network-Based Keyword Spotting for IoT Devices基于深度神经网络的物联网设备关键词识别多任务学习
PREAI
分享收藏Data-Driven Modeling Based on Two-Stream λ Gated Recurrent Unit Network With Soft Sensor Application
PREAI
分享收藏
查看更多内容