arrow
返回

ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs

delete2024-09-09
delete1
PRE
AI
高
高艺 (義典 橘高)
K
Kaijie Xiao
F
Fu Li
W
Weifeng Xu
J
Jiaming Huang
W
Wei Dong *
DOI:10.1145/3678585delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Trigger-Action Program (TAP) is a simple but powerful format to realize intelligent IoT applications, especially in home automation scenarios. Existing trace-driven approaches and in-situ programming approaches depend on either customized interaction commands or well-labeled datasets, resulting in limited applicable scenarios. In this paper, we propose ChatIoT, a zero-code TAP generation system based on large language models (LLMs). With a novel context-aware compressive prompting scheme, ChatIoT is able to automatically generate TAPs from user requests in a token-efficient manner and deploy them to the TAP runtime. Further, for those TAP requests including unknown sensing abilities, ChatIoT can also generate new AI models with knowledge distillation by multimodal LLMs, with a novel model customization method based on deep reinforcement learning. We implemented ChatIoT and evaluated its performance extensively. Results show that ChatIoT can reduce token consumption by 26.1-84.9% and improve TAP generation accuracy by 4.2-65.5% compared to state-of-the-art approaches in multiple settings. We also conducted a real user study, and ChatIoT can achieve 91.57% TAP generation accuracy.
Keyword:
Zero-code TAP generation
LLMs
Home automation
Internet of Things

期刊

P
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
IF:
4.5
论文数:
1.1K
被引数:
7.2K

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Knowledge Distillation: A Survey知识蒸馏: 一项调查
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
err分享
err收藏
A comprehensive survey on model compression and acceleration模型压缩与加速综述
err2020-02-08
err260
PREAI
errChoudhary, Tejalal; Mishra, Vipul; Goswami, Anurag; Sarangapani, Jagannathan
err分享
err收藏
From Users' Intentions to IF-THEN Rules in the Internet of Things
err2021-08-16
err25
PREAI
errCorno, Fulvio; de Russis, Luigi; Roffarello, Alberto Monge
err分享
err收藏
Predicting 30-Day Readmissions in an Asian Population: Building a Predictive Model by Incorporating Markers of Hospitalization Severity
err2016-12-09
err0
errOAAI
errLian Leng Low; Nan Liu; Sijia Wang; Julian Thumboo; Marcus Eng Hock Ong; Kheng Hock Lee
err分享
err收藏
学者 查看更多内容