.png){kind=icon}
Return
Efficient and Secure Deep Learning Inference in Trusted Processor Enabled Edge Clouds
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2022.3187772.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Edge intelligence has emerged as a prevalent enabling technology to support various intelligent applications. Along with the prosperity, it also raises great concern on the security and privacy since the edge servers are usually shared and untrusted. The security-sensitive code (i.e., the pre-trained model) and data may be easily stolen by malicious tenants, and even untrusted infrastructure providers. To this end, Software Guard Extensions (SGX) is proposed to provide an isolated Trust Execution Environment (TEE) for security and privacy guarantee. However, we find that running tasks in SGX suffer certain performance degradation due to the limited Enclave Page Cache (EPC) size. This further leads to frequent page swapping operations and the high enclave call overhead, which are also influenced by the task (i.e., DNN layer) dispatching and scheduling. To this end, in this paper, we design Lasagna, as an SGX based secure DNN inference acceleration framework, which explores the layered-structure of DNN models to well balance the usage of the scarce EPC resources and the computation resources. Lasagna mainly consists of a global task balancer and a local task scheduler, responding for task dispatching across distributed edge servers and task scheduling in local server, respectively. We evaluate Lasagna over different well-known DNN models, and the results show that Lasagna effectively speeds up the inference performance by 1.11 x -1.51 x.
Keywords:
DNN Inference
edge intelligence
SGX
task scheduling
Journal
IF:
6
Papers:
5.2K
Citations:
1.1W
Organization
View more organizations
Cited Papers
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing.png)
PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAIShareSaveDark and singular optical solitons with Kundu–Eckhaus equation by extended trial equation method and extended G′/G-expansion schemeOptik
OptikIF0
PREAI
ShareSaveShareSave
View more