1
Return

LGT4CG: Lightweight GPU-TEE for cloud GPUs

delete2026-06-13
delete0
delete
OA
AI
F
Fengyuan Yu
C
Chenlin Huang *
Z
Zhichao Hua *
Y
Yan Ding
K
Keming Wang
R
Renyu Yang
H
Hua Cheng
B
Bo Yu
DOI:10.1016/j.sysarc.2026.103886delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
GPU Trusted Execution Environments (GPU-TEEs) protect GPU-accelerated AI applications from untrusted system software. Existing GPU-TEEs can be categorized into Type-I and Type-II designs. Type-I GPU-TEEs execute AI applications and the full-featured AI runtime inside the TEE, enlarging the trusted computing base (TCB). Type-II GPU-TEEs reduce the TCB by moving applications and complex runtimes outside the TEE and verifying execution via pre-recorded metadata. Existing lightweight Type-II designs target integrated GPUs, leaving cloud discrete GPUs (dGPUs) unprotected. We propose LGT4CG, a lightweight GPU-TEE for dGPUs. It includes GPU Shield, which secures CPU–GPU interactions, and Task Monitor, which verifies execution against metadata. We implement a prototype on ARM with NVIDIA RTX 3090. The runtime TCB consists of only about 6K lines of C code. On DNNs, LGT4CG adds an average overhead of 4.16% for inference and 0.34% for training. On LLMs, the average overhead is 7.10% for TTFT and 6.05% for output throughput.
Keywords:
Operating system security
Trusted Execution Environment
Heterogeneous computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Systems Architecture cover
Journal of Systems Architecture
IF:
4.1
Papers:
2.9K
Citations:
4.2K

Organization

T
tsinghua university
Scholars:
11.5W
Papers: 9.9W
Citations: 137
N
national university of defense technology
Scholars:
3.8K
Papers: 1.2K
Citations: 0
B
Beihang University
Scholars:
5.0W
Papers: 4.0W
Citations: 37
S
shanghai jiao tong university
Scholars:
15.1W
Papers: 11.5W
Citations: 159
Cited Papers

Cited Papers

Citing Papers

Citing Papers