未登录
分享
收藏Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency边缘AI的可持续大语言模型推理:评估量化大语言模型在能效、输出准确性和推理延迟方面的表现
Husom, Erik Johannes; Goknil, Arda; Astekin, Merve; Shar, Lwin Khin; Kasen, Andre; Sen, Sagar; Mithassel, Benedikt Andreas; Soylu, Ahmet
分享
收藏