Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
Husom, Erik Johannes; Goknil, Arda; Astekin, Merve; Shar, Lwin Khin; Kasen, Andre; Sen, Sagar; Mithassel, Benedikt Andreas; Soylu, Ahmet
Share
Save