CD-LLM: A Heterogeneous Multi-FPGA System for Batched Decoding of 70B+LLMs Using a Compute-Dedicated Architecture
Ma, Wenheng; Yang, Xinhao; Zeng, Shulin; Liu, Tengxuan; Shen, Libo; Wang, Hongyi; Li, Shiyao; Hong, Ke; Zhu, Zhenhua; Ning, Xuefei; Ho, Tsung-Yi; Dai, Guohao; Wang, Yu
Share
Save