未登录返回期刊详情
XY-Serve: End-to-End Versatile Production Serving for Dynamic LLM WorkloadsXY-Serve:面向动态大语言模型工作负载的端到端通用生产服务
Song, Mingcong; Tang, Xinru; Hou, Fengfan; Li, Jing; Wei, Wei; Ma, Yipeng; Xiao, Runqiu; Si, Hongjie; Jiang, Dingcheng; Yin, Shouyi; Hu, Yang; Long, Guoping
分享
收藏 GFS: A Preemption-aware Scheduling Framework for GPU Clusters with Predictive Spot Instance ManagementGFS:一种具备抢占感知的GPU集群调度框架,带有预测性竞价实例管理
Duan, Jiaang; Xu, Shenglin; Qian, Shiyou; Yang, Dingyu; Wang, Kangjin; Liao, Chenzhi; Yu, Yinghao; Hua, Qin; Hu, Hanwen; Wang, Qi; Wu, Wenchao; Bao, Dongqing; Lu, Tianyu; Cao, Jian; Xue, Guangtao; Yang, Guodong; Zhang, Liping; Chen, Gang
分享
收藏