XY-Serve: End-to-End Versatile Production Serving for Dynamic LLM Workloads
Song, Mingcong; Tang, Xinru; Hou, Fengfan; Li, Jing; Wei, Wei; Ma, Yipeng; Xiao, Runqiu; Si, Hongjie; Jiang, Dingcheng; Yin, Shouyi; Hu, Yang; Long, Guoping.png)
Share.png)
Save GFS: A Preemption-aware Scheduling Framework for GPU Clusters with Predictive Spot Instance ManagementDuan, Jiaang; Xu, Shenglin; Qian, Shiyou; Yang, Dingyu; Wang, Kangjin; Liao, Chenzhi; Yu, Yinghao; Hua, Qin; Hu, Hanwen; Wang, Qi; Wu, Wenchao; Bao, Dongqing; Lu, Tianyu; Cao, Jian; Xue, Guangtao; Yang, Guodong; Zhang, Liping; Chen, Gang Share Save 
.png){kind=icon}
.png){kind=icon}
Not logged in.png){kind=icon}
.png){kind=icon}
.png){kind=icon}
