未登录
分享
收藏MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM ModelsMSCH: 基于Microbatch的选择性激活检查点,带有隐藏的重新计算,可有效训练LLM模型
Zhang, Cheng; Yu, Minjun; Yu, Li; Cong, Pengyu; Yan, Yuchao; Bao, Jie; Jiang, Jian; Wang, Xiaozheng; Ye, Xiaolong; Tang, Tao; Xiao, Liang
分享
收藏