Shengwei Li - Publications, H-index & Citations

Shengwei Li

national university of defense technology

8H指数

24论文数

238被引数

收录论文 7

发表时间

Pro-Prophet: A Systematic Load Balancing Method for Efficient Parallel Training of Large-Scale MoE Models Pro-Prophet: 一种针对大规模MoE模型高效并行训练的系统性负载均衡方法

IEEE Transactions on Parallel and Distributed Systems

IF6

2026-03-02

PREAI

Wei Wang; Zhiquan Lai; Dongsheng Li; Shengwei Li; Weijie Liu; Keshi Ge; Ao Shen; Huayou Su

Toward Understanding the Generalizability of Delayed Stochastic Gradient Descent 理解延迟随机梯度下降法泛化性的研究

IEEE Transactions on Pattern Analysis and Machine Intelligence

IF18.6

2025-09-01

PREAI

Xiaoge Deng; Li Shen; Shengwei Li; Tao Sun; Dongsheng Li; Dacheng Tao

Estimation of transport CO2 emissions using machine learning algorithm 基于机器学习算法的运输CO2排放量估算

TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT

IF7.7

2024-08-01

PREAI

Li, Shengwei; Tong, Zeping; Haroon, Muhammad

A Multidimensional Communication Scheduling Method for Hybrid Parallel DNN Training

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS

IF6

2024-08-01

PREAI

Li, Shengwei; Lu, Kai; Lai, Zhiquan; Liu, Weijie; Ge, Keshi; Li, Dongsheng

A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS

IF6

2024-04-01

PREAI

Li, Dongsheng; Li, Shengwei; Lai, Zhiquan; Fu, Yongquan; Ye, Xiangyu; Cai, Lei; Qiao, Linbo

AutoPipe-H: A Heterogeneity-Aware Data-Paralleled Pipeline Approach on Commodity GPU Servers

IEEE TRANSACTIONS ON COMPUTERS

IF3.8

2024-01-01

PREAI

Liu, Weijie; Lu, Kai; Lai, Zhiquan; Li, Shengwei; Ge, Keshi; Li, Dongsheng; Lu, Xicheng

Merak: An Efficient Distributed DNN Training Framework With Automated 3D Parallelism for Giant Foundation Models

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS

IF6

2023-05-01

OAAI

Lai, Zhiquan; Li, Shengwei; Tang, Xudong; Ge, Keshi; Liu, Weijie; Duan, Yabo; Qiao, Linbo; Li, Dongsheng

研究方向