arrow
Return

Optimal Cut Layer Bounds for Split Learning

delete2025-01-01
delete0
PRE
AI
M
Matea Marinova *
M
Marija Poposka
Z
Zoran Hadži-Velkov
R
Rakovic, Valentin
DOI:10.1109/LCOMM.2025.3542541delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Split learning (SL) is a distributed learning method where a deep learning model is partitioned between the client and server, aiming to optimize the training process. A key challenge in split learning is selecting the cut layer to minimize energy consumption while considering both computational and communication overheads. In this letter, we address this challenge within the context of a wireless system with multiple clients and a central server. We introduce a pruning-based cut layer selection scheme that effectively reduces the energy consumption for each client. Our approach leverages analytical bounds for optimal cut layer location, which we derive and validate against state-of-the-art SL benchmark schemes, demonstrating the high efficiency of our proposed method.
Keywords:
Servers
Training
Energy consumption
Computational modeling
Load modeling
Data models
Data communication
Computer architecture
Synchronization
Mathematical models
Energy efficiency
optimal cut layer
pruning
deep learning
split learning

Journal

IEEE Communications Letters cover
IEEE Communications Letters
IF:
4.4
Papers:
1.3W
Citations:
2.2W

Organization

S
saints cyril & methodius university of skopje
Scholars:
2.2K
Papers: 1.4K
Citations: 0