arrow
Return

Fast and fair split computing for accelerating deep neural network (DNN) inference

delete2025-02-01
delete0
delete
OA
AI
C
Cha, Dongju
J
Jaewook Lee
S
Sangheon Pack *
DOI:10.1016/j.icte.2024.09.013delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Conventional split computing approaches for AI models that generate large outputs suffer from long transmission and inference times. Due to the limited resources of the edge server and selfish MDs, some MDs cannot offload their tasks and sacrifice their performance. To address these issues, we formulate an optimization problem to determine one or two split points that minimize inference latency while ensuring fair offloading among MDs. Additionally, we devise a low-complexity heuristic algorithm called fast and fair split computing (F2SC). Evaluation results demonstrate that F2SC reduces inference time by 3.8% similar to 20.1% compared to the conventional approaches while maintaining fairness. (c) 2024 The Author(s). Published by Elsevier B.V. on behalf of The Korean Institute of Communications and Information Sciences. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Keywords:
Split computing
Split point decision
Deep neural network inference
Jain's fairness index
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ICT Express cover
ICT Express
IF:
4.2
Papers:
1.0K
Citations:
2.5K

Organization

L
LG Electronics
Scholars:
781
Papers: 635
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
First COVID-19 case in Zambia — Comparative phylogenomic analyses of SARS-CoV-2 detected in African countries
err2021-01-01
err0
errOAAI
errEdgar Simulundu; Francis Mupeta; Pascalina Chanda-Kapata; Ngonda Saasa; Katendi Changula; Walter Muleya; Simbarashe Chitanga; Miniva Mwanza; Paul Simusika; Herman Chambaro; Benjamin Mubemba; Masahiro Kajihara; Duncan Chanda; Lloyd Mulenga; Sombo Fwoloshi; Aaron Lunda Shibemba; Fred Kapaya; Paul Zulu; Kunda Musonda; Mwaka Monze; Nyambe Sinyange; Mazyanga L. Mazaba; Muzala Kapin’a; Peter J. Chipimo; Raymond Hamoonga; Davie Simwaba; William Ngosa; Albertina N. Morales; Nkomba Kayeyi; John Tembo; Mathew Bates; Yasuko Orba; Hirofumi Sawa; Ayato Takada; King S. Nalubamba; Kennedy Malama; Victor Mukonka; Alimuddin Zumla; Nathan Kapata
errShare
errSave
A Survey on Collaborative DNN Inference for Edge Intelligence
err2023-05-03
err18
PREAI
errRen, Wei-Qing; Qu, Yu-Ben; Dong, Chao; Jing, Yu-Qian; Sun, Hao; Wu, Qi-Hui; Guo, Song
errShare
errSave
mmWave Indoor Channel Measurement Campaign for 5G New Radio Indoor Broadcasting
err2022-06-01
err20
PREAI
errZhang, Hequn; Zhang, Yue; Cosmas, John; Jawad, Nawar; Li, Wei; Muller, Robert; Jiang, Tao
errShare
errSave
Video super-resolution based on deep learning: a comprehensive survey
err2022-04-01
err81
PREAI
errLiu, Hongying; Ruan, Zhubo; Zhao, Peng; Dong, Chao; Shang, Fanhua; Liu, Yuanyuan; Yang, Linlin; Timofte, Radu
errShare
errSave
Poly(4-vinylpyridine) catalyzed hydrolysis of methyl bromide to methanol and dimethyl ether
err2009-09-01
err0
PREAI
errG.K. Surya Prakash; Juan C. Colmenares; Patrice T. Batamack; Thomas Mathew; George A. Olah
errShare
errSave
Pervasive AI for IoT Applications: A Survey on Resource-Efficient Distributed Artificial Intelligence
err2022-01-01
err46
errOAAI
errBaccour, Emna; Mhaisen, Naram; Abdellatif, Alaa Awad; Erbad, Aiman; Mohamed, Amr; Hamdi, Mounir; Guizani, Mohsen
errShare
errSave
no more