logo
CanyamAI summaries for academic research
language
MobileMobile
  • Phone FeatureWeChat Mini Program
EnglishEnglish
noticeNotice
BlogBlog
delete
arrow
Return

Optimizing deep learning models: A review

delete2025-09-01
delete0
PRE
AI
A
Abdelkader Belhadri *
I
Ibtissam Benchennane
DOI：10.1177/15741702251370052delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advances in deep learning have enabled the development of highly powerful models, but these models are also extremely resource-intensive. This results in high financial costs, prolonged training times, and a significant environmental impact. Consequently, optimizing the training process is essential to mitigate these costs while maintaining or enhancing performance. In this context, software-level optimization plays a crucial role by improving training pipelines, memory management, and overall code efficiency. Fine-tuning hyperparameters, as part of this code optimization process, is the focus of this review, which examines how to effectively combine and adjust these parameters to boost overall model performance while reducing both costs and environmental impact.
Keywords:
deep learning
learning rate
momentum
weight decay

Journal

M
MULTIAGENT AND GRID SYSTEMS
IF:
0.4
Papers:
10
Citations:
0

Organization

No organization information available