arrow
返回

Cyclical Learning Rate Optimization on Deep Learning Model for Brain Tumor Segmentation

delete2023-01-01
delete1
delete
OA
AI
A
Aziz Fajar
R
Riyanarto Sarno *
C
Chastine Fatichah
R
Rahadian Indarto Susilo
G
Gusti Pangestu
DOI:10.1109/ACCESS.2023.3326475delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, deep learning has found widespread applications in tasks such as segmentation and classification. Fine-tuning hyperparameters is crucial to improve performance, with the learning rate being a key parameter. Various methods, including adaptive learning rates, learning rate scheduling, and cyclical learning rates, have been used to optimize learning rates. Cyclical learning rates offer significant benefits with minimal computational cost, as seen in previous research. This study introduces a novel approach to tuning the cyclical learning rate, which incorporates the exponential moving average. These methods are applied to the BraTS 2021 dataset for segmentation tasks, resulting in superior performance compared to the previous approach. Our proposed method reduces the epochs required to reach convergence by 19 and 54 epochs for U-Net and Dense U-net, respectively. For Res U-net, the epoch needed to convergence is 10 epochs more. However, the proposed method produces lower loss values with 0.707, 0.657, and 0.665 compared to the previous method with 0.712, 0.685, and 0.725 for U-net, Res U-net, and Dense U-net, respectively.
Keyword:
3D image data
deep learning
exponential moving average
information and communication technology
learning rate
scientific research

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

I
institut teknologi sepuluh nopember
学者数:
2.1K
论文数: 1.2K
被引数: 0
U
universitas bina nusantara
学者数:
815
论文数: 583
被引数: 0
Airlangga University 封面图
Airlangga University
学者数:
4.5K
论文数: 2.3K
被引数: 1.7K
学者 查看更多机构
引用论文

引用论文

Iterative reconstruction of low-dose CT based on differential sparse基于差分稀疏的低剂量CT迭代重建
err2023-01-01
err127
PREAI
errLu, Siyu; Yang, Bo; Xiao, Ye; Liu, Shan; Liu, Mingzhe; Yin, Lirong; Zheng, Wenfeng
err分享
err收藏
CT-Based Automatic Spine Segmentation Using Patch-Based Deep Learning
err2023-03-04
err52
errOAAI
errQadri, Syed Furqan; Lin, Hongxiang; Shen, Linlin; Ahmad, Mubashir; Qadri, Salman; Khan, Salabat; Khan, Maqbool; Zareen, Syeda Shamaila; Akbar, Muhammad Azeem; Bin Heyat, Md Belal; Qamar, Saqib
err分享
err收藏
When Does Model-Based Control Pay Off?
err2016-08-26
err0
errOAAI
errWouter Kool; Fiery A. Cushman; Samuel J. Gershman
err分享
err收藏
err分享
err收藏
err分享
err收藏
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)多模态脑肿瘤图像分割基准 (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
err分享
err收藏
学者 查看更多内容