arrow
Return

A dynamic loss function for improved semantic segmentation

delete2023-07-07
delete1
PRE
AI
H
Haroon Haider Khan
M
Majid Iqbal Khan *
DOI:10.1007/s00500-023-08818-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The effectiveness of the training process significantly impacts the performance of a machine learning (ML) model. The loss function plays an important role during training as it determines the learning curve of the ML model and offers recommendations for enhancing the model's optimization. The choice of the loss function is crucial for models employed in tasks, such as image classification and semantic segmentation. In the process of segmentation, data are extracted from different image features, which can lead to a diminished gradient value that hampers model training, particularly in high-dimensional scenarios using conventional loss functions. Moreover, as the number of classes increases, major objects often overlap minor objects, leading to false and imprecise detection. To address these issues, a dynamic loss function is needed that can self-adjust to handle class imbalance problems. This paper introduces a dynamic loss function that can adjust itself throughout the model's training process, aiming to tackle the issue of class imbalance. Experiments were conducted on three imbalanced medical image datasets to compare the performance of the proposed dynamic loss function with state-of-the-art loss functions using different ML models. The results demonstrate that during the training process proposed dynamic loss function manages to significantly reduce the convergence time of the model by sharply minimizing the loss. Moreover, during validation process these ML models showed improved performance in terms of accuracy, recall and precision.
Keywords:
Loss function
Hyperparameter
Semantic segmentation

Journal

Soft Computing cover
Soft Computing
IF:
2.5
Papers:
1.0W
Citations:
2.1W

Organization

C
comsats university islamabad (cui)
Scholars:
1.1W
Papers: 1.1W
Citations: 7
Cited Papers

Cited Papers

WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians
err2015-07-01
err1.0K
PREAI
errBernal, Jorge; Javier Sanchez, F.; Fernandez-Esparrach, Gloria; Gil, Debora; Rodriguez, Cristina; Vilarino, Fernando
errShare
errSave
Evolving Neural Networks through a Reverse Encoding Tree
err2020-07-01
err0
errOAAI
errHaoling Zhang; Chao-Han Huck Yang; Hector Zenil; Narsis A. Kiani; Yue Shen; Jesper N. Tegner
errShare
errSave
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
AnatomyNet: Deep learning for fast and fully automated whole-volume segmentation of head and neck anatomy
err2018-12-17
err398
PREAI
errZhu, Wentao; Huang, Yufang; Zeng, Liang; Chen, Xuming; Liu, Yong; Qian, Zhen; Du, Nan; Fan, Wei; Xie, Xiaohui
errShare
errSave
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
errShare
errSave
Combo loss: Handling input and output imbalance in multi-organ segmentation
err2019-07-01
err270
errOAAI
errTaghanaki, Saeid Asgari; Zheng, Yefeng; Zhou, S. Kevin; Georgescu, Bogdan; Sharma, Puneet; Xu, Daguang; Comaniciu, Dorin; Hamarneh, Ghassan
errShare
errSave
researcher View more