.png){kind=icon}
Return
Improving loss function for deep convolutional neural network applied in automatic image annotation
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-023-02873-3.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Automatic image annotation (AIA) is a mechanism for describing the visual content of an image with a list of semantic labels. Typically, there is a massive imbalance between positive and negative tags in a picture-in other words, an image includes much fewer positive labels than negative ones. This imbalance can negatively affect the optimization process and diminish the emphasis on gradients from positive labels during training. Although traditional annotation models mainly focus on model structure design, we propose a novel unsymmetrical loss function for a deep convolutional neural network (CNN) that performs differently on positives and negatives, which leads to a reduction in the loss contribution from negative labels and also highlights the contribution of positive ones. During the annotation process, we specify a threshold for each label separately based on the Matthews correlation coefficient (MCC). Extensive experiments on high-vocabulary datasets like Corel 5k, IAPR TC-12, and Esp Game reveal that despite ignoring the semantic relationships between labels, our suggested approach achieves remarkable results compared to the state-of-the-art automatic image annotation models.
Keywords:
Image annotation
Deep learning
Unsymmetrical loss function
Threshold estimation
Journal
IF:
2.9
Papers:
4.6K
Citations:
6.5K
Organization
Cited Papers
ShareSaveShareSaveLearning semantic dependencies with channel correlation for multi-label classification.png)
VISUAL COMPUTER
VISUAL COMPUTERIF2.9
PREAI
ShareSaveShareSaveShareSaveA Semi-supervised Learning Approach Based on Adaptive Weighted Fusion for Automatic Image Annotation
PREAI
ShareSaveShareSaveThe advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluationBMC GENOMICS
OAAI
BMC GENOMICSIF3.7
OAAIShareSaveShareSave
View more