arrow
返回

Improving loss function for deep convolutional neural network applied in automatic image annotation

delete2023-05-12
delete3
PRE
AI
A
Ali Salar
A
Ali Ahmadi *
DOI:10.1007/s00371-023-02873-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Automatic image annotation (AIA) is a mechanism for describing the visual content of an image with a list of semantic labels. Typically, there is a massive imbalance between positive and negative tags in a picture-in other words, an image includes much fewer positive labels than negative ones. This imbalance can negatively affect the optimization process and diminish the emphasis on gradients from positive labels during training. Although traditional annotation models mainly focus on model structure design, we propose a novel unsymmetrical loss function for a deep convolutional neural network (CNN) that performs differently on positives and negatives, which leads to a reduction in the loss contribution from negative labels and also highlights the contribution of positive ones. During the annotation process, we specify a threshold for each label separately based on the Matthews correlation coefficient (MCC). Extensive experiments on high-vocabulary datasets like Corel 5k, IAPR TC-12, and Esp Game reveal that despite ignoring the semantic relationships between labels, our suggested approach achieves remarkable results compared to the state-of-the-art automatic image annotation models.
Keyword:
Image annotation
Deep learning
Unsymmetrical loss function
Threshold estimation

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

K
K. N. Toosi University of Technology
学者数:
5.3K
论文数: 5.1K
被引数: 3
引用论文

引用论文

Canine Distemper in an Isolated Population of Fishers (Martes pennanti) from California
err2012-10-01
err0
errOAAI
errStefan M. Keller; Mourad Gabriel; Karen A. Terio; Edward J. Dubovi; Elizabeth VanWormer; Rick Sweitzer; Reginald Barret; Craig Thompson; Kathryn Purcell; Linda Munson
err分享
err收藏
Learning semantic dependencies with channel correlation for multi-label classification
err2019-08-01
err7
PREAI
errXue, Lixia; Jiang, Di; Wang, Ronggui; Yang, Juan; Hu, Min
err分享
err收藏
err分享
err收藏
学者 查看更多内容