返回
Generative Reasoning Integrated Label Noise Robust Deep Image Representation Learning
DOI:10.1109/TIP.2023.3293776.png)
摘要
En 中文
The development of deep learning based image representation learning (IRL) methods has attracted great attention for various image understanding problems. Most of these methods require the availability of a set of high quantity and quality of annotated training images, which can be time-consuming, complex and costly to gather. To reduce labeling costs, crowdsourced data, automatic labeling procedures or citizen science projects can be considered. However, such approaches increase the risk of including label noise in training data. It may result in overfitting on noisy labels when discriminative reasoning is employed as in most of the existing methods. This leads to sub-optimal learning procedures, and thus inaccurate characterization of images. To address this issue, in this paper, we introduce a generative reasoning integrated label noise robust deep representation learning (GRID) approach. The proposed GRID approach aims to model the complementary characteristics of discriminative and generative reasoning for IRL under noisy labels. To this end, we first integrate generative reasoning into discriminative reasoning through a supervised variational autoencoder. This allows the proposed GRID approach to automatically detect training samples with noisy labels. Then, through our label noise robust hybrid representation learning strategy, GRID adjusts the whole learning procedure for IRL of these samples through generative reasoning and that of the other samples through discriminative reasoning. Our approach learns discriminative image representations while preventing interference of noisy labels during training independently from the IRL method being selected. Thus, unlike the existing label noise robust methods, GRID does not depend on the type of annotation, label noise, neural network architecture, loss function or learning task, and thus can be directly utilized for various image understanding problems. Experimental results show the effectiveness of the proposed GRID approach compared to the state-of-the-art methods. The code of the proposed approach is publicly available at https://github.com/gencersumbul/GRID.
Keyword:
Generative reasoning
discriminative reasoning
noise robust learning
image representation learning
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises医学成像中的深度学习: 成像特征,技术趋势,具有进展亮点的案例研究和未来承诺
PROCEEDINGS OF THE IEEE
IF25.9
Adversarial Shape Learning for Building Extraction in VHR Remote Sensing ImagesVHR遥感影像中建筑物提取的对抗性形状学习
Generation of hydroxyl radicals by urban suspended particulate air matter. The role of iron ions城市悬浮颗粒物产生羟基自由基。铁离子的作用:
A Deep Multi-Attention Driven Approach for Multi-Label Remote Sensing Image Classification
IEEE ACCESS
IF3.6
Transition Is a Process: Pair-to-Video Change Detection Networks for Very High Resolution Remote Sensing Images过渡是一个过程: 用于高分辨率遥感图像的对到视频变化检测网络

