arrow
返回

NormAUG: Normalization-Guided Augmentation for Domain Generalization

delete2024-01-01
delete3
delete
OA
AI
L
Lei Qi
H
Hongpeng Yang
Y
Yinghuan Shi
X
Xin Geng *
DOI:10.1109/TIP.2024.3364516delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during testing. To address this issue, several domain generalization methods have been developed to learn robust and domain-invariant features from multiple training domains that can generalize well to unseen test domains. Data augmentation plays a crucial role in achieving this goal by enhancing the diversity of the training data. In this paper, inspired by the observation that normalizing an image with different statistics generated by different batches with various domains can perturb its feature, we propose a simple yet effective method called NormAUG (Normalization-guided Augmentation). Our method includes two paths: the main path and the auxiliary (augmented) path. During training, the auxiliary path includes multiple sub-paths, each corresponding to batch normalization for a single domain or a random combination of multiple domains. This introduces diverse information at the feature level and improves the generalization of the main path. Moreover, our NormAUG method effectively reduces the existing upper boundary for generalization based on theoretical perspectives. During the test stage, we leverage an ensemble strategy to combine the predictions from the auxiliary path of our model, further boosting performance. Extensive experiments are conducted on multiple benchmark datasets to validate the effectiveness of our proposed method.
Keyword:
Training
Training data
Data augmentation
Data models
Feature extraction
Ensemble learning
Task analysis
Normalization-guided augmentation
domain generalization
domain-shift

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

err分享
err收藏
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
err分享
err收藏
Contrastive-ACE: Domain Generalization Through Alignment of Causal Mechanisms对比-ACE: 通过因果机制的对齐进行域泛化
err2023-01-01
err15
errOAAI
errWang, Yunqi; Liu, Furui; Chen, Zhitang; Wu, Yik-Chung; Hao, Jianye; Chen, Guangyong; Heng, Pheng-Ann
err分享
err收藏
Wired But Not Connected
err2000-02-28
err0
PREAI
errErica B. Lilly; Connie Van Fleet
err分享
err收藏
学者 查看更多内容