arrow
返回

Confidence-based and sample-reweighted test-time adaptation

delete2024-01-01
delete0
PRE
AI
H
Hao Yang
M
Min Wang
Z
Zhengfei Yu
H
Hang Zhang
Y
Yun Zhou *
DOI:10.1016/j.knosys.2023.111164delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, Test Time Adaptation (TTA) has emerged as a solution to real-world challenges posed by inconsistencies between training and testing distributions. This technique refines a pretrained model for a target domain using only unlabeled test data. However, most existing TTA methods assign equal weights to all samples and are dominated by entropy minimization for adaptation. In this paper, we propose a novel confidence-based optimization strategy and theoretically show that the proposed method tends to yield larger gradients than entropy-based methods and has the potential to enhance performance. Moreover, we show that the importance of samples is frequently underestimated and propose a novel truncation function that assigns an adaptive weight to each sample. The proposed method, named CSTTA, consists of a novel confidence-based optimization strategy and sample-reweighted strategy. It aims to better utilize the sample information for quicker adaptation to new scenarios. Extensive experiments on three digital datasets (CIFAR10-C, CIFAR100-C and ImageNet-C) and a real-world dataset (ImageNet-3DCC) demonstrate the effectiveness of the proposed method.
Keyword:
Deep learning
Test time adaptation
Distribution shift
Robustness

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

err2003-01-01
err0
PREAI
errLászló Bene
err分享
err收藏
ACDC: Online unsupervised cross-domain adaptation
err2022-10-01
err6
errOAAI
errde Carvalho, Marcus; Pratama, Mahardhika; Zhang, Jie; Yee, Edward Yapp Kien
err分享
err收藏
Lateral Crashing of Tri-Axially Braided Composite Tubes三轴编织复合管的侧向碰撞
err2012-04-26
err0
PREAI
errNageswara R. Janapala; Zhanjun Wu; Fu-Kuo Chang; Robert K. Goldberg
err分享
err收藏
err分享
err收藏
Expression of the alternative splicing variants of bcl6b in medaka Oryzias latipes
err2019-01-01
err0
PREAI
errRunshuai Zhang; Xiaomei Ke; Kongyue Wu; Hao Shen; Emile Nibona; Abdullah Al Hafiz; Xiaoting Liang; Weiyuan Ye; Qingchun Zhou; Xueping Zhong; Haobin Zhao
err分享
err收藏
学者 查看更多内容