arrow
返回

Exploiting classifier inter-level features for efficient out-of-distribution detection

delete2024-02-01
delete1
PRE
AI
J
Jamil Fayyad
K
Kashish Gupta
N
Navid Mahdian
D
Dominique Gruyer
H
Homayoun Najjaran *
DOI:10.1016/j.imavis.2023.104897delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning approaches have achieved state-of-the-art performance in a wide range of applications. Most often, however, it is falsely assumed that samples at inference follow a similar distribution as the training data. This assumption impairs models' ability to handle Out-of-Distribution (OOD) data during deployment. While several OOD detection approaches mostly focus on outputs of the last layer, we propose a novel mechanism that exploits features extracted from intermediate layers of a deep classifier. Specifically, we train an off-the-shelf auxiliary network using features of early layers to learn distinctive representations that improve OOD detection. The proposed network can be appended to any classification model without imposing any modification to its original architecture. Additionally, the mechanism does not require access to OOD data during training. We evaluate the performance of the mechanism on a variety of backbone architectures and datasets for near-OOD and far-OOD scenarios. The results demonstrate improvements in OOD detection compared to other state-of-the-art approaches. In particular, our proposed mechanism improves AUROC by 14.2% and 8.3% in comparison to the strong OOD baseline method, and by 3.2% and 3.9% in comparison to the second-best performing approach, on CIFAR-10 and CIFAR-100 datasets respectively.
Keyword:
Out -of -distribution detection
Deep learning -based classification
Machine learning
Feature exploitation
Intermediate feature extraction

期刊

Image and Vision Computing 封面图
Image and Vision Computing
IF:
4.2
论文数:
4.1K
被引数:
6.7K

机构

U
universite gustave-eiffel
学者数:
5.6K
论文数: 4.8K
被引数: 5
U
University of Victoria
学者数:
1.0W
论文数: 1.0W
被引数: 1.5W
U
University of British Columbia
学者数:
7.0W
论文数: 6.1W
被引数: 8.6W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Detecting out-of-distribution samples via variational auto-encoder with reliable uncertainty estimation
err2022-01-01
err21
errOAAI
errRan, Xuming; Xu, Mingkun; Mei, Lingrui; Xu, Qi; Liu, Quanying
err分享
err收藏
Preparation of zinc oxide free, transparent rubber nanocomposites using a layered double hydroxide filler
err2011-01-01
err0
PREAI
errAmit Das; De-Yi Wang; Andreas Leuteritz; Kalaivani Subramaniam; H. Chris Greenwell; Udo Wagenknecht; Gert Heinrich
err分享
err收藏
Effect of the addition of young bamboo culm flour as a sugar and/or fat substitute in cookie formulations
err2019-12-01
err0
errOAAI
errMária Herminia Ferrari FELISBERTO; Patricia Satie Endo MIYAKE; Antonio Ludovico BERALDO; André Rinaldi FUKUSHIMA; Luís Antônio Baffile LEONI; Maria Teresa Pedrosa Silva CLERICI
err分享
err收藏
MIO-TCD: A New Benchmark Dataset for Vehicle Classification and Localization
err2018-10-01
err86
PREAI
errLuo, Zhiming; Branchaud-Charron, Frederic; Lemaire, Carl; Konrad, Janusz; Li, Shaozi; Mishra, Akshaya; Achkar, Andrew; Eichel, Justin; Jodoin, Pierre-Marc
err分享
err收藏
学者 查看更多内容