arrow
返回

Cost-Aware AUC Optimization via Adaptive Kernel Density Estimation

delete2025-12-04
delete0
PRE
AI
P
Peisong Wen
Q
Qianqian Xu
Z
Zhong Yang
H
Huiyang Shao
L
Linchao Zhang
Q
Qingming Huang
DOI:10.1109/TPAMI.2025.3640236delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Area Under the Receiver Operating Characteristics Curve (AUC) is a widely used metric for evaluating model performance across all possible decision thresholds. Existing methods for AUC optimization typically assume a predefined parametric distribution of thresholds. However, the optimal decision threshold depends on the misclassification costs, which follow a non-parametric distribution.This motivates us to introduce a variant of AUC, termed Cost-aware AUC (CAUC), where the thresholds are conditioned on an empirically determined cost distribution. Unfortunately, as a bilevel problem, it is challenging to directly optimize the CAUC: 1) The inner problem of finding the optimal thresholds is non-convex, leading to potential issues with convergence; 2) The outer problem involves the derivative of False Positive Rate (FPR) w.r.t. the threshold, which is unavailable without an explicit formulation of threshold distribution. To address challenge 1), we utilize the convex relaxation technique to reshape the inner problem into a convex one. Facing challenge 2), we propose an adaptive kernel density estimation framework. Specifically, the derivative of FPR is considered an aggregation of various kernel functions. To avoid manually crafting the aggregation function, we propose a finite-difference-based stochastic algorithm to optimize the model without explicit aggregation function. Theoretically, the proposed algorithm enjoys a convergence rate of $\mathcal {O}(\epsilon ^{-4})$. Empirical studies across various datasets and cost distributions speak to the effectiveness and soundness of our framework.
Keyword:
AUC optimization
adaptive metric optimization
cost-sensitive learning
learning theory

期刊

IEEE Transactions on Pattern Analysis and Machine Intelligence 封面图
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
论文数:
864
被引数:
9.8W

机构

U
university of chinese academy of sciences
学者数:
976
论文数: 395
被引数: 0
B
bytedance
学者数:
88
论文数: 40
被引数: 3
C
china electronics technology group corporation
学者数:
288
论文数: 169
被引数: 0
C
chinese academy of sciences
学者数:
56.7W
论文数: 44.9W
被引数: 704
学者 查看更多机构