arrow
Return

One-pass AUC optimization

delete2016-07-01
delete27
delete
OA
AI
W
Wei Gao
L
Lu Wang
靳榕 (Rong Jin)
S
Shenghuo Zhu
Z
Zhi‐Hua Zhou *
DOI:10.1016/j.artint.2016.03.003delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
AUC is an important performance measure that has been used in diverse tasks, such as class-imbalanced learning, cost-sensitive learning, learning to rank, etc. In this work, we focus on one-pass AUC optimization that requires going through training data only once without having to store the entire training dataset. Conventional online learning algorithms cannot be applied directly to one-pass AUC optimization because AUC is measured by a sum of losses defined over pairs of instances from different classes. We develop a regression-based algorithm which only needs to maintain the first and second order statistics of training data in memory, resulting in a storage requirement independent of the number of training data. To efficiently handle high-dimensional data, we develop two deterministic algorithms that approximate the covariance matrices. We verify, both theoretically and empirically, the effectiveness of the proposed algorithms. (C) 2016 Elsevier B.V. All rights reserved.
Keywords:
AUC
ROC curve
Online learning
Large-scale learning
Least square loss
Random projection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

A
alibaba group
Scholars:
1.1K
Papers: 789
Citations: 0
N
nanjing university
Scholars:
7.7W
Papers: 5.6W
Citations: 87