arrow
返回

Dynamic Quantification With Constrained Error Under Unknown General Dataset Shift

delete2024-07-01
delete0
PRE
AI
B
Benjamin Denham *
E
Edmund Lai
R
Roopak Sinha
M
M. Asif Naeem
DOI:10.1109/TKDE.2023.3349286delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Quantification research has sought to accurately estimate class distributions under dataset shift. While existing methods perform well under assumed conditions of shift, it is not always clear whether such assumptions will hold in a given application. This work extends the analysis and experimental evaluation of our Gain-Some-Lose-Some (GSLS) model for quantification under general dataset shift and incorporates it into a method for dynamically selecting the most appropriate quantification method. Selection by a Kolmogorov-Smirnov test for any shift followed by a newly proposed Adjusted Kolmogorov-Smirnov test for non-prior shift is found to best balance quantification and runtime performance. We also present a framework for constraining quantification prediction intervals to user-specified limits by requesting a smaller set of instance class labels from the user than required with confidence-based rejection.
Keyword:
Sociology
Probabilistic logic
Reliability
Training
Task analysis
Predictive models
Analytical models
Quantification
dataset shift
prediction intervals
shift detection
machine learning

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

A
Auckland University of Technology
学者数:
4.0K
论文数: 4.4K
被引数: 4.7K
引用论文

引用论文

A Review of Off-Line Mode Dataset Shifts
err2020-08-01
err7
PREAI
errTakahashi, Carla C.; Braga, Antonio P.
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Fabrication of polyimide microspheres with high precursor polymer concentration
err2011-04-30
err0
PREAI
errJianjun Lu; Xiaoxia Zhang; Miaoqing Liu; Li Chen; Xingnan Li; Huimin Li; Peitong Xie; Li Lin
err分享
err收藏
Blunt and Penetrating Cardiac Trauma
err2017-10-01
err0
PREAI
errSeth A. Bellister; Bradley M. Dennis; Oscar D. Guillamondegui
err分享
err收藏
Optimal gauge for the multimode Rabi model in circuit QED
err2019-11-25
err0
errOAAI
errMarco Roth; Fabian Hassler; David P. DiVincenzo
err分享
err收藏
Risk factors and outcome of mood disorders in epilepsy: a case-control study
err2003-03-01
err0
errOAAI
errK JAGADHEESAN; ASHWANI K GARG; S.HAQUE NIZAMIE
err分享
err收藏
学者 查看更多内容