返回
Dynamic Quantification With Constrained Error Under Unknown General Dataset Shift
DOI:10.1109/TKDE.2023.3349286.png)
摘要
En 中文
Quantification research has sought to accurately estimate class distributions under dataset shift. While existing methods perform well under assumed conditions of shift, it is not always clear whether such assumptions will hold in a given application. This work extends the analysis and experimental evaluation of our Gain-Some-Lose-Some (GSLS) model for quantification under general dataset shift and incorporates it into a method for dynamically selecting the most appropriate quantification method. Selection by a Kolmogorov-Smirnov test for any shift followed by a newly proposed Adjusted Kolmogorov-Smirnov test for non-prior shift is found to best balance quantification and runtime performance. We also present a framework for constraining quantification prediction intervals to user-specified limits by requesting a smaller set of instance class labels from the user than required with confidence-based rejection.
Keyword:
Sociology
Probabilistic logic
Reliability
Training
Task analysis
Predictive models
Analytical models
Quantification
dataset shift
prediction intervals
shift detection
machine learning
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W

