arrow
返回

Uncertainty quantification driven machine learning for improving model accuracy in imbalanced regression tasks

delete2025-02-01
delete0
PRE
AI
T
Tuba Dolar
J
Jie Chen
W
Wei Chen *
DOI:10.1016/j.eswa.2024.125526delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Several factors are known to determine the quality of machine learning models, one of which is the dataset quality. One problem related to the quality of a dataset is the imbalance issue. An imbalanced dataset contains significantly more data points for certain values of the output variable which increases the overfitting risk and negatively affects the prediction accuracy. In this article, we propose using epistemic uncertainty quantification (UQ) of machine learning models to identify rare samples in imbalanced regression problems for balancing the dataset. The developed algorithm, uncertainty quantification-driven imbalanced regression (UQDIR), is guided by UQ to restructure the training set with an adequate weight function using existent samples, eliminating the need for new data collection. After identifying rare samples with UQ, the algorithm selects a sample from the training set, assigns a resampling weight using the new weight function, and finally resamples the selected sample according to its assigned weight. We test UQDIR on several benchmark datasets and different machine learning algorithms, then compare its performance with similar imbalanced regression methods. A metamaterial design problem application is also provided for demonstrating the effectiveness of the algorithm in real-world scenarios. We show that improving the quality of UQ metrics results in improved model accuracy.
Keyword:
Machine learning
Uncertainty quantification
Imbalanced dataset
Metamaterial design

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

N
Northwestern University
学者数:
6.2W
论文数: 5.3W
被引数: 3.9K
引用论文

引用论文

Altered expression of synaptotagmin 13 mRNA in adult mouse brain after contextual fear conditioning
err2012-09-01
err0
PREAI
errSeungrie Han; Soontaek Hong; Dongmin Lee; Myeong-hoe Lee; June-seek Choi; Min Jung Koh; Woong Sun; Hyun Kim; Hyun Woo Lee
err分享
err收藏
Pre-processing approaches for imbalanced distributions in regression
err2019-05-01
err64
PREAI
errBranco, Paula; Torgo, Luis; Ribeiro, Rita P.
err分享
err收藏
Hybrid Classifier Ensemble for Imbalanced Data
err2020-04-01
err87
PREAI
errYang, Kaixiang; Yu, Zhiwen; Wen, Xin; Cao, Wenming; Chen, C. L. Philip; Wong, Hau-San; You, Jane
err分享
err收藏
Proteomic Analysis of Human Lens Epithelial Cells Exposed to Microwaves
err2007-12-21
err0
PREAI
errHong-Wu Li; Ke Yao; Hong-Ying Jin; Li-Xia Sun; De-Qiang Lu; Yi-Bo Yu
err分享
err收藏
A novel ensemble method for classifying imbalanced data一种新的不平衡数据分类集成方法
err2015-05-01
err338
PREAI
errSun, Zhongbin; Song, Qinbao; Zhu, Xiaoyan; Sun, Heli; Xu, Baowen; Zhou, Yuming
err分享
err收藏
err分享
err收藏
学者 查看更多内容