返回
Uncertainty quantification driven machine learning for improving model accuracy in imbalanced regression tasks
DOI:10.1016/j.eswa.2024.125526.png)
摘要
En 中文
Several factors are known to determine the quality of machine learning models, one of which is the dataset quality. One problem related to the quality of a dataset is the imbalance issue. An imbalanced dataset contains significantly more data points for certain values of the output variable which increases the overfitting risk and negatively affects the prediction accuracy. In this article, we propose using epistemic uncertainty quantification (UQ) of machine learning models to identify rare samples in imbalanced regression problems for balancing the dataset. The developed algorithm, uncertainty quantification-driven imbalanced regression (UQDIR), is guided by UQ to restructure the training set with an adequate weight function using existent samples, eliminating the need for new data collection. After identifying rare samples with UQ, the algorithm selects a sample from the training set, assigns a resampling weight using the new weight function, and finally resamples the selected sample according to its assigned weight. We test UQDIR on several benchmark datasets and different machine learning algorithms, then compare its performance with similar imbalanced regression methods. A metamaterial design problem application is also provided for demonstrating the effectiveness of the algorithm in real-world scenarios. We show that improving the quality of UQ metrics results in improved model accuracy.
Keyword:
Machine learning
Uncertainty quantification
Imbalanced dataset
Metamaterial design
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Automated Performance Metrics and Machine Learning Algorithms to Measure Surgeon Performance and Anticipate Clinical Outcomes in Robotic Surgery
JAMA SURGERY
IF14.9
AdaBoost-CNN: An adaptive boosting algorithm for convolutional neural networks to classify multi -class imbalanced datasets using transfer learningAdaboost-cnn: 卷积神经网络的自适应boosting算法,用于使用迁移学习对多类不平衡数据集进行分类
NEUROCOMPUTING
IF6.5
Training cost-sensitive neural networks with methods addressing the class imbalance problem用解决类不平衡问题的方法训练代价敏感的神经网络

