.png){kind=icon}
返回
Search-based fairness testing for regression-based machine learning systems
.png){kind=icon}
OA
AI
DOI：10.1007/s10664-022-10116-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Context Machine learning (ML) software systems are permeating many aspects of our life, such as healthcare, transportation, banking, and recruitment. These systems are trained with data that is often biased, resulting in biased behaviour. To address this issue, fairness testing approaches have been proposed to test ML systems for fairness, which predominantly focus on assessing classification-based ML systems. These methods are not applicable to regression-based systems, for example, they do not quantify the magnitude of the disparity in predicted outcomes, which we identify as important in the context of regression-based ML systems. Method: We conduct this study as design science research. We identify the problem instance in the context of emergency department (ED) wait-time prediction. In this paper, we develop an effective and efficient fairness testing approach to evaluate the fairness of regression-based ML systems. We propose fairness degree, which is a new fairness measure for regression-based ML systems, and a novel search-based fairness testing (SBFT) approach for testing regression-based machine learning systems. We apply the proposed solutions to ED wait-time prediction software. Results: We experimentally evaluate the effectiveness and efficiency of the proposed approach with ML systems trained on real observational data from the healthcare domain. We demonstrate that SBFT significantly outperforms existing fairness testing approaches, with up to 111% and 190% increase in effectiveness and efficiency of SBFT compared to the best performing existing approaches. Conclusion: These findings indicate that our novel fairness measure and the new approach for fairness testing of regression-based ML systems can identify the degree of fairness in predictions, which can help software teams to make data-informed decisions about whether such software systems are ready to deploy. The scientific knowledge gained from our work can be phrased as a technological rule; to measure the fairness of the regression-based ML systems in the context of emergency department wait-time prediction use fairness degree and search-based techniques to approximate it.
Keyword:
Fairness testing
Software testing
Search-based software testing
Software fairness
Machine learning
Bias
期刊
IF:
3.6
论文数:
2.0K
被引数:
5.3K
机构
引用论文
Preventing and Experiencing Ischemic Heart Disease as a Woman: State of the Science A Scientific Statement From the American Heart Association作为女性预防和经历缺血性心脏病: 科学状况美国心脏协会的科学声明.png)
CIRCULATIONOAAI
CIRCULATIONIF38.6
OAAI分享收藏分享收藏Acute Myocardial Infarction in Women A Scientific Statement From the American Heart Association女性急性心肌梗塞美国心脏协会的科学声明CIRCULATION
OAAI
CIRCULATIONIF38.6
OAAI分享收藏Tachykinin and Calcitonin Gene-Related Peptide Immunoreactivities and Mrnas in the Mammalian Enteric Nervous System and Sensory Ganglia哺乳动物肠神经系统和感觉神经节中的速激肽和降钙素基因相关肽的免疫反应性和mrna
PREAI
分享收藏
查看更多内容