arrow
Return

Fitting Graphs: A Visual Framework for Transparent and Robust Machine Learning Model Selection

delete2026-06-01
delete0
delete
OA
AI
R
Robbie Nakatsu *
DOI:10.1080/08839514.2026.2678638delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Model developers often rely on cross-validation (CV) to estimate model performance, yet CV – even when repeated multiple times – can produce highly variable results that are difficult to interpret. This paper introduces the fitting graph, an information visualization that helps developers assess model performance, select regularization parameters, and evaluate model robustness. The fitting graph plots the relationship between the regularization parameter (λ) and mean squared error (MSE) across multiple CV repetitions, with a smoothing spline used to estimate the underlying curve. Experiments on several datasets – including the Baseball, Boston Housing, and Parkinson’s datasets – demonstrate that fitting graphs provide a transparent visual summary of model performance behavior across λ values. The spline-estimated curve reliably identifies near-optimal λ values even when only a small number of CV repetitions are performed, substantially reducing computational cost. A case study using an intentionally unstable regression model further shows that the fitting graph can identify stable regions of performance where standard CV often fails. The results indicate that fitting graphs offer a simple and effective visual diagnostic for transparent and robust model development and selection.

Journal

A
Applied Artificial Intelligence
IF:
4.3
Papers:
84
Citations:
0

Organization

L
Loyola Marymount University
Scholars:
601
Papers: 641
Citations: 662
Cited Papers

Cited Papers

No cited papers available