arrow
Return

Variable Importance Estimation for High-Dimensional Optimisation

delete2026-01-01
delete0
PRE
AI
K
Kelly J. Hunter
S
Sarah L. Thomson
E
Emma Hart *
DOI:10.1007/978-3-032-07938-1_10delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Machine learning models trained on the solution spaces of optimisation problems can potentially shed light on variable importance. In prior work the recently established combinatorial benchmark, Polynomial Unconstrained Binary Optimisation with variable importance (PUBOi) was used in this way. Small search spaces were considered so that it was possible to fully enumerate as well as sample. The study confirmed that explainable artificial intelligence (XAI) feature attribution methods can detect these ground-truth importances in this combinatorial optimisation problem. In the present work, we consider larger problem dimensions with the aim of establishing whether the results and XAI methods scale. We compare the distributions of important and unimportant variables across PUBOi instances for prevalent XAI methods to uncover how well important variables are captured. We found that in high-dimensional instances the important variables were captured but to a lesser extent than in low-dimensional instances. The analysis will help to inform future work in adapting search operators during optimisation.
Keywords:
explainable artificial intelligence
variable importance
pseudo-boolean optimisation

Journal

A
ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, UKCI 2025
IF:
0
Papers:
39
Citations:
0

Organization

E
edinburgh napier university
Scholars:
460
Papers: 283
Citations: 0
Cited Papers

Cited Papers

Explainable Landscape-Aware Optimization Performance Prediction
err2021-12-05
err0
errOAAI
errRisto Trajanov; Stefan Dimeski; Martin Popovski; Peter Korošec; Tome Eftimov
errShare
errSave
Explainable Landscape Analysis in Automated Algorithm Performance Prediction
err2022-04-15
err0
PREAI
errRisto Trajanov; Stefan Dimeski; Martin Popovski; Peter Korošec; Tome Eftimov
errShare
errSave
Into the Black Box: Mining Variable Importance with XAI
err2025-01-01
err0
PREAI
errHunter,Kelly; Thomson,Sarah L.; Hart,Emma
errShare
errSave
PUBO$$_i$$: A Tunable Benchmark with Variable Importance
err2022-01-01
err0
PREAI
errTari,Sara; Verel,Sébastien; Omidvar,Mahmoud
errShare
errSave
Random Forests
err
IF0
err2001-01-01
err0
PREAI
errLeo Breiman
errShare
errSave
Towards explainable metaheuristic
err2022-07-19
err0
errOAAI
errManjinder Singh; Alexander E. I. Brownlee; David Cairns
errShare
errSave
researcher View more