arrow
Return

Algorithm-agnostic significance testing in supervised learning with multimodal data

delete2024-09-25
delete0
delete
OA
AI
L
Lucas Kook *
A
Anton Rask Lundborg
DOI:10.1093/bib/bbae475delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Motivation Valid statistical inference is crucial for decision-making but difficult to obtain in supervised learning with multimodal data, e.g. combinations of clinical features, genomic data, and medical images. Multimodal data often warrants the use of black-box algorithms, for instance, random forests or neural networks, which impede the use of traditional variable significance tests.Results We address this problem by proposing the use of COvariance MEasure Tests (COMETs), which are calibrated and powerful tests that can be combined with any sufficiently predictive supervised learning algorithm. We apply COMETs to several high-dimensional, multimodal data sets to illustrate (i) variable significance testing for finding relevant mutations modulating drug-activity, (ii) modality selection for predicting survival in liver cancer patients with multiomics data, and (iii) modality selection with clinical features and medical imaging data. In all applications, COMETs yield results consistent with domain knowledge without requiring data-driven pre-processing, which may invalidate type I error control. These novel applications with high-dimensional multimodal data corroborate prior results on the power and robustness of COMETs for significance testing.Availability and implementation COMETs are implemented in the cometsR package available on CRAN and pycometsPython library available on GitHub. Source code for reproducing all results is available at https://github.com/LucasKook/comets. All data sets used in this work are openly available.
Keywords:
Conditional independence
Generalised Covariance Measure
multimodal data
Projected Covariance Measure
significance testin
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Briefings in Bioinformatics cover
Briefings in Bioinformatics
IF:
7.7
Papers:
5.6K
Citations:
2.7W

Organization

U
University of Copenhagen
Scholars:
7.6W
Papers: 6.6W
Citations: 86
Cited Papers

Cited Papers

errShare
errSave
LOCAL PERMUTATION TESTS FOR CONDITIONAL INDEPENDENCE
err2022-12-01
err9
errOAAI
errKim, Ilmun; Neykov, Matey; Balakrishnan, Sivaraman; Wasserman, Larry
errShare
errSave
Globalization and populism in Europe
err2020-11-19
err0
errOAAI
errAndreas Bergh; Anders Kärnä
errShare
errSave
Multimodal deep learning for biomedical data fusion: a review
err2022-01-28
err192
errOAAI
errStahlschmidt, Soren Richard; Ulfenborg, Benjamin; Synnergren, Jane
errShare
errSave
Expanding automotive electronic systems
err2002-01-01
err0
PREAI
errG. Leen; D. Heffernan
errShare
errSave
NONPARAMETRIC CONDITIONAL LOCAL INDEPENDENCE TESTING
err2023-10-01
err2
errOAAI
errChristgau, Alexander Mangulad; Petersen, Lasse; Hansen, Niels richard
errShare
errSave
DeepProg: an ensemble of deep-learning and machine-learning models for prognosis prediction using multi-omics data
err2021-07-14
err111
errOAAI
errPoirion, Olivier B.; Jing, Zheng; Chaudhary, Kumardeep; Huang, Sijia; Garmire, Lana X.
errShare
errSave
Simplified Transfer Learning for Chest Radiography Models Using Less Data
errRADIOLOGY
IF15.2
err2022-11-01
err24
PREAI
errSellergren, Andrew B.; Chen, Christina; Nabulsi, Zaid; Li, Yuanzhen; Maschinot, Aaron; Sarna, Aaron; Huang, Jenny; Lau, Charles; Kalidindi, Sreenivasa Raju; Etemadi, Mozziyar; Garcia-Vicente, Florencia; Melnick, David; Liu, Yun; Eswaran, Krish; Tse, Daniel; Beladia, Neeral; Krishnan, Dilip; Shetty, Shravya
errShare
errSave
researcher View more