arrow
Return

A multiperspective evaluation framework of spatial transcriptomics clustering methods

delete2026-07-08
delete0
delete
OA
AI
G
Gospel Ozioma Nnadi
V
Vincenzo Bonnici
S
Simone Avesani *
E
Eva Viesi *
R
Rosalba Giugno
DOI:10.1093/nargab/lqag075delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Spatial transcriptomics (ST) allows the exploration of gene expression within tissue microenvironments, driving the development of multiple computational approaches for spatial domain identification. Evaluating these methods typically relies on label-dependent metrics, such as contingency matrices and information-theoretic measures, which require ground-truth annotations, and label-independent metrics, which assess transcriptomic similarity or spatial organization. However, annotations are often incomplete or unavailable, while label-independent metrics fail to jointly evaluate the integration of transcriptomic and spatial information, a core feature of ST clustering methods. To address these limitations, we introduce MultimetricST, a Python-based framework that provides a unified, flexible evaluation strategy integrating both cutting-edge and state-of-the-art label-dependent and label-independent metrics. We applied MultimetricST on two generated synthetic datasets and thirteen datasets derived from seven ST technologies to systematically evaluate the spatial domains identified by eleven state-of-the-art deep learning methods. Our framework highlights the strengths and limitations of each assessment strategy, providing an accessible and reproducible tool for comparative and robust evaluation, and method selection.

Journal

N
NAR Genomics and Bioinformatics
IF:
2.8
Papers:
259
Citations:
0

Organization

U
university of parma
Scholars:
2.9K
Papers: 1.1K
Citations: 0
U
university of verona
Scholars:
2.7K
Papers: 1.1K
Citations: 0
Cited Papers

Cited Papers

Spatiotemporal transcriptomic atlas of mouse organogenesis using DNA nanoball-patterned arrays
errCell
IF0
err2022-05-01
err0
errOAAI
errAo Chen; Sha Liao; Mengnan Cheng; Kailong Ma; Liang Wu; Yiwei Lai; Xiaojie Qiu; Jin Yang; Jiangshan Xu; Shijie Hao; Xin Wang; Huifang Lu; Xi Chen; Xing Liu; Xin Huang; Zhao Li; Yan Hong; Yujia Jiang; Jian Peng; Shuai Liu; Mengzhe Shen; Chuanyu Liu; Quanshui Li; Yue Yuan; Xiaoyu Wei; Huiwen Zheng; Weimin Feng; Zhifeng Wang; Yang Liu; Zhaohui Wang; Yunzhi Yang; Haitao Xiang; Lei Han; Baoming Qin; Pengcheng Guo; Guangyao Lai; Pura Muñoz-Cánoves; Patrick H. Maxwell; Jean Paul Thiery; Qing-Feng Wu; Fuxiang Zhao; Bichao Chen; Mei Li; Xi Dai; Shuai Wang; Haoyan Kuang; Junhou Hui; Liqun Wang; Ji-Feng Fei; Ou Wang; Xiaofeng Wei; Haorong Lu; Bo Wang; Shiping Liu; Ying Gu; Ming Ni; Wenwei Zhang; Feng Mu; Ye Yin; Huanming Yang; Michael Lisby; Richard J. Cornall; Jan Mulder; Mathias Uhlén; Miguel A. Esteban; Yuxiang Li; Longqi Liu; Xun Xu; Jian Wang
errShare
errSave
Data Filtering and Its Prioritization in Pipelines for Spatial Segmentation of Mass Spectrometry Imaging
err2021-03-08
err17
PREAI
errGuo, Lei; Hu, Zhenxing; Zhao, Chao; Xu, Xiangnan; Wang, Shujuan; Xu, Jingjing; Dong, Jiyang; Cai, Zongwei
errShare
errSave
Spatial architecture of the immune microenvironment orchestrates tumor immunity and therapeutic response
err2021-06-25
err244
errOAAI
errFu, Tong; Dai, Lei-Jie; Wu, Song-Yang; Xiao, Yi; Ma, Ding; Jiang, Yi-Zhou; Shao, Zhi-Ming
errShare
errSave
errShare
errSave
Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST
err2023-03-01
err115
errOAAI
errLong, Yahui; Ang, Kok Siong; Li, Mengwei; Chong, Kian Long Kelvin; Sethi, Raman; Zhong, Chengwei; Xu, Hang; Ong, Zhiwei; Sachaphibulkij, Karishma; Chen, Ao; Zeng, Li; Fu, Huazhu; Wu, Min; Lim, Lina Hsiu Kim; Liu, Longqi; Chen, Jinmiao
errShare
errSave
conST: an interpretable multi-modal contrastive learning framework for spatial transcriptomics
err
IF0
err2022-01-17
err0
errOAAI
errYongshuo Zong; Tingyang Yu; Xuesong Wang; Yixuan Wang; Zhihang Hu; Yu Li
errShare
errSave
Tumour evolution and microenvironment interactions in 2D and 3D space
err2024-10-30
err0
errOAAI
errChia-Kuei Mo; Jingxian Liu; Siqi Chen; Erik Storrs; Andre Luiz N. Targino da Costa; Andrew Houston; Michael C. Wendl; Reyka G. Jayasinghe; Michael D. Iglesia; Cong Ma; John M. Herndon; Austin N. Southard-Smith; Xinhao Liu; Jacqueline Mudd; Alla Karpova; Andrew Shinkle; S. Peter Goedegebuure; Abdurrahman Taha Mousa Ali Abdelzaher; Peng Bo; Lauren Fulghum; Samantha Livingston; Metin Balaban; Angela Hill; Joseph E. Ippolito; Vesteinn Thorsson; Jason M. Held; Ian S. Hagemann; Eric H. Kim; Peter O. Bayguinov; Albert H. Kim; Mary M. Mullen; Kooresh I. Shoghi; Tao Ju; Melissa A. Reimers; Cody Weimholt; Liang-I Kang; Sidharth V. Puram; Deborah J. Veis; Russell Pachynski; Katherine C. Fuh; Milan G. Chheda; William E. Gillanders; Ryan C. Fields; Benjamin J. Raphael; Feng Chen; Li Ding
errShare
errSave
Generalizing RNA velocity to transient cell states through dynamical modeling
err2020-08-03
err1.3K
errOAAI
errBergen, Volker; Lange, Marius; Peidli, Stefan; Wolf, F. Alexander; Theis, Fabian J.
errShare
errSave
Identifying multicellular spatiotemporal organization of cells with SpaceFlow
err2022-07-14
err56
errOAAI
errRen, Honglei; Walker, Benjamin L.; Cang, Zixuan; Nie, Qing
errShare
errSave
researcher View more