Null models for comparing information decomposition across complex systems

Alberto Liardi

doi:10.1371/journal.pcbi.1013629

Null models for comparing information decomposition across complex systems

2025-11-01

0

PRE

AI

DOI：10.1371/journal.pcbi.1013629

Original

Original request for help

Save

Abstract

En 中文

A key feature of information theory is its universality, as it can be applied to study a broad variety of complex systems. However, many information-theoretic measures can vary significantly even across systems with similar properties, making normalisation techniques essential for allowing meaningful comparisons across datasets. Inspired by the framework of Partial Information Decomposition (PID), here we introduce Null Models for Information Theory (NuMIT), a null model-based non-linear normalisation procedure which improves upon standard entropy-based normalisation approaches and overcomes their limitations. We provide practical implementations of the technique for systems with different statistics, and showcase the method on synthetic models and on human neuroimaging data. Our results demonstrate that NuMIT provides a robust and reliable tool to characterise complex systems of interest, allowing cross-dataset comparisons and providing a meaningful significance test for PID analyses.

Keywords:

TOPOLOGY

SERIES

Null models for comparing information decomposition across complex systems

Abstract

Journal

Organization