.png){kind=icon}
返回
Information decomposition in complex systems via machine learning
.png){kind=icon}
OA
AI
DOI：10.1073/pnas.2312988121.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
One of the fundamental steps toward understanding a complex system is identifying variation at the scale of the system's components that is most relevant to behavior on a macroscopic scale. Mutual information provides a natural means of linking between observables. However, characterizing the manner in which information is distributed across a set of observables is computationally challenging and generally infeasible beyond a handful of measurements. Here, we propose a practical and general methodology that uses machine learning to decompose the information contained in a set of measurements by jointly optimizing a lossy compression of each measurement. Guided by the distributed information bottleneck as a learning objective, the information decomposition identifies the variation in the measurements of the system state most relevant to specified macroscale behavior. We focus our analysis on two paradigmatic complex systems: a Boolean circuit and an amorphous material undergoing plastic deformation. In both examples, the large amount of entropy of the system state is decomposed, bit by bit, in terms of what is most related to macroscale behavior. The identification of meaningful variation in data, with the full generality brought by information theory, is made practical for studying the connection between micro- and macroscale structure in complex systems.
Keyword:
information theory
machine learning for science
complex systems
amorphous plasticity
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
9.1
论文数:
10.8W
被引数:
73.5W
机构
引用论文
Job tenure and quality of work life of people with psychiatric disabilities working in social enterprises在社会企业工作的精神病患者的工作任期和工作生活质量
PREAI
分享收藏Validity and time savings in the selection of short forms of the Wechsler Adult Intelligence Scale—Revised.修订后的韦氏成人智力量表简短形式选择的有效性和时间节省。
PREAI
分享收藏Interpretable machine learning: Fundamental principles and 10 grand challenges可解释的机器学习: 基本原则和十大挑战.png)
STATISTICS SURVEYS
OAAI
STATISTICS SURVEYSIF15.4
OAAI分享收藏分享收藏
查看更多内容