返回
Feature Analysis Network: An Interpretable Idea in Deep Learning
DOI:10.1007/s12559-023-10238-0.png)
摘要
En 中文
Deep Learning (DL) stands out as a leading model for processing high-dimensional data, where the nonlinear transformation of hidden layers effectively extracts features. However, these unexplainable features make DL a low interpretability model. Conversely, Bayesian network (BN) is transparent and highly interpretable, and it can be helpful for interpreting DL. To improve the interpretability of DL from the perspective of feature cognition, we propose the feature analysis network (FAN), a DL structure fused with BN. FAN retains the DL feature extraction capability and applies BN as the output layer to learn the relationships between the features and the outputs. These relationships can be probabilistically represented by the structure and parameters of the BN, intuitively. In a further study, a correlation clustering-based feature analysis network (cc-FAN) is proposed to detect the correlations among inputs and to preserve this information to explain the features' physical meaning to a certain extent. To quantitatively evaluate the interpretability of the model, we design the network simplification and interpretability indicators separately. Experiments on eight datasets show that FAN has better interpretability than that of the other models with basically unchanged model accuracy and similar model complexities. On the radar effect mechanism dataset, from the feature structure-based relevance interpretability indicator, FAN is up to 4.8 times better than that of the other models, and cc-FAN is up to 21.5 times better than that of the other models. FAN and cc-FAN enhance the interpretability of the DL model structure from the aspects of features; moreover, based on the input correlations, cc-FAN can help us to better understand the physical meaning of features.
Keyword:
Deep learning
Bayesian networks
Feature analysis
Correlation clustering
期刊
IF:
4.3
论文数:
1.6K
被引数:
3.6K
机构
引用论文
10-km Transmission of 106-Gb/s PAM4 with Directly Modulated DFB Lasers in the CWDM Range10公里传输106-Gb/s PAM4信号,采用直接调制的DFB激光器,在CWDM范围内
Net 100 Gb/s/λ VCSEL+MMF nonlinear Digital Pre-Distortion using Convolutional Neural NetworksNet 100 Gb/s/λ VCSEL+MMF非线性数字预失真技术,采用卷积神经网络实现
106-Gbps PAM4 Operation at an Extinction Ratio above 3.5 dB using a Conventional Buried-Heterostructure Directly Modulated Laser106-Gbps PAM4操作,采用常规埋异质结构直调激光器,消光比超过3.5 dB

