.png){kind=icon}
返回
MGRW-Transformer: Multigranularity Random Walk Transformer Model for Interpretable Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2023.3326283.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep-learning models have been widely used in image recognition tasks due to their strong feature-learning ability. However, most of the current deep-learning models are black box systems that lack a semantic explanation of how they reached their conclusions. This makes it difficult to apply these methods to complex medical image recognition tasks. The vision transformer (ViT) model is the most commonly used deep-learning model with a self-attention mechanism that shows the region of influence as compared to traditional convolutional networks. Thus, ViT offers greater interpretability. However, medical images often contain lesions of variable size in different locations, which makes it difficult for a deep-learning model with a self-attention module to reach correct and explainable conclusions. We propose a multigranularity random walk transformer (MGRW-Transformer) model guided by an attention mechanism to find the regions that influence the recognition task. Our method divides the image into multiple subimage blocks and transfers them to the ViT module for classification. Simultaneously, the attention matrix output from the multiattention layer is fused with the multigranularity random walk module. Within the multigranularity random walk module, the segmented image blocks are used as nodes to construct an undirected graph using the attention node as a starting node and guiding the coarse-grained random walk. We appropriately divide the coarse blocks into finer ones to manage the computational cost and combine the results based on the importance of the discovered features. The result is that the model offers a semantic interpretation of the input image, a visualization of the interpretation, and insight into how the decision was reached. Experimental results show that our method improves classification performance with medical images while presenting an understandable interpretation for use by medical professionals.
Keyword:
Graph random walk
interpretable method
multigranularity formal analysis
self-attention mechanism
vision transformer (ViT)
期刊
IF:
8.9
论文数:
7.5K
被引数:
7.2W
机构
引用论文
Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
.png){kind=icon}
PREAI
分享收藏Simulation of Asphalt Materials Using Finite Element Micromechanical Model with Damage Mechanics
PREAI
分享收藏Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning基于弱监督多示例学习的组织病理学图像肺癌亚型分类
PREAI
分享收藏
Research on the Efficiency of Wireless Power Transfer System Based on Multi-Auxiliary Transmitting Coils基于多辅助发射线圈的无线电能传输系统效率研究
PREAI
分享收藏
查看更多内容