arrow
返回

Diffusion Kernel Attention Network for Brain Disorder Classification

delete2022-10-01
delete23
PRE
AI
张
张俭嘉 (Jianjia Zhang)
L
Luping Zhou
王磊 封面图
王磊 (Lei Wang)
M
Mengting Liu
D
Dinggang Shen *
DOI:10.1109/TMI.2022.3170701delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Constructing and analyzing functional brain networks (FBN) has become a promising approach to brain disorder classification. However, the conventional successive construct-and-analyze process would limit the performance due to the lack of interactions and adaptivity among the subtasks in the process. Recently, Transformer has demonstrated remarkable performance in various tasks, attributing to its effective attention mechanism in modeling complex feature relationships. In this paper, for the first time, we develop Transformer for integrated FBN modeling, analysis and brain disorder classification with rs-fMRI data by proposing a Diffusion Kernel Attention Network to address the specific challenges. Specifically, directly applying Transformer does not necessarily admit optimal performance in this task due to its extensive parameters in the attention module against the limited training samples usually available. Looking into this issue, we propose to use kernel attention to replace the original dot-product attention module in Transformer. This significantly reduces the number of parameters to train and thus alleviates the issue of small sample while introducing a non-linear attention mechanism to model complex functional connections. Another limit of Transformer for FBN applications is that it only considers pair-wise interactions between directly connected brain regions but ignores the important indirect connections. Therefore, we further explore diffusion process over the kernel attention to incorporate wider interactions among indirectly connected brain regions. Extensive experimental study is conducted on ADHD-200 data set for ADHD classification and on ADNI data set for Alzheimer's disease classification, and the results demonstrate the superior performance of the proposed method over the competing methods.
Keyword:
Transformers
Kernel
Feature extraction
Brain modeling
Task analysis
Time series analysis
Training
Attention network
brain disease classification
brain network
kernel
diffusion process
transformer

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

U
University of Wollongong
学者数:
1.3W
论文数: 1.6W
被引数: 2.8W
U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
S
ShanghaiTech University
学者数:
9.7K
论文数: 5.9K
被引数: 1.6W
学者 查看更多机构
引用论文

引用论文

Transformers in Vision: A Survey视觉中的变形金刚: 一项调查
err2022-09-13
err1.1K
errOAAI
errKhan, Salman; Naseer, Muzammal; Hayat, Munawar; Zamir, Syed Waqas; Khan, Fahad Shahbaz; Shah, Mubarak
err分享
err收藏
err分享
err收藏
err分享
err收藏
D
err2018-10-27
err0
PREAI
errSpringer Fachmedien Wiesbaden
err分享
err收藏
Comparison of GC–MS and FTIR methods for quantifying naphthenic acids in water samples
err2008-11-01
err0
PREAI
errAngela C. Scott; Rozlyn F. Young; Phillip M. Fedorak
err分享
err收藏
Infiltration anesthetic lidocaine inhibits cancer cell invasion by modulating ectodomain shedding of heparin‐binding epidermal growth factor‐like growth factor (HB‐EGF)
err2002-07-08
err0
PREAI
errTadanori Mammoto; Shigeki Higashiyama; Mutsuko Mukai; Akiko Mammoto; Masako Ayaki; Takashi Mashimo; Yukio Hayashi; Yoshihiko Kishi; Hiroyuki Nakamura; Hitoshi Akedo
err分享
err收藏
学者 查看更多内容