Multi-Label Retinal Disease Classification Using Transformers

doi:10.1109/JBHI.2022.3214086

2023-06-01

Manuel Alejandro Rodríguez *

Hasan Al-Marzouqi

Panos Liatsis

DOI：10.1109/JBHI.2022.3214086

原文链接

原文求助

摘要

En 中文

Early detection of retinal diseases is one of the most important means of preventing partial or permanent blindness in patients. In this research, a novel multi-label classification system is proposed for the detection of multiple retinal diseases, using fundus images collected from a variety of sources. First, a new multi-label retinal disease dataset, the MuReD dataset, is constructed, using a number of publicly available datasets for fundus disease classification. Next, a sequence of post-processing steps is applied to ensure the quality of the image data and the range of diseases, present in the dataset. For the first time in fundus multi-label disease classification, a transformer-based model optimized through extensive experimentation is used for image analysis and decision making. Numerous experiments are performed to optimize the configuration of the proposed system. It is shown that the approach performs better than state-of-the-art works on the same task by 7.9% and 8.1% in terms of AUC score for disease detection and disease classification, respectively. The obtained results further support the potential applications of transformer-based architectures in the medical imaging field.

Keyword:

Multi-label

fundus imaging

disease classification

transformer

deep learning

期刊

IEEE Journal of Biomedical and Health Informatics

IF:

6.8

论文数:

4.5K

被引数:

2.0W

机构

暂无机构信息

引用论文

A survey on medical image analysis in diabetic retinopathy

MEDICAL IMAGE ANALYSIS

IF11.8

2020-08-01

PREAI

Stolte, Skylar; Fang, Ruogu

Multi-Label Classification of Fundus Images With Graph Convolutional Network and Self-Supervised Learning 基于图卷积网络和自监督学习的眼底图像多标签分类

ieee signal processing magazine

IF3.9

2021-01-01

PREAI

Lin, Jinke; Cai, Qingling; Lin, Manying

Modeling and Enhancing Low-Quality Retinal Fundus Images

IEEE TRANSACTIONS ON MEDICAL IMAGING

IF9.8

2021-03-01

OAAI

Shen, Ziyi; Fu, Huazhu; Shen, Jianbing; Shao, Ling

Automatic detection of 39 fundus diseases and conditions in retinal photographs using deep neural networks 使用深度神经网络自动检测视网膜照片中的39种眼底疾病和状况

NATURE COMMUNICATIONS

IF15.7

2021-08-10

132

OAAI

Cen, Ling-Ping; Ji, Jie; Lin, Jian-Wei; Ju, Si-Tong; Lin, Hong-Jie; Li, Tai-Ping; Wang, Yun; Yang, Jian-Feng; Liu, Yu-Fen; Tan, Shaoying; Tan, Li; Li, Dongjie; Wang, Yifan; Zheng, Dezhi; Xiong, Yongqun; Wu, Hanfu; Jiang, Jingjing; Wu, Zhenggen; Huang, Dingguo; Shi, Tingkun; Chen, Binyao; Yang, Jianling; Zhang, Xiaoling; Luo, Li; Huang, Chukai; Zhang, Guihua; Huang, Yuqiang; Ng, Tsz Kin; Chen, Haoyu; Chen, Weiqi; Pang, Chi Pui; Zhang, Mingzhi

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations 视觉基因组: 使用众包密集图像注释连接语言和视觉

INTERNATIONAL JOURNAL OF COMPUTER VISION

IF9.3

2017-02-06

3.1K

OAAI

Krishna, Ranjay; Zhu, Yuke; Groth, Oliver; Johnson, Justin; Hata, Kenji; Kravitz, Joshua; Chen, Stephanie; Kalantidis, Yannis; Li, Li-Jia; Shamma, David A.; Bernstein, Michael S.; Li Fei-Fei

Learning multi-label scene classification 学习多标签场景分类

PATTERN RECOGNITION

IF7.6

2004-09-01

2.0K

PREAI

Boutell, MR; Luo, JB; Shen, XP; Brown, CM

Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source 以五氧化二磷为掺杂源合成n型半导体金刚石膜

Applied Physics A Solids and Surfaces

IF0

1990-10-01

PREAI