arrow
Return

Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning

delete2021-12-02
delete12
PRE
AI
L
Lu Zhao
X
Xiaowei Xu
R
Runping Hou
W
Wangyuan Zhao
H
Hai Zhong
H
Haohua Teng
Y
Yuchen Han
X
Xiaolong Fu
孙建奇 cover
孙建奇 (Jianqi Sun)
赵俊 cover
赵俊 (Jun Zhao) *
DOI:10.1088/1361-6560/ac3b32delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Objective. Subtype classification plays a guiding role in the clinical diagnosis and treatment of non-small-cell lung cancer (NSCLC). However, due to the gigapixel of whole slide images (WSIs) and the absence of definitive morphological features, most automatic subtype classification methods for NSCLC require manually delineating the regions of interest (ROIs) on WSIs. Approach. In this paper, a weakly supervised framework is proposed for accurate subtype classification while freeing pathologists from pixel-level annotation. With respect to the characteristics of histopathological images, we design a two-stage structure with ROI localization and subtype classification. We first develop a method called multi-resolution expectation-maximization convolutional neural network (MR-EM-CNN) to locate ROIs for subsequent subtype classification. The EM algorithm is introduced to select the discriminative image patches for training a patch-wise network, with only WSI-wise labels available. A multi-resolution mechanism is designed for fine localization, similar to the coarse-to-fine process of manual pathological analysis. In the second stage, we build a novel hierarchical attention multi-scale network (HMS) for subtype classification. HMS can capture multi-scale features flexibly driven by the attention module and implement hierarchical features interaction. Results. Experimental results on the 1002-patient Cancer Genome Atlas dataset achieved an AUC of 0.9602 in the ROI localization and an AUC of 0.9671 for subtype classification. Significance. The proposed method shows superiority compared with other algorithms in the subtype classification of NSCLC. The proposed framework can also be extended to other classification tasks with WSIs.
Keywords:
Lung cancer
pathological image
multi-instance learning
subtype classification

Journal

Physics in Medicine and Biology cover
Physics in Medicine and Biology
IF:
3.4
Papers:
1.4W
Citations:
3.1W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159