Evaluating Transfer Learning and Multiple Instance Learning for Domain-Specific Endoscopic Video Classification

doi:10.1007/978-981-95-4100-3_21

Evaluating Transfer Learning and Multiple Instance Learning for Domain-Specific Endoscopic Video Classification

2026-01-01

0

PRE

AI

DOI：10.1007/978-981-95-4100-3_21

Original

Original request for help

Save

Abstract

En 中文

Inflammatory Bowel Disease (IBD) is commonly assessed through endoscopy, but manual interpretation suffers from interobserver variability and limited scalability. Deep learning models offer a path toward standardizing evaluations, yet their effectiveness is constrained by limited task-specific data and the complexity of video-based scoring. Transfer learning from large image datasets like ImageNet is often used to address data scarcity, but such general-purpose features may not align well with medical imagery. This paper investigates the effectiveness of domain-specific pretraining for endoscopic video classification under weak supervision. We apply a multiple instance learning (MIL) framework to classify inflammation status from endoscopy videos using a range of deep learning architectures pretrained on either ImageNet, general medical images, or the domain-specific GastroNet5M dataset. Our findings show that models pretrained on endoscopy-specific data consistently outperform general-purpose models across both internal and external datasets, achieving superior F1 Score and AUC values. These results highlight the importance of domain-aligned feature representations and weakly supervised learning strategies in medical video analysis.

Keywords:

Endoscopy

Inflammatory Bowel Disease

Video Classification

Multiple Instance Learning

Transfer Learning

Evaluating Transfer Learning and Multiple Instance Learning for Domain-Specific Endoscopic Video Classification

Abstract

Journal

Organization