.png){kind=icon}
返回
Video Polyp Segmentation: A Deep Learning Perspective
.png){kind=icon}
OA
AI
DOI：10.1007/s11633-022-1371-y.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present the first comprehensive video polyp segmentation (VPS) study in the deep learning era. Over the years, developments in VPS are not moving forward with ease due to the lack of a large-scale dataset with fine-grained segmentation annotations. To address this issue, we first introduce a high-quality frame-by-frame annotated VPS dataset, named SUN-SEG, which contains 158 690 colonoscopy video frames from the well-known SUN-database. We provide additional annotation covering diverse types, i.e., attribute, object mask, boundary, scribble, and polygon. Second, we design a simple but efficient baseline, named PNS+, which consists of a global encoder, a local encoder, and normalized self-attention (NS) blocks. The global and local encoders receive an anchor frame and multiple successive frames to extract long-term and short-term spatial-temporal representations, which are then progressively refined by two NS blocks. Extensive experiments show that PNS+ achieves the best performance and real-time inference speed (170 fps), making it a promising solution for the VPS task. Third, we extensively evaluate 13 representative polyp/object segmentation models on our SUN-SEG dataset and provide attribute-based comparisons. Finally, we discuss several open issues and suggest possible research directions for the VPS community. Our project and dataset are publicly available at https://github.com/GewelsJI/VPS.
Keyword:
Video polyp segmentation (VPS)
dataset
self-attention
colonoscopy
abdomen
期刊
IF:
8.7
论文数:
303
被引数:
882
机构
引用论文
WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians在结肠镜检查中准确突出显示息肉的wm-dova地图: 医生的验证与显著性地图
PREAI
分享收藏Satellite‐derived NDVI underestimates the advancement of alpine vegetation growth over the past three decades.png)
Ecology
OAAI
EcologyIF0
OAAI分享收藏
查看更多内容