arrow
返回

Tiny polyp detection from endoscopic video frames using vision transformers

delete2024-04-04
delete1
delete
OA
AI
E
Entong Liu
B
Bishi He *
D
Darong Zhu
Y
Yuanjiao Chen
Z
Zhe Xu
DOI:10.1007/s10044-024-01254-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning techniques can be effective in helping doctors diagnose gastrointestinal polyps. Currently, processing video frame sequences containing a large amount of spurious noise in polyp detection suffers from elevated recall and mean average precision. Moreover, the mean average precision is also low when the polyp target in the video frame has large-scale variability. Therefore, we propose a tiny polyp detection from endoscopic video frames using Vision Transformers, named TPolyp. The proposed method uses a cross-stage Swin Transformer as a multi-scale feature extractor to extract deep feature representations of data samples, improves the bidirectional sampling feature pyramid, and integrates the prediction heads of multiple channel self-attention mechanisms. This approach focuses more on the feature information of the tiny object detection task than convolutional neural networks and retains relatively deeper semantic information. It additionally improves feature expression and discriminability without increasing the computational complexity. Experimental results show that TPolyp improves detection accuracy by 7%, recall by 7.3%, and average accuracy by 7.5% compared to the YOLOv5 model, and has better tiny object detection in scenarios with blurry artifacts.
Keyword:
Polyp detection
Endoscopic video analysis
Tiny object detection
Vision transformers
Gastrointestinal diseases

期刊

Pattern Analysis and Applications 封面图
Pattern Analysis and Applications
IF:
2
论文数:
1.9K
被引数:
1.9K

机构

H
Hangzhou Dianzi University
学者数:
1.3W
论文数: 9.6K
被引数: 7.5K
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Computer-aided diagnosis for characterization of colorectal lesions: comprehensive software that includes differentiation of serrated lesions
err2020-10-01
err35
PREAI
errPu, Leonardo Zorron Cheng Tao; Maicas, Gabriel; Tian, Yu; Yamamura, Takeshi; Nakamura, Masanao; Suzuki, Hiroto; Singh, Gurfarmaan; Rana, Khizar; Hirooka, Yoshiki; Burt, Alastair D.; Fujishiro, Mitsuhiro; Carneiro, Gustavo; Singh, Rajvinder
err分享
err收藏
Fluoropyrrolidine amides as dipeptidyl peptidase IV inhibitors
err2004-03-01
err0
PREAI
errCharles G. Caldwell; Ping Chen; Jiafang He; Emma R. Parmee; Barbara Leiting; Frank Marsilio; Reshma A. Patel; Joseph K. Wu; George J. Eiermann; Aleksandr Petrov; Huaibing He; Kathryn A. Lyons; Nancy A. Thornberry; Ann E. Weber
err分享
err收藏
Abdominal aortic aneurysms – glycaemic status and mortality腹主动脉瘤-血糖状态和死亡率
err2016-04-01
err0
PREAI
errIren Drange Hjellestad; Eirik Søfteland; Roy Miodini Nilsen; Eystein Sverre Husebye; Torbjørn Jonung
err分享
err收藏
A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises医学成像中的深度学习: 成像特征,技术趋势,具有进展亮点的案例研究和未来承诺
err2021-05-01
err384
errOAAI
errZhou, S. Kevin; Greenspan, Hayit; Davatzikos, Christos; Duncan, James S.; Van Ginneken, Bram; Madabhushi, Anant; Prince, Jerry L.; Rueckert, Daniel; Summers, Ronald M.
err分享
err收藏
The Miss Rate for Colorectal Adenoma Determined by Quality-Adjusted, Back-to-Back Colonoscopies
err2012-01-30
err184
errOAAI
errAhn, Sang Bong; Han, Dong Soo; Bae, Joong Ho; Byun, Tae Jun; Kim, Jong Pyo; Eun, Chang Soo
err分享
err收藏
err分享
err收藏
学者 查看更多内容