arrow
返回

Dynamic Depth-Aware Network for Endoscopy Super-Resolution

delete2022-10-01
delete9
PRE
AI
W
Wenting Chen
Y
Yifan Liu
J
Jiancong Hu
Y
Yixuan Yuan *
DOI:10.1109/JBHI.2022.3188878delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Endoscopy super-resolution (SR) plays an important role in improving diagnostic results and reducing the misdiagnosis rate. Even though recent studies have investigated the SR for endoscopy, these methods apply equal importance to the whole image and do not consider the relationship among pixels, especially the depth information, which can provide diagnosis-related information for clinicians. To address this problem, we propose a dynamic depth-aware network for endoscopy super-resolution, which represents the first effort to comprehensively integrate the depth information to the SR task for endoscopic images. It includes a depth-wise feature extracting branch (DW-B) and a depth-guided SR branch (DGSR-B). The DW-B aims to extract the representative feature for each depth level (i.e. depth matrix) further to provide auxiliary information and guide the super-resolution of texture under different depth levels. In DGSR-B, a depth-guided block (DGB) consisting of depth-focus normalization (DFN) is introduced to inject both the depth matrix and depth map into the LR image feature, so as to guide the image generation for each depth region. To adaptively super-resolve the regions under different depth levels, we devise a dynamic depth-aware loss to assign different trainable weights to each region for SR optimization. Extensive experiments have been conducted on two main publicly available datasets, i.e., the Kvasir dataset and the EndoScene dataset, and the superior performance verifies the effectiveness of our method for SR task and polyp segmentation. Source code is to be released.
Keyword:
Feature extraction
Endoscopes
Cancer
Superresolution
Deep learning
Task analysis
Three-dimensional displays
Endoscopy
super-resolution
depth information
polyp segmentation

期刊

IEEE Journal of Biomedical and Health Informatics 封面图
IEEE Journal of Biomedical and Health Informatics
IF:
6.8
论文数:
4.5K
被引数:
2.0W

机构

S
shenzhen research institute, city university of hong kong
学者数:
828
论文数: 660
被引数: 4
C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
引用论文

引用论文

Rates of new or missed colorectal cancers after colonoscopy and their risk factors: A population-based analysis
err2007-01-01
err553
PREAI
errBressler, Brian; Paszat, Lawrence F.; Chen, Zhongliang; Rothwell, Deanna M.; Vinden, Chris; Rabeneck, Linda
err分享
err收藏
Long-Term Colorectal-Cancer Incidence and Mortality after Lower Endoscopy
err2013-09-19
err1.2K
errOAAI
errNishihara, Reiko; Wu, Kana; Lochhead, Paul; Morikawa, Teppei; Liao, Xiaoyun; Qian, Zhi Rong; Inamura, Kentaro; Kim, Sun A.; Kuchiba, Aya; Yamauchi, Mai; Imamura, Yu; Willett, Walter C.; Rosner, Bernard A.; Fuchs, Charles S.; Giovannucci, Edward; Ogino, Shuji; Chan, Andrew T.
err分享
err收藏
err1997-01-01
err0
PREAI
errDietrich Stoyan; Ilya S. Molchanov
err分享
err收藏
Physical and mechanical properties of green banana (Musa paradisiaca) fruit
err1995-01-01
err0
PREAI
errR.P. Kachru; Nachiket Kotwaliwale; D. Balasubramanian
err分享
err收藏
EndoL2H: Deep Super-Resolution for Capsule Endoscopy
err2020-12-01
err28
errOAAI
errAlmalioglu, Yasin; Bengisu Ozyoruk, Kutsev; Gokce, Abdulkadir; Incetan, Kagan; Irem Gokceler, Guliz; Ali Simsek, Muhammed; Ararat, Kivanc; Chen, Richard J.; Durr, Nicholas J.; Mahmood, Faisal; Turan, Mehmet
err分享
err收藏
err分享
err收藏
学者 查看更多内容