arrow
Return

Multi-scale, multi-dimensional binocular endoscopic image depth estimation network

delete2023-09-01
delete0
delete
OA
AI
X
Xiongzhi Wang
Y
Yunfeng Nie
任文琦 cover
任文琦 (Wenqi Ren)
M
Min Wei
J
Jingang Zhang *
DOI:10.1016/j.compbiomed.2023.107305delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
During invasive surgery, the use of deep learning techniques to acquire depth information from lesion sites in real-time is hindered by the lack of endoscopic environmental datasets. This work aims to develop a high-accuracy three-dimensional (3D) simulation model for generating image datasets and acquiring depth information in real-time. Here, we proposed an end-to-end multi-scale supervisory depth estimation network (MMDENet) model for the depth estimation of pairs of binocular images. The proposed MMDENet highlights a multi-scale feature extraction module incorporating contextual information to enhance the correspondence precision of poorly exposed regions. A multi-dimensional information-guidance refinement module is also proposed to refine the initial coarse disparity map. Statistical experimentation demonstrated a 3.14% reduction in endpoint error compared to state-of-the-art methods. With a processing time of approximately 30fps, satisfying the requirements of real-time operation applications. In order to validate the performance of the trained MMDENet in actual endoscopic images, we conduct both qualitative and quantitative analysis with 93.38% high precision, which holds great promise for applications in surgical navigation.
Keywords:
Depth estimation
Endoscopic datasets
Convolutional neural network
Stereoscopic vision
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computers in Biology and Medicine cover
Computers in Biology and Medicine
IF:
6.3
Papers:
8.3K
Citations:
3.3W

Organization

I
institute of information engineering, cas
Scholars:
474
Papers: 466
Citations: 0
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704
researcher View more organizations