返回
Articulated Multi-Instrument 2-D Pose Estimation Using Fully Convolutional Networks
DOI:10.1109/TMI.2017.2787672.png)
摘要
En 中文
Instrument detection, pose estimation, and tracking in surgical videos are an important vision component for computer-assisted interventions. While significant advances have been made in recent years, articulation detection is still a major challenge. In this paper, we propose a deep neural network for articulated multi-instrument 2-D pose estimation, which is trained on detailed annotations of endoscopic and microscopic data sets. Our model is formed by a fully convolutional detection-regression network. Joints and associations between joint pairs in our instrument model are located by the detection subnetwork and are subsequently refined through a regression sub-network. Based on the output from the model, the poses of the instruments are inferred using maximum bipartite graph matching. Our estimation framework is powered by deep learning techniques without any direct kinematic information from a robot. Our framework is tested on single-instrument RMIT data, and also on multi-instrument EndoVis and in vivo data with promising results. In addition, the data set annotations are publicly released along with our code and model.
Keyword:
Surgical instrument detection
articulated pose estimation
fully convolutional networks
surgical vision
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.8
论文数:
6.2K
被引数:
3.7W
机构
引用论文
Sequence analysis of the Ras-MAPK pathway genes SOS1, EGFR & GRB2 in silver foxes (Vulpes vulpes): candidate genes for hereditary hyperplastic gingivitis
Genetica
IF0
Effects of chronic cerebral hypoperfusion and low-dose progesterone treatment on apoptotic processes, expression and subcellular localization of key elements within Akt and Erk signaling pathways in rat hippocampus
Neuroscience
IF0
Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detection使用深度神经网络进行区域建议和检测,在机器人辅助手术视频中检测和定位机器人工具
Vision-based and marker-less surgical tool detection and tracking: a review of the literature
MEDICAL IMAGE ANALYSIS
IF11.8

