arrow
返回

Articulated Multi-Instrument 2-D Pose Estimation Using Fully Convolutional Networks

delete2018-05-01
delete96
delete
OA
AI
X
Xiaofei Du *
T
Thomas Kurmann
P
Ping-Lin Chang
M
Maximilian Allan
S
Sébastien Ourselin
R
Raphael Sznitman
J
John D. Kelly
D
Danail Stoyanov
DOI:10.1109/TMI.2017.2787672delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Instrument detection, pose estimation, and tracking in surgical videos are an important vision component for computer-assisted interventions. While significant advances have been made in recent years, articulation detection is still a major challenge. In this paper, we propose a deep neural network for articulated multi-instrument 2-D pose estimation, which is trained on detailed annotations of endoscopic and microscopic data sets. Our model is formed by a fully convolutional detection-regression network. Joints and associations between joint pairs in our instrument model are located by the detection subnetwork and are subsequently refined through a regression sub-network. Based on the output from the model, the poses of the instruments are inferred using maximum bipartite graph matching. Our estimation framework is powered by deep learning techniques without any direct kinematic information from a robot. Our framework is tested on single-instrument RMIT data, and also on multi-instrument EndoVis and in vivo data with promising results. In addition, the data set annotations are publicly released along with our code and model.
Keyword:
Surgical instrument detection
articulated pose estimation
fully convolutional networks
surgical vision
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.2K
被引数:
3.7W

机构

U
University College London
学者数:
7.9W
论文数: 6.2W
被引数: 15.7W
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
U
University of Bern
学者数:
4.0W
论文数: 3.1W
被引数: 4.8W
学者 查看更多机构
引用论文

引用论文

Vascular Endothelial Dysfunction in Inflammatory Bowel Diseases: Pharmacological and Nonpharmacological Targets
err2018-04-12
err0
errOAAI
errAntonietta Gerarda Gravina; Marcello Dallio; Mario Masarone; Valerio Rosato; Andrea Aglitti; Marcello Persico; Carmelina Loguercio; Alessandro Federico
err分享
err收藏
Digital Participatory Platforms for Civic Engagement: A New Way of Participating in Society?
err2020-01-01
err0
PREAI
errFrancesca De Filippi; Cristina Coscia; Grazia Giulia Cocina; Giulia Lazzari; Stefania Manzo
err分享
err收藏
A Problem in Brownian Motion
err1929-07-01
err0
PREAI
errG. E. Uhlenbeck; S. Goudsmit
err分享
err收藏
Vision-based and marker-less surgical tool detection and tracking: a review of the literature
err2017-01-01
err217
errOAAI
errBouget, David; Allan, Max; Stoyanov, Danail; Jannin, Pierre
err分享
err收藏
EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosEndoNet: 用于腹腔镜视频识别任务的深层体系结构
err2017-01-01
err581
errOAAI
errTwinanda, Andru P.; Shehata, Sherif; Mutter, Didier; Marescaux, Jacques; de Mathelin, Michel; Padoy, Nicolas
err分享
err收藏
学者 查看更多内容