arrow
返回

A mixed reality framework for microsurgery simulation with visual-tactile perception

delete2023-06-30
delete5
PRE
AI
N
Nan Xiang *
H
Hai‐Ning Liang
L
Lingyun Yu
X
Xiaosong Yang *
J
Jianjun Zhang
DOI:10.1007/s00371-023-02964-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Microsurgery is a general term for surgery combining surgical microscope and specialized precision instruments during operation. Training in microsurgery requires considerable time and training resources. With the rapid development of computer technologies, virtual surgery simulation has gained extensive attention over the past decades. In this work, we take advantage of mixed reality (MR) that creates an interactive environment where physical and digital objects coexist, and present an MR framework for the microsurgery simulation. It enables users to practice anastomosis skills with real microsurgical instruments rather than additional haptic feedback devices that are typically used in virtual reality-based systems, and to view a realistic rendering intra-operative scene at the same time, thus creating an immersive training experience with such a visual-tactile interactive environment. A vision-based tracking system is proposed to simultaneously track microsurgical instruments and artificial blood vessels, and a learning-based anatomical modeling approach is introduced to facilitate the development of simulations in different microsurgical specialities by rapidly creating virtual assets. Moreover, we build a prototype system for the simulation specializing in microvascular hepatic artery reconstruction to demonstrate the feasibility and applicability of our framework.
Keyword:
Virtual surgery
Mixed reality
3D tracking
3D modeling

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

B
Bournemouth University
学者数:
2.7K
论文数: 3.1K
被引数: 3.5K
引用论文

引用论文

Current progress in patient-specific modeling
err2009-12-02
err154
errOAAI
errNeal, Maxwell Lewis; Kerckhoffs, Roy
err分享
err收藏
err分享
err收藏
New lithostratigraphical, sedimentological, mineralogical and palaeontological data on the Mesozoic of Belgian Lorraine: a progress report
err2007-09-09
err0
errOAAI
errFrédéric BOULVAIN; Isabelle BELANGER; Dominique DELSATE; Danièle DOSQUET; Pierre GHYSEL; Pascal GODEFROIT; Martin LALOUX; Marc ROCHE; Hervé TEERLYNCK; Jacques THOREZ
err分享
err收藏
The Dysphagia Research Society Accelerating a Priority Research Agenda
err2017-01-02
err0
PREAI
errSudarshan R. Jadcherla; Gary H. McCullough; Stephanie K. Daniels; Douglas J. Van Daele; Kulwinder Dua; Cathy Lazarus; Reza Shaker
err分享
err收藏
Plasma Hsp90 levels in patients with systemic sclerosis and relation to lung and skin involvement: a cross-sectional and longitudinal study系统性硬化症患者的血浆Hsp90水平及其与肺和皮肤受累的关系: 一项横断面和纵向研究
err2021-01-07
err180
errOAAI
errStorkanova, Hana; Oreska, Sabina; Spiritovic, Maja; Hermankova, Barbora; Bubova, Kristyna; Komarc, Martin; Pavelka, Karel; Vencovsky, Jiri; Distler, Joerg H. W.; Senolt, Ladislav; Becvar, Radim; Tomcik, Michal
err分享
err收藏
The C. elegans par-4 gene encodes a putative serine-threonine kinase required for establishing embryonic asymmetry
err2000-04-01
err0
PREAI
errJennifer L. Watts; Diane G. Morton; Jennifer Bestman; Kenneth J. Kemphues
err分享
err收藏
学者 查看更多内容