返回
A mixed reality framework for microsurgery simulation with visual-tactile perception
DOI:10.1007/s00371-023-02964-1.png)
摘要
En 中文
Microsurgery is a general term for surgery combining surgical microscope and specialized precision instruments during operation. Training in microsurgery requires considerable time and training resources. With the rapid development of computer technologies, virtual surgery simulation has gained extensive attention over the past decades. In this work, we take advantage of mixed reality (MR) that creates an interactive environment where physical and digital objects coexist, and present an MR framework for the microsurgery simulation. It enables users to practice anastomosis skills with real microsurgical instruments rather than additional haptic feedback devices that are typically used in virtual reality-based systems, and to view a realistic rendering intra-operative scene at the same time, thus creating an immersive training experience with such a visual-tactile interactive environment. A vision-based tracking system is proposed to simultaneously track microsurgical instruments and artificial blood vessels, and a learning-based anatomical modeling approach is introduced to facilitate the development of simulations in different microsurgical specialities by rapidly creating virtual assets. Moreover, we build a prototype system for the simulation specializing in microvascular hepatic artery reconstruction to demonstrate the feasibility and applicability of our framework.
Keyword:
Virtual surgery
Mixed reality
3D tracking
3D modeling
期刊
IF:
2.9
论文数:
4.6K
被引数:
6.5K
机构
引用论文
Low-Cost Improvements for Reducing Multifaceted Work-Related Risks and Preventing Stress at Work低成本改进措施,用于减少多方面的与工作相关的风险并预防工作压力
Plasma Hsp90 levels in patients with systemic sclerosis and relation to lung and skin involvement: a cross-sectional and longitudinal study系统性硬化症患者的血浆Hsp90水平及其与肺和皮肤受累的关系: 一项横断面和纵向研究
SCIENTIFIC REPORTS
IF3.9
The C. elegans par-4 gene encodes a putative serine-threonine kinase required for establishing embryonic asymmetry
Development
IF0

