.png){kind=icon}
返回
PEg TRAnsfer Workflow recognition challenge report: Do multimodal data improve recognition?
.png){kind=icon}
OA
AI
DOI：10.1016/j.cmpb.2023.107561.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Background and objective: In order to be context-aware, computer-assisted surgical systems require accu-rate, real-time automatic surgical workflow recognition. In the past several years, surgical video has been the most commonly-used modality for surgical workflow recognition. But with the democratization of robot-assisted surgery, new modalities, such as kinematics, are now accessible. Some previous methods use these new modalities as input for their models, but their added value has rarely been studied. This paper presents the design and results of the PEg TRAnsfer Workflow recognition (PETRAW) challenge with the objective of developing surgical workflow recognition methods based on one or more modalities and studying their added value. Methods: The PETRAW challenge included a data set of 150 peg transfer sequences performed on a vir-tual simulator. This data set included videos, kinematic data, semantic segmentation data, and annota-tions, which described the workflow at three levels of granularity: phase, step, and activity. Five tasks were proposed to the participants: three were related to the recognition at all granularities simultane-ously using a single modality, and two addressed the recognition using multiple modalities. The mean application-dependent balanced accuracy (AD-Accuracy) was used as an evaluation metric to take into account class balance and is more clinically relevant than a frame-by-frame score.Results: Seven teams participated in at least one task with four participating in every task. The best results were obtained by combining video and kinematic data (AD-Accuracy of between 93% and 90% for the four teams that participated in all tasks). Conclusion: The improvement of surgical workflow recognition methods using multiple modalities com-pared with unimodal methods was significant for all teams. However, the longer execution time required for video/kinematic-based methods(compared to only kinematic-based methods) must be considered. In-deed, one must ask if it is wise to increase computing time by 20 0 0 to 20,0 0 0% only to increase accuracy by 3%. The PETRAW data set is publicly available at www.synapse.org/PETRAW to encourage further re-search in surgical workflow recognition.(c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Surgical process model
Workflow recognition
Multimodal
OR of the future
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.8
论文数:
7.0K
被引数:
2.1W
机构
查看更多机构
引用论文
.png){kind=icon}
分享收藏EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosEndoNet: 用于腹腔镜视频识别任务的深层体系结构OAAI
OAAI分享收藏分享收藏 查看更多内容