.png){kind=icon}
返回
Temporal Memory Relation Network for Workflow Recognition From Surgical Video
.png){kind=icon}
OA
AI
DOI：10.1109/TMI.2021.3069471.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Automatic surgical workflow recognition is a key component for developing context-aware computer-assisted systems in the operating theatre. Previous works either jointly modeled the spatial features with short fixed-range temporal information, or separately learned visual and long temporal cues. In this paper, we propose a novel end-to-end temporal memory relation network (TMRNet) for relating long-range and multi-scale temporal patterns to augment the present features. We establish a long-range memory bank to serve as a memory cell storing the rich supportive information. Through our designed temporal variation layer, the supportive cues are further enhanced by multi-scale temporal-only convolutions. To effectively incorporate the two types of cues without disturbing the joint learning of spatio-temporal features, we introduce a non-local bank operator to attentively relate the past to the present. In this regard, our TMRNet enables the current feature to view the long-range temporal dependency, as well as tolerate complex temporal extents. We have extensively validated our approach on two benchmark surgical video datasets, M2CAI challenge dataset and Cholec80 dataset. Experimental results demonstrate the outstanding performance of our method, consistently exceeding the state-of-the-art methods by a large margin (e.g., 67.0% v.s. 78.9% Jaccard on Cholec80 dataset).
Keyword:
Surgery
Hidden Markov models
Feature extraction
Visualization
Training
Gallbladder
Tools
Surgical workflow recognition
long-range memory clue
multi-scale temporal convolution
non-local operation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.8
论文数:
6.3K
被引数:
3.7W
机构
引用论文
.png){kind=icon}
Distribution of pollutants from a new paper plant in southern Lake Champlain, Vermont and New YorkOAAI
OAAI分享收藏EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosEndoNet: 用于腹腔镜视频识别任务的深层体系结构OAAI
OAAI分享收藏分享收藏
查看更多内容