.png){kind=icon}
返回
Motion-Aware Memory Network for Fast Video Salient Object Detection
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2023.3348659.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Previous methods based on 3DCNN, convLSTM, or optical flow have achieved great success in video salient object detection (VSOD). However, these methods still suffer from high computational costs or poor quality of the generated saliency maps. To address this, we design a space-time memory (STM)-based network that employs a standard encoder-decoder architecture. During the encoding stage, we extract high-level temporal features from the current frame and its adjacent frames, which is more efficient and practical than methods reliant on optical flow. During the decoding stage, we introduce an effective fusion strategy for both spatial and temporal branches. The semantic information of the high-level features is used to improve the object details in the low-level features. Subsequently, spatiotemporal features are methodically derived step by step to reconstruct the saliency maps. Moreover, inspired by the boundary supervision prevalent in image salient object detection (ISOD), we design a motion-aware loss that predicts object boundary motion, and simultaneously perform multitask learning for VSOD and object motion prediction. This can further enhance the model's capability to accurately extract spatiotemporal features while maintaining object integrity. Extensive experiments on several datasets demonstrate the effectiveness of our method and can achieve state-of-the-art metrics on some datasets. Our proposed model does not require optical flow or additional preprocessing, and can reach an impressive inference speed of nearly 100 FPS.
Keyword:
Video salient object detection
salient object detection
memory network
feature fusion
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力，对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
OAAI
.png){kind=icon}
OAAI分享收藏LID, LEED, and Alternative Rating Systems—Integrating Low Impact Development Techniques with Green Building DesignLID，LEED和替代评级系统-将低影响开发技术与绿色建筑设计相结合
PREAI
分享收藏Auto-combustion synthesis, Mössbauer study and catalytic properties of copper-manganese ferrites
PREAI
分享收藏分享收藏
查看更多内容