arrow
返回

Learning Temporal Distribution and Spatial Correlation Toward Universal Moving Object Segmentation

delete2024-01-01
delete1
PRE
AI
G
Guanfang Dong *
C
Chenqiu Zhao
X
Xichen Pan
A
Anup Basu
DOI:10.1109/TIP.2024.3378473delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The goal of moving object segmentation is separating moving objects from stationary backgrounds in videos. One major challenge in this problem is how to develop a universal model for videos from various natural scenes since previous methods are often effective only in specific scenes. In this paper, we propose a method called Learning Temporal Distribution and Spatial Correlation (LTS) that has the potential to be a general solution for universal moving object segmentation. In the proposed approach, the distribution from temporal pixels is first learned by our Defect Iterative Distribution Learning (DIDL) network for a scene-independent segmentation. Notably, the DIDL network incorporates the use of an improved product distribution layer that we have newly derived. Then, the Stochastic Bayesian Refinement (SBR) Network, which learns the spatial correlation, is proposed to improve the binary mask generated by the DIDL network. Benefiting from the scene independence of the temporal distribution and the accuracy improvement resulting from the spatial correlation, the proposed approach performs well for almost all videos from diverse and complex natural scenes with fixed parameters. Comprehensive experiments on standard datasets including LASIESTA, CDNet2014, BMC, SBMI2015 and 128 real world videos demonstrate the superiority of proposed approach compared to state-of-the-art methods with or without the use of deep learning networks. To the best of our knowledge, this work has high potential to be a general solution for moving object segmentation in real world environments. The code and real-world videos can be found on GitHub https://github.com/guanfangdong/LTS-UniverisalMOS.
Keyword:
Moving object segmentation
distribution learning
Bayesian probabilistic model
machine learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of alberta
学者数:
5.1W
论文数: 4.9W
被引数: 65
U
University of British Columbia
学者数:
7.0W
论文数: 6.1W
被引数: 8.6W
引用论文

引用论文

Background Modeling by Stability of Adaptive Features in Complex Scenes
err2018-03-01
err17
PREAI
errYang, Dan; Zhao, Chenqiu; Zhang, Xiaohong; Huang, Sheng
err分享
err收藏
Contact inhibition modulates intracellular levels of miR-223 in a p27kip1-dependent manner
err2014-03-04
err0
errOAAI
errJoshua Armenia; Linda Fabris; Francesca Lovat; Stefania Berton; Ilenia Segatto; Sara D’Andrea; Cristina Ivan; Luciano Cascione; George A. Calin; Carlo M. Croce; Alfonso Colombatti; Andrea Vecchione; Barbara Belletti; Gustavo Baldassarre
err分享
err收藏
Deep neural network concepts for background subtraction: A systematic review and comparative evaluation
err2019-09-01
err266
errOAAI
errBouwmans, Thierry; Jayed, Sajid; Sultana, Maryam; Jung, Soon Ki
err分享
err收藏
err分享
err收藏
A multi-scale feature fusion spatial-channel attention model for background subtraction
err2023-07-28
err3
PREAI
errYang, Yizhong; Xia, Tingting; Li, Dajin; Zhang, Zhang; Xie, Guangjun
err分享
err收藏
学者 查看更多内容