.png){kind=icon}
返回
The Right Spin: Learning Object Motion from Rotation-Compensated Flow Fields
.png){kind=icon}
OA
AI
DOI：10.1007/s11263-023-01859-x.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A good understanding of geometrical concepts as well as a broad familiarity with objects lead to excellent human perception of moving objects. The human ability to detect and segment moving objects works in the presence of multiple objects, complex background geometry, motion of the observer and even camouflage. How we perceive moving objects so reliably is a longstanding research question in computer vision and borrows findings from related areas such as psychology, cognitive science and physics. One approach to the problem is to teach a deep network to model all of these effects. This is in contrast with the strategy used by human vision, where cognitive processes and body design are tightly coupled and each is responsible for certain aspects of correctly identifying moving objects. Similarly, from the computer vision perspective there is evidence that classical, geometry-based techniques are better suited to the motion-based parts of the problem, while deep networks are more suitable for modeling appearance. In this work, we argue that the coupling of camera rotation and camera translation can create complex motion fields that are difficult for a deep network to untangle directly. We present a novel probabilistic model to estimate the camera's rotation given the motion field. We then rectify the flow field to obtain a rotation-compensated motion field for subsequent segmentation. This strategy of first estimating camera motion, and then allowing a network to learn the remaining parts of the problem, yields improved results on the widely used DAVIS benchmark as well as the more recent motion segmentation data set MoCA (Moving Camouflaged Animals).
Keyword:
Motion segmentation
Video segmentation
Optical flow
Camera motion estimation
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力，对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
OAAI
OAAI分享收藏分享收藏Forced acoustical response of a cavity coupled with a semi-infinite space using coupled mode theory.png)
Wave Motion
Wave MotionIF0
PREAI
分享收藏Chiral cage molecules generated by regioselective O-alkylation of a doubly-bridged calix[8]arene
PREAI
分享收藏
查看更多内容