arrow
Return

Model-Agnostic Temporal Regularizer for Object Localization Using Motion Fields

delete2022-01-01
delete1
PRE
AI
C
Carlos Santiago *
D
Daniela O. Medley
J
Jorge S. Marques
J
Jacinto C. Nascimento
DOI:10.1109/TIP.2022.3155947delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Video analysis often requires locating and tracking target objects. In some applications, the localization system has access to the full video, which allows fine-grain motion information to be estimated. This paper proposes capturing this information through motion fields and using it to improve the localization results. The learned motion fields act as a model-agnostic temporal regularizer that can be used with any localization system based on keypoints. Unlike optical flow-based strategies, our motion fields are estimated from the model domain, based on the trajectories described by the object keypoints. Therefore, they are not affected by poor imaging conditions. The benefits of the proposed strategy are shown on three applications: 1) segmentation of cardiac magnetic resonance; 2) facial model alignment; and 3) vehicle tracking. In each case, combining popular localization methods with the proposed regularizer leads to improvement in overall accuracies and reduces gross errors.
Keywords:
Location awareness
Tracking
Trajectory
Predictive models
Computational modeling
Estimation
Motion segmentation
Object localization
motion fields
temporal regularization

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
universidade de coimbra
Scholars:
1.9W
Papers: 1.6W
Citations: 16