arrow
Return

Multiframe motion segmentation with missing data using PowerFactorization and GPCA

delete2007-11-27
delete193
delete
OA
AI
R
Renè Vidal *
R
Roberto Tron
R
Richard Hartley
DOI:10.1007/s11263-007-0099-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We consider the problem of segmenting multiple rigid- body motions from point correspondences in multiple affine views. We cast this problem as a subspace clustering problem in which point trajectories associated with each motion live in a linear subspace of dimension two, three or four. Our algorithm involves projecting all point trajectories onto a 5- dimensional subspace using the SVD, the PowerFactorization method, or RANSAC, and fitting multiple linear subspaces representing different rigid- body motions to the points in R-5 using GPCA. Unlike previous work, our approach does not restrict the motion subspaces to be four-dimensional and independent. Instead, it deals gracefully with all the spectrum of possible affine motions: from two-dimensional and partially dependent to four- dimensional and fully independent. Our algorithm can handle the case of missing data, meaning that point tracks do not have to be visible in all images, by using the PowerFactorization method to project the data. In addition, our method can handle outlying trajectories by using RANSAC to perform the projection. We compare our approach to other methods on a database of 167 motion sequences with full motions, independent motions, degenerate motions, partially dependent motions, missing data, outliers, etc. On motion sequences with complete data our method achieves a misclassification error of less that 5% for two motions and 29% for three motions.
Keywords:
multibody factorization
multibody grouping
3-D motion segmentation
structure from motion
subspace clustering
PowerFactorization and Generalized Principal Component analysis (GPCA)
missing data

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

J
Johns Hopkins University
Scholars:
10.2W
Papers: 8.8W
Citations: 13.0W
N
nicta
Scholars:
191
Papers: 167
Citations: 0