Human Object Inpainting Using Manifold Learning-Based Posture Sequence Estimation

doi:10.1109/TIP.2011.2158228

Human Object Inpainting Using Manifold Learning-Based Posture Sequence Estimation

2011-11-01

11

OA

AI

DOI：10.1109/TIP.2011.2158228

Original

Save

View PDF

Abstract

En 中文

We propose a human object inpainting scheme that divides the process into three steps: 1) human posture synthesis; 2) graphical model construction; and 3) posture sequence estimation. Human posture synthesis is used to enrich the number of postures in the database, after which all the postures are used to build a graphical model that can estimate the motion tendency of an object. We also introduce two constraints to confine the motion continuity property. The first constraint limits the maximum search distance if a trajectory in the graphical model is discontinuous, and the second confines the search direction in order to maintain the tendency of an object's motion. We perform both forward and backward predictions to derive local optimal solutions. Then, to compute an overall best solution, we apply the Markov random field model and take the potential trajectory with the maximum total probability as the final result. The proposed posture sequence estimation model can help identify a set of suitable postures from the posture database to restore damaged/missing postures. It can also make a reconstructed motion sequence look continuous.

Keywords:

Dimensionality reduction

isomap

manifold learning

object completion

video inpainting

Human Object Inpainting Using Manifold Learning-Based Posture Sequence Estimation

Abstract

AI Summary

Journal

Organization