arrow
Return

Learning Multi-human Optical Flow

delete2020-01-02
delete31
delete
OA
AI
R
Ranjan, Anurag *
H
Hoffmann, David T.
D
Dimitrios Tzionas
S
Siyu Tang
R
Romero, Javier
B
Black, Michael J.
DOI:10.1007/s11263-019-01279-wdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The optical flow of humans is well known to be useful for the analysis of human action. Recent optical flow methods focus on training deep networks to approach the problem. However, the training data used by them does not cover the domain of human motion. Therefore, we develop a dataset of multi-human optical flow and train optical flow networks on this dataset. We use a 3D model of the human body and motion capture data to synthesize realistic flow fields in both single- and multi-person images. We then train optical flow networks to estimate human flow fields from pairs of images. We demonstrate that our trained networks are more accurate than a wide range of top methods on held-out test data and that they can generalize well to real image sequences. The code, trained models and the dataset are available for research.
Keywords:
Optical
Flow
Deep
Learning
Human
Bodies
Synthetic
Dataset
Humanflow
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

M
Max Planck Society
Scholars:
8.2W
Papers: 7.7W
Citations: 3.3W
Cited Papers

Cited Papers

Relaxin: An Ovarian Hormone in an Avian Species (Gallus domesticus)
err1997-02-01
err0
PREAI
errKevin H. Brackett; Phillip A. Fields; Wilfrid Dubois; Shou-Mei T. Chang; Floyd B. Mather; Michael J. Fields
errShare
errSave
Comparative analysis of occlusion methods for artificial sphincters
err2020-04-07
err0
PREAI
errLeonardo Marziale; Gioia Lucarini; Tommaso Mazzocchi; Leonardo Ricotti; Arianna Menciassi
errShare
errSave
Learning low-level vision
err2000-01-01
err1.2K
PREAI
errFreeman, WT; Pasztor, EC; Carmichael, OT
errShare
errSave
Capturing Hands in Action Using Discriminative Salient Points and Physics Simulation
err2016-03-18
err188
PREAI
errTzionas, Dimitrios; Ballan, Luca; Srikantha, Abhilash; Aponte, Pablo; Pollefeys, Marc; Gall, Juergen
errShare
errSave
Ingestion of corrosive acids
err1989-09-01
err0
PREAI
errShowkat Ali Zargar; Rakesh Kochhar; Birender Nagi; Saroj Mehta; Satish Kumar Mehta
errShare
errSave
Essential role of clusterin in pancreas regeneration
err2011-02-02
err0
PREAI
errSong Lee; Seok‐Woo Hong; Bon‐Hong Min; Young‐Jun Shim; Ki‐Up Lee; In‐Kyu Lee; M. Bendayan; Bruce J. Aronow; In‐Sun Park
errShare
errSave
Tropical rainforest flies carrying pathogens form stable associations with social nonhuman primates
err2019-07-18
err0
errOAAI
errJan F. Gogarten; Ariane Düx; Benjamin Mubemba; Kamilla Pléh; Constanze Hoffmann; Alexander Mielke; Jonathan Müller‐Tiburtius; Andreas Sachse; Roman M. Wittig; Sébastien Calvignac‐Spencer; Fabian H. Leendertz
errShare
errSave
errShare
errSave
researcher View more