arrow
返回

Fine-Grained Multi-human Parsing

delete2019-05-13
delete26
PRE
AI
J
Jian Zhao *
J
Jianshu Li
H
Hengzhu Liu
YAN Shuicheng 封面图
YAN Shuicheng (Shuicheng Yan)
J
Jiashi Feng
DOI:10.1007/s11263-019-01181-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Despite the noticeable progress in perceptual tasks like detection, instance segmentation and human parsing, computers still perform unsatisfactorily on visually understanding humans in crowded scenes, such as group behavior analysis, person re-identification, e-commerce, media editing, video surveillance, autonomous driving and virtual reality, etc. To perform well, models need to comprehensively perceive the semantic information and the differences between instances in a multi-human image, which is recently defined as themulti-human parsingtask. In this paper, we first present a new large-scale database Multi-human Parsing (MHP v2.0) for algorithm development and evaluation to advance the research on understanding humans in crowded scenes. MHP v2.0 contains 25,403 elaborately annotated images with 58 fine-grained semantic category labels and 16 dense pose key point labels, involving 2-26 persons per image captured in real-world scenes from various viewpoints, poses, occlusion, interactions and background. We further propose a novel deep Nested Adversarial Network (NAN) model for multi-human parsing. NAN consists of three Generative Adversarial Network-like sub-nets, respectively performing semantic saliency prediction, instance-agnostic parsing and instance-aware clustering. These sub-nets form a nested structure and are carefully designed to learn jointly in an end-to-end way. NAN consistently outperforms existing state-of-the-art solutions on our MHP and several other datasets, including MHP v1.0, PASCAL-Person-Part and Buffy. NAN serves as a strong baseline to shed light on generic instance-level semantic part prediction and drive the future research on multi-human parsing. With the above innovations and contributions, we have organized the CVPR 2018 Workshop on Visual Understanding of Humans in Crowd Scene (VUHCS 2018) and the Fine-Grained Multi-human Parsing and Pose Estimation Challenge. These contributions together significantly benefit the community. Code and pre-trained models are available at.
Keyword:
Multi-human parsing
Benchmark dataset
Nested adversarial learning
Generative Adversarial Networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
4.0K
被引数:
2.8W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Vascular Endothelial Dysfunction in Inflammatory Bowel Diseases: Pharmacological and Nonpharmacological Targets
err2018-04-12
err0
errOAAI
errAntonietta Gerarda Gravina; Marcello Dallio; Mario Masarone; Valerio Rosato; Andrea Aglitti; Marcello Persico; Carmelina Loguercio; Alessandro Federico
err分享
err收藏
The oxygen effect and fractionated radiotherapy
err2012-12-20
err0
PREAI
errMichael Horsman; Bradly Wouters; Michael Joiner; Jens Overgaard
err分享
err收藏
From Facial Expression Recognition to Interpersonal Relation Prediction
err2017-11-24
err170
errOAAI
errZhang, Zhanpeng; Luo, Ping; Loy, Chen Change; Tang, Xiaoou
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容