.png){kind=icon}
Return
Multi-View Multi-Human Association With Deep Assignment Network
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2021.3139178.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Identifying the same persons across different views plays an important role in many vision applications. In this paper, we study this important problem, denoted as Multi-view Multi-Human Association (MvMHA), on multi-view images that are taken by different cameras at the same time. Different from previous works on human association across two views, this paper is focused on more general and challenging scenarios of more than two views, and none of these views are fixed or priorly known. In addition, each involved person may be present in all the views or only a subset of views, which are also not priorly known. We develop a new end-to-end deep-network based framework to address this problem. First, we use an appearance-based deep network to extract the feature of each detected subject on each image. We then compute pairwise-similarity scores between all the detected subjects and construct a comprehensive affinity matrix. Finally, we propose a Deep Assignment Network (DAN) to transform the affinity matrix into an assignment matrix, which provides a binary assignment result for MvMHA. We build both a synthetic dataset and a real image dataset to verify the effectiveness of the proposed method. We also test the trained network on other three public datasets, resulting in very good cross-domain performance.
Keywords:
Cameras
Feature extraction
Optimization
Training
Video surveillance
Three-dimensional displays
Testing
Human association
multi-view association
wearable cameras
maximum multi-clique problem
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W
Organization
Cited Papers
.png){kind=icon}
ShareSave
ShareSaveShareSaveEffect of park age, size, shape and isolation on ant assemblages in two cities of Southern Spain
PREAI
ShareSaveShareSaveShareSave
View more