arrow
Return

Decoupled Two-Stage Crowd Counting and Beyond

delete2021-01-01
delete59
PRE
AI
J
Jian Cheng
H
Haipeng Xiong
Z
Zhiguo Cao
H
Hao Lü *
DOI:10.1109/TIP.2021.3055631delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
One of appealing approaches to counting dense objects, such as crowd, is density map estimation. Density maps, however, present ambiguous appearance cues in congested scenes, rendering infeasibility in identifying individuals and difficulties in diagnosing errors. Inspired by an observation that counting can be interpreted as a two-stage process, i.e., identifying possible object regions and counting exact object numbers, we introduce a probabilistic intermediate representation termed the probability map that depicts the probability of each pixel being an object. This representation allows us to decouple counting into probability map regression (PMR) and count map regression (CMR). We therefore propose a novel decoupled two-stage counting (D2C) framework that sequentially regresses the probability map and learns a counter conditioned on the probability map. Given the probability map and the count map, a peak point detection algorithm is derived to localize each object with a point under the guidance of local counts. An advantage of D2C is that the counter can be learned reliably with additional synthesized probability maps. This addresses important data deficiency and sample imbalanced problems in counting. Our framework also enables easy diagnoses and analyses of error patterns. For instance, we find that, the counter per se is sufficiently accurate, while the bottleneck appears to be PMR. We further instantiate a network D2CNet in our framework and report state-of-the-art counting and localization performance across 6 crowd counting benchmarks. Since the probability map is a representation independent of visual appearance, D2CNet also exhibits remarkable cross-dataset transferability. Code and pretrained models are made available at: https://git.io/d2cnet
Keywords:
Location awareness
Probabilistic logic
Training
Reliability
Object recognition
Kernel
Detection algorithms
Crowd counting
crowd analysis
convolutional neural networks
local count models
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

No organization information available
Cited Papers

Cited Papers

A retrospective cross-national examination of COVID-19 outbreak in 175 countries: a multiscale geographically weighted regression analysis (January 11-June 28, 2020)
err2020-10-01
err0
errOAAI
errAyodeji Emmanuel Iyanda; Richard Adeleke; Yongmei Lu; Tolulope Osayomi; Adeleye Adaralegbe; Mayowa Lasode; Ngozi J. Chima-Adaralegbe; Adedoyin M. Osundina
errShare
errSave
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability
err2003-08-13
err0
PREAI
errVirginie Niel; Amber L. Thompson; M. Carmen Muñoz; Ana Galet; Andrés E. Goeta; José A. Real
errShare
errSave
Network Theory in Prebiotic Evolution
err2018-08-02
err0
PREAI
errSara Imari Walker; Cole Mathis
errShare
errSave
Benefits and costs of artificial nighttime lighting of the environment
err2015-03-01
err0
PREAI
errKevin J. Gaston; Sian Gaston; Jonathan Bennie; John Hopkins
errShare
errSave
Use of Chelating Diphosphines To Prepare New Phosphido Clusters of Aluminum and Gallium
err1996-05-28
err0
PREAI
errDavid A. Atwood; Alan H. Cowley; Richard A. Jones; Ronald J. Powell; Christine M. Nunn
errShare
errSave
errShare
errSave
Symbolic Interaction Theory and Architecture
err2011-12-22
err0
errOAAI
errRonald W. Smith; Valerie Bugni
errShare
errSave
researcher View more