arrow
Return

Deformable Density Estimation via Adaptive Representation

delete2023-01-01
delete4
PRE
AI
Z
Zhiyuan Zhao
X
Xuelong Li *
DOI:10.1109/TIP.2023.3240839delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Crowd counting is the basic task of crowd analysis and it is of great significance in the field of public safety. Therefore, it receives more and more attention recently. The common idea is to combine the crowd counting task with convolutional neural networks to predict the corresponding density map, which is generated by filtering the dot labels with specific Gaussian kernels. Although the counting performance is promoted by the newly proposed networks, they all suffer one conjunct problem, which is due to the perspective effect, there is significant scale contrast among targets in different positions within one scene, but the existing density maps can not represent this scale change well. To address the prediction difficulties caused by target scale variation, we propose a scale-sensitive crowd density map estimation framework, which focuses on dealing with target scale change from density map generation, network design, and model training stage. It consists of the Adaptive Density Map (ADM), Deformable Density Map Decoder (DDMD), and Auxiliary Branch. To be specific, the Gaussian kernel size variates adaptively based on target size to generate ADM that contains scale information for each specific target. DDMD introduces the deformable convolution to fit the Gaussian kernel variation and boosts the model's scale sensitivity. The Auxiliary Branch guides the learning of deformable convolution offsets during the training phase. Finally, we construct experiments on different large-scale datasets. The results show the effectiveness of the proposed ADM and DDMD. Furthermore, the visualization demonstrates that deformable convolution learns the target scale variation.
Keywords:
Adaptive Gaussian kernel
deformable convolu-tion
density estimation

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
Cited Papers

Cited Papers

Comparative analysis of occlusion methods for artificial sphincters
err2020-04-07
err0
PREAI
errLeonardo Marziale; Gioia Lucarini; Tommaso Mazzocchi; Leonardo Ricotti; Arianna Menciassi
errShare
errSave
A retrospective cross-national examination of COVID-19 outbreak in 175 countries: a multiscale geographically weighted regression analysis (January 11-June 28, 2020)
err2020-10-01
err0
errOAAI
errAyodeji Emmanuel Iyanda; Richard Adeleke; Yongmei Lu; Tolulope Osayomi; Adeleye Adaralegbe; Mayowa Lasode; Ngozi J. Chima-Adaralegbe; Adedoyin M. Osundina
errShare
errSave
errShare
errSave
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability
err2003-08-13
err0
PREAI
errVirginie Niel; Amber L. Thompson; M. Carmen Muñoz; Ana Galet; Andrés E. Goeta; José A. Real
errShare
errSave
Tetrabromidobis(dicyclohexylphosphane-κP)digallium(Ga—Ga)
err2012-09-05
err0
errOAAI
errDennis H. Mayo; Yang Peng; Peter Zavalij; Kit H. Bowen; Bryan W. Eichhorn
errShare
errSave
researcher View more