arrow
Return

Rethinking Global Context in Crowd Counting

delete2024-04-15
delete3
PRE
AI
G
Guolei Sun
Y
Yun Liu *
T
Thomas Probst
D
Danda Pani Paudel
N
Nikola Popović
L
Luc Van Gool
DOI:10.1007/s11633-023-1475-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper investigates the role of global context for crowd counting. Specifically, a pure transformer is used to extract features with global information from overlapping image patches. Inspired by classification, we add a context token to the input sequence, to facilitate information exchange with tokens corresponding to image patches throughout transformer layers. Due to the fact that transformers do not explicitly model the tried-and-true channel-wise interactions, we propose a token-attention module (TAM) to recalibrate encoded features through channel-wise attention informed by the context token. Beyond that, it is adopted to predict the total person count of the image through regression-token module (RTM). Extensive experiments on various datasets, including ShanghaiTech, UCF-QNRF, JHU-CROWD++ and NWPU, demonstrate that the proposed context extraction techniques can significantly improve the performance over the baselines.
Keywords:
Crowd counting
vision transformer
global context
attention
density map

Journal

Machine Intelligence Research cover
Machine Intelligence Research
IF:
8.7
Papers:
304
Citations:
882

Organization

E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
A novel species-specific tandem repeat DNA family from Sinapis arvensis: detection of telomere-like sequences
err1996-08-01
err0
PREAI
errRitu Kapila; Sandip Das; Malathi Lakshmikumaran; P. S. Srivastava
errShare
errSave
A retrospective cross-national examination of COVID-19 outbreak in 175 countries: a multiscale geographically weighted regression analysis (January 11-June 28, 2020)
err2020-10-01
err0
errOAAI
errAyodeji Emmanuel Iyanda; Richard Adeleke; Yongmei Lu; Tolulope Osayomi; Adeleye Adaralegbe; Mayowa Lasode; Ngozi J. Chima-Adaralegbe; Adedoyin M. Osundina
errShare
errSave
Tetrabromidobis(dicyclohexylphosphane-κP)digallium(Ga—Ga)
err2012-09-05
err0
errOAAI
errDennis H. Mayo; Yang Peng; Peter Zavalij; Kit H. Bowen; Bryan W. Eichhorn
errShare
errSave
Network Theory in Prebiotic Evolution
err2018-08-02
err0
PREAI
errSara Imari Walker; Cole Mathis
errShare
errSave
researcher View more