.png){kind=icon}
Return
An interactive network based on transformer for multimodal crowd counting
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-023-04721-2.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Crowd counting is a task to estimate the total number of pedestrians in an image. In most of the existing research, good vision problems, such as in parks, squares, and bright shopping malls during the day, have been addressed. However, there is little research on complex scenes in darkness. To study this problem, we propose an interactive network based on Transformer for multi-modal crowd counting. First, sliding convolutional encoding is adopted for the image to obtain better encoding features. The features are extracted through the designed primary interaction network, and then channel token attention is used to modulate the features. Then, the FGAF-MLP is used for high and low semantic fusion to enhance the feature expression and fully fuse the data in different modes to improve the accuracy of the method. To verify the effectiveness of our method, we conducted extensive ablation experiments with the latest multimodal benchmark RGBT-CC, and we verified the complementarity between multiple modal data and the effectiveness of the model components. We also verified the effectiveness of our method with the ShanghaiTechRGBD benchmark. The experimental results showed that our proposed method exhibits good results and achieves an improvement of more than 10% in terms of the mean average error and mean squared error for the RGBT-CC benchmark.
Keywords:
Crowd counting
Transformer
Multimodal data
Feature fusion
Journal
IF:
3.5
Papers:
7.6K
Citations:
1.7W
Organization
Cited Papers
ShareSaveShareSaveShareSaveShareSaveInnovation, creativity and governance: Social dynamics of economic performance in city-regions.png)
Innovation
InnovationIF0
PREAI
ShareSaveShareSaveCongested crowd instance localization with dilated convolutional swin transformerNEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAIShareSaveShareSave
View more