arrow
返回

Focus for Free in Density-Based Counting

delete2024-02-09
delete2
PRE
AI
Z
Zenglin Shi *
P
Pascal Mettes
C
Cees G. M. Snoek
DOI:10.1007/s11263-024-01990-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This work considers supervised learning to count from images and their corresponding point annotations. Where density-based counting methods typically use the point annotations only to create Gaussian-density maps, which act as the supervision signal, the starting point of this work is that point annotations have counting potential beyond density map generation. We introduce two methods that repurpose the available point annotations to enhance counting performance. The first is a counting-specific augmentation that leverages point annotations to simulate occluded objects in both input and density images to enhance the network's robustness to occlusions. The second method, foreground distillation, generates foreground masks from the point annotations, from which we train an auxiliary network on images with blacked-out backgrounds. By doing so, it learns to extract foreground counting knowledge without interference from the background. These methods can be seamlessly integrated with existing counting advances and are adaptable to different loss functions. We demonstrate complementary effects of the approaches, allowing us to achieve robust counting results even in challenging scenarios such as background clutter, occlusion, and varying crowd densities. Our proposed approach achieves strong counting results on multiple datasets, including ShanghaiTech Part_A and Part_B, UCF_QNRF, JHU-Crowd++, and NWPU-Crowd. Code is available at https://github.com/shizenglin/Counting-with-Focus-for-Free.
Keyword:
Object counting
Deep learning
Vision transformer

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
U
university of amsterdam
学者数:
6.0W
论文数: 5.1W
被引数: 94
引用论文

引用论文

Mining Closed Colossal Frequent Patterns from High-Dimensional Dataset: Serial Versus Parallel Framework
err2017-07-13
err0
PREAI
errSudeep Sureshan; Anusha Penumacha; Siddharth Jain; Manjunath Vanahalli; Nagamma Patil
err分享
err收藏
err分享
err收藏
A retrospective cross-national examination of COVID-19 outbreak in 175 countries: a multiscale geographically weighted regression analysis (January 11-June 28, 2020)
err2020-10-01
err0
errOAAI
errAyodeji Emmanuel Iyanda; Richard Adeleke; Yongmei Lu; Tolulope Osayomi; Adeleye Adaralegbe; Mayowa Lasode; Ngozi J. Chima-Adaralegbe; Adedoyin M. Osundina
err分享
err收藏
学者 查看更多内容