arrow
返回

Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting

delete2023-01-01
delete9
PRE
AI
R
Rui Wang
Y
Yixue Hao
L
Long Hu *
J
Jincai Chen *
陈
陈敏 (Min Chen) *
D
Di Wu
DOI:10.1109/TMM.2023.3251106delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the expensive and laborious annotations of labeled data required by fully-supervised learning in the crowd counting task, it is desirable to explore a method to reduce the labeling burden. There exists a large number of unlabeled images in the wild that can be easily obtained compared to labeled datasets. Based on the characteristics of consistent spatial transformation with the annotations of heads and image, this paper proposes a self-supervised learning framework with unlabeled and limited labeled data for pre-training and fine-tuning crowd counting model (SSL-FT). It includes an online network and a target network that receive the same images but are randomly processed by two defined augmentation transformations. We leverage unlabeled data to pre-train the online network based on a self-supervised loss and small-scale labeled data to transfer the model to a specific domain based on a fully-supervised loss. We demonstrate the effectiveness of the SSL-FT on four public datasets including ShanghaiTech PartA, PartB, UCF-QNRF and WorldExpo'10 utilizing a classical counting model. Experimental results show that our approach performs better than state-of-art semi-supervised methods.
Keyword:
Data models
Head
Self-supervised learning
Annotations
Training
Task analysis
Computational modeling
Crowd counting
augmentation transformation
self-supervised learning
self-supervised loss

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Potential role of serum level of soluble CD44 and IFN-γ in B-cell chronic lymphocytic leukemia
err2010-08-31
err0
PREAI
errNervana Samy; M. D. Abd El-Maksoud; T. E. Mousa; Hatem A. El-Mezayen; Mohamed Shaalan
err分享
err收藏
Network Theory in Prebiotic Evolution
err2018-08-02
err0
PREAI
errSara Imari Walker; Cole Mathis
err分享
err收藏
Mining Closed Colossal Frequent Patterns from High-Dimensional Dataset: Serial Versus Parallel Framework
err2017-07-13
err0
PREAI
errSudeep Sureshan; Anusha Penumacha; Siddharth Jain; Manjunath Vanahalli; Nagamma Patil
err分享
err收藏
Knowledge of medications among patients with glaucoma in Taiwan
err2019-01-01
err0
errOAAI
errMei Lan Ko; Kai Lin Wei; Yi-Jung Ho; Pai Huei Peng; Henry Horng Shing Lu
err分享
err收藏
Transcription Factor and miRNA Interplays Can Manifest the Survival of ccRCC Patients
err2019-10-28
err0
errOAAI
errShijie Qin; Xuejia Shi; Canbiao Wang; Ping Jin; Fei Ma
err分享
err收藏
学者 查看更多内容