arrow
Return

Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting

delete2023-01-01
delete9
PRE
AI
R
Rui Wang
Y
Yixue Hao
L
Long Hu *
J
Jincai Chen *
陈
陈敏 (Min Chen) *
D
Di Wu
DOI:10.1109/TMM.2023.3251106delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to the expensive and laborious annotations of labeled data required by fully-supervised learning in the crowd counting task, it is desirable to explore a method to reduce the labeling burden. There exists a large number of unlabeled images in the wild that can be easily obtained compared to labeled datasets. Based on the characteristics of consistent spatial transformation with the annotations of heads and image, this paper proposes a self-supervised learning framework with unlabeled and limited labeled data for pre-training and fine-tuning crowd counting model (SSL-FT). It includes an online network and a target network that receive the same images but are randomly processed by two defined augmentation transformations. We leverage unlabeled data to pre-train the online network based on a self-supervised loss and small-scale labeled data to transfer the model to a specific domain based on a fully-supervised loss. We demonstrate the effectiveness of the SSL-FT on four public datasets including ShanghaiTech PartA, PartB, UCF-QNRF and WorldExpo'10 utilizing a classical counting model. Experimental results show that our approach performs better than state-of-art semi-supervised methods.
Keywords:
Data models
Head
Self-supervised learning
Annotations
Training
Task analysis
Computational modeling
Crowd counting
augmentation transformation
self-supervised learning
self-supervised loss

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Potential role of serum level of soluble CD44 and IFN-γ in B-cell chronic lymphocytic leukemia
err2010-08-31
err0
PREAI
errNervana Samy; M. D. Abd El-Maksoud; T. E. Mousa; Hatem A. El-Mezayen; Mohamed Shaalan
errShare
errSave
Use of Plastic Embedding Materials
err1974-07-01
err0
PREAI
errJ. A. Sandham; J. D. McEwen
errShare
errSave
Network Theory in Prebiotic Evolution
err2018-08-02
err0
PREAI
errSara Imari Walker; Cole Mathis
errShare
errSave
Mining Closed Colossal Frequent Patterns from High-Dimensional Dataset: Serial Versus Parallel Framework
err2017-07-13
err0
PREAI
errSudeep Sureshan; Anusha Penumacha; Siddharth Jain; Manjunath Vanahalli; Nagamma Patil
errShare
errSave
Knowledge of medications among patients with glaucoma in Taiwan
err2019-01-01
err0
errOAAI
errMei Lan Ko; Kai Lin Wei; Yi-Jung Ho; Pai Huei Peng; Henry Horng Shing Lu
errShare
errSave
Transcription Factor and miRNA Interplays Can Manifest the Survival of ccRCC Patients
err2019-10-28
err0
errOAAI
errShijie Qin; Xuejia Shi; Canbiao Wang; Ping Jin; Fei Ma
errShare
errSave
researcher View more