arrow
返回

Multi-Task Credible Pseudo-Label Learning for Semi-Supervised Crowd Counting

delete2024-08-01
delete15
PRE
AI
P
Pengfei Zhu
J
Jingqing Li
B
Bing Cao *
胡清华 封面图
胡清华 (Qinghua Hu)
DOI:10.1109/TNNLS.2023.3241211delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As a widely used semi-supervised learning strategy, self-training generates pseudo-labels to alleviate the labor-intensive and time-consuming annotation problems in crowd counting while boosting the model performance with limited labeled data and massive unlabeled data. However, the noise in the pseudo-labels of the density maps greatly hinders the performance of semi-supervised crowd counting. Although auxiliary tasks, e.g., binary segmentation, are utilized to help improve the feature representation learning ability, they are isolated from the main task, i.e., density map regression and the multi-task relationships are totally ignored. To address the above issues, we develop a multi-task credible pseudo-label learning (MTCP) framework for crowd counting, consisting of three multi-task branches, i.e., density regression as the main task, and binary segmentation and confidence prediction as the auxiliary tasks. Multi-task learning is conducted on the labeled data by sharing the same feature extractor for all three tasks and taking multi-task relations into account. To reduce epistemic uncertainty, the labeled data are further expanded, by trimming the labeled data according to the predicted confidence map for low-confidence regions, which can be regarded as an effective data augmentation strategy. For unlabeled data, compared with the existing works that only use the pseudo-labels of binary segmentation, we generate credible pseudo-labels of density maps directly, which can reduce the noise in pseudo-labels and therefore decrease aleatoric uncertainty. Extensive comparisons on four crowd-counting datasets demonstrate the superiority of our proposed model over the competing methods. The code is available at: https://github.com/ljq2000/MTCP.
Keyword:
Task analysis
Uncertainty
Multitasking
Data models
Predictive models
Feature extraction
Semisupervised learning
Crowd counting
multi-task learning
self-training
semi-supervised

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

A retrospective cross-national examination of COVID-19 outbreak in 175 countries: a multiscale geographically weighted regression analysis (January 11-June 28, 2020)
err2020-10-01
err0
errOAAI
errAyodeji Emmanuel Iyanda; Richard Adeleke; Yongmei Lu; Tolulope Osayomi; Adeleye Adaralegbe; Mayowa Lasode; Ngozi J. Chima-Adaralegbe; Adedoyin M. Osundina
err分享
err收藏
The Role of Multiple Large Shareholders in the Choice of Debt Source
err2016-11-04
err0
PREAI
errSabri Boubaker; Wael Rouatbi; Walid Saffar
err分享
err收藏
Transcription Factor and miRNA Interplays Can Manifest the Survival of ccRCC Patients
err2019-10-28
err0
errOAAI
errShijie Qin; Xuejia Shi; Canbiao Wang; Ping Jin; Fei Ma
err分享
err收藏
学者 查看更多内容